Depending on the length of the outage I think this could be a good third party dependency test. Do people chaos monkey test all their third party dependencies? e.g. block them for a day? Will schools notice?
We switch between claude and chatgpt auto (with a preference for claude when it's up), so we don't notice anything. Hopefully llama or so will be good enough some day, so we can just spin up a Vast machine when both are down or run off a local machine entirely.
That's cool. I was not aware they had reached response parity yet. So in this case everyone would just need to do the same thing you did and have automatic failover to multiple providers. I guess that makes it a mostly non issue for businesses.
We made a lot of tooling around llms for years now, so they don't need to have responsive parity exactly to be switchable for what we use them for. No other models work yet though: we sometimes try, with very varying results; definitely not ready for prime time.
Some engineers at OpenAI are about to find out that their Christmas travel plans are cancelled.