The new AWS. From 2007-2009 there were countless AWS outages, a lot of heckling, including from my part as I ran on bare metal using Rackspace. Lo and behold AWS became a behemoth and a significant majority of workloads moved there. OpenAI is starting to feel like that. There's going to be countless outages, there will be a lot of people throwing shade at it, maybe even me..., but they're going to come out as a formidable force and a new foundation for the next generation of apps.
I really hope we see some open alternatives to OpenAI, the cloud space has largely been a sh*tshow. The choices aren't great, it's either crufty AWS or the trigger happy deprecating folks at Google Cloud. Azure tends to be quite painful to use. And well the rest of the landscape is a bunch of niche tools so we never really got even distribution and we never ended up with Android for Cloud, which should be a thing.
It's not clear Stable Difussion or stability.ai is creating anymore of a democracy amongst AI tools considering the cost of running these things. We need some sort of community led infrastructure where we can pool resources/cash and feel like there's a sense of ownership over this stuff that isn't directly attributed to corporations e.g maybe we could co-op community led AI infra and pay people a dividend for their contribution to it.
The PETALS project is a step in the right direction. A network of GPUs allows you to do inference (and even retrieve activations!) for the BLOOM model, a model so big it won’t fit on most regular hardware
> So many startups and AI-powered features are simultaneously down right now.
That doesn't sound like a good thing? In fact, this is all what this so-called hype of chatbots is - sitting on someone else's API isn't revolutionary.
> Reminds me of the early days of cloud providers.
Reminds me of the monthly GitHub outages. If they still cannot reduce those outages after years since the acquisition, then I would expect OpenAI to experience frequent outages as well.
Build your own rails and infra as a core competency. Know how to run and manage GPU workers. (Granted, we're not hosting our own video yet, but want to skip to WASM/WebGPU - we're hiring for this.)
That said, OpenAI playground is such a big part of my exploratory workflow now, and my flow got interrupted. I've been taken offline and am now I'm in a Twitter / HN loop.
I jumped on your site, a live stream started and some cat/Meowth like figure started talking about a delayed flight from New Zealand to "US" (pronounced "US"). Suffice to say, I guess we will be seeing an explosion of fake AI generated tutorial and "news" videos spoken by "AI" voices on youtube. :/
I guess it might be better than a tutorial video with a thick accent?
We're putting the finishing touches on narrative and will have a completely retooled news station shortly. We can scale the shit out of this, and that's just my team.
Cost structures of content of all types are going to zero. We can make music, change Taylor Swift songs to Beyonce, populate scenes with actors, ...
This thread is very very deep in the uncanny valley for me. From the reduced availability because of segfaults, over the cats talking about flight delays to scaling the shit out of it. While, obviously, the website exists. Is this parody?
so outage was more than 5 hours. For some project like Chatgpt, I bet OpenAI would have SLA for less than 4 hours . The company needs to focus also look at Devops not just AI.
I really hope we see some open alternatives to OpenAI, the cloud space has largely been a sh*tshow. The choices aren't great, it's either crufty AWS or the trigger happy deprecating folks at Google Cloud. Azure tends to be quite painful to use. And well the rest of the landscape is a bunch of niche tools so we never really got even distribution and we never ended up with Android for Cloud, which should be a thing.
It's not clear Stable Difussion or stability.ai is creating anymore of a democracy amongst AI tools considering the cost of running these things. We need some sort of community led infrastructure where we can pool resources/cash and feel like there's a sense of ownership over this stuff that isn't directly attributed to corporations e.g maybe we could co-op community led AI infra and pay people a dividend for their contribution to it.