The new AWS. From 2007-2009 there were countless AWS outages, a lot of heckling, including from my part as I ran on bare metal using Rackspace. Lo and behold AWS became a behemoth and a significant majority of workloads moved there. OpenAI is starting to feel like that. There's going to be countless outages, there will be a lot of people throwing shade at it, maybe even me..., but they're going to come out as a formidable force and a new foundation for the next generation of apps.
I really hope we see some open alternatives to OpenAI, the cloud space has largely been a sh*tshow. The choices aren't great, it's either crufty AWS or the trigger happy deprecating folks at Google Cloud. Azure tends to be quite painful to use. And well the rest of the landscape is a bunch of niche tools so we never really got even distribution and we never ended up with Android for Cloud, which should be a thing.
It's not clear Stable Difussion or stability.ai is creating anymore of a democracy amongst AI tools considering the cost of running these things. We need some sort of community led infrastructure where we can pool resources/cash and feel like there's a sense of ownership over this stuff that isn't directly attributed to corporations e.g maybe we could co-op community led AI infra and pay people a dividend for their contribution to it.
The PETALS project is a step in the right direction. A network of GPUs allows you to do inference (and even retrieve activations!) for the BLOOM model, a model so big it won’t fit on most regular hardware
I really hope we see some open alternatives to OpenAI, the cloud space has largely been a sh*tshow. The choices aren't great, it's either crufty AWS or the trigger happy deprecating folks at Google Cloud. Azure tends to be quite painful to use. And well the rest of the landscape is a bunch of niche tools so we never really got even distribution and we never ended up with Android for Cloud, which should be a thing.
It's not clear Stable Difussion or stability.ai is creating anymore of a democracy amongst AI tools considering the cost of running these things. We need some sort of community led infrastructure where we can pool resources/cash and feel like there's a sense of ownership over this stuff that isn't directly attributed to corporations e.g maybe we could co-op community led AI infra and pay people a dividend for their contribution to it.