I mean, you can look at the most recent commit and see that the infrastructure is being built out for this right now (of course OpenAI doesn't care about sm_120, though).
By all means, the guy could have written the triton fixes he needs and NOT sent it up stream. It would still make more sense to do that! He’s obviously an expert, and I was sincerely wondering, why bother with the C++ stuff if he already knew the better way, and also has the chops to implement it?
The APIs are marginally profitable. You can calculate the lifecycle costs of the open models on clusters in batched inference and figure out its less than than what they charge.
The training and researches are very expensive. The fixed price subscriptions are 100% a sweetheart deal.
OpenAI for its part is tracking to $12-$15 billion in annual sales. If they slapped a basic ad model for referring onto what they're already doing, it's an easily profitable enterprise doing $30+ billion in sales next year. Frankly they should have already built and deployed that, it would make their free versions instantly profitable and they could boost usage limits and choke off the competition. It's the very straight-forward path to financially ruining their various weaker competition. Anthropic is Lyft in this scenario (and I say that as a big fan of Claude).
You can go below one byte per parameter. 4-bit quantization is fairly popular. It does affect quality - for some models more so than others - but, generally speaking, a 4-bit quantized model is still going to do significantly better than an 8-bit model with 1/2 parameters.
Greater return for the government paying for a UBI, compared to not paying for a UBI.
> We already have existing labor markets that are very capable of determining returns.
I'm not sure I understand how "existing labour markets" are going to solve the three things I listed: education, caregiving, and parents taking time off to look after their kids.
The issue of parents being absent is that it results in negative externalities: crime rate, an alienated society, low literacy rates. The existing labour market is great at placing parents into a job efficiently, but it has absolutely nothing to do with keeping their kids out of prison. Nor should it, really, because externalities are a government-level coordination problem.
When it comes to education, the issue is again a coordination problem. Companies might do some training, but they generally prefer to foist the risk off onto employees, other companies, and governments by hiring people who are already educated. Again, this is a coordination problem, because any individual company that skips training and just hires educated workers directly will be more efficient, but those educated workers have to come from somewhere.
I will concede that it's more efficient not to take care of the elderly. I question whether it is desirable, however.
Yes.
reply