Not really: 5090: 210 TF / $2k == 105 TF/$k B200: 2250 TF / $40k == 56 TF/$k Get... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		neilmovva 3 months ago \| parent \| context \| favorite \| on: Writing Speed-of-Light Flash Attention for 5090 in... Not really: 5090: 210 TF / $2k == 105 TF/$k B200: 2250 TF / $40k == 56 TF/$k Getting only 2x the FLOPs per dollar probably isn't worth the hassle of having to rack 10x as many GPUs, while having no NVLink.

lossolo 3 months ago | [–]

One of the reasons they removed NVLink from consumer cards (they supported it before). There’s also an issue with power consumption (1xB200 vs 10x5090)

steinvakt2 3 months ago | [–]

Sure, but when spending 20x more, getting almost twice the compute per buck seems expected

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact