> Also, I assume financial applications such as hedge funds would be buying thes... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		deadmutex 11 months ago \| parent \| context \| favorite \| on: Llama 3.1 405B now runs at 969 tokens/s on Cerebra... > Also, I assume financial applications such as hedge funds would be buying these things in bulk now. Please elaborate.. why?

aurareturn 11 months ago [–]

I'm assuming hedge funds are using LLMs to dissect information from company news, SEC reports as soon as possible then make a decision on trading. Having faster inference would be a huge advantage.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact