I pay 78 cents an hour to host Llama. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		BoorishBears 7 months ago \| parent \| context \| favorite \| on: Ingesting PDFs and why Gemini 2.0 changes everythi... I pay 78 cents an hour to host Llama.

beastman82 7 months ago [–]

Vast? Specs?

BoorishBears 7 months ago | [–]

Runpod, 2xA40.

Not sure why you think buying an entire inference server is a necessity to run these models.

Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact