Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Well I guess this is the best time to say that HuggingFace hosts many open source chat models, one of my favorites is a finetuned version of Mistral 7B: https://huggingface.co/spaces/HuggingFaceH4/zephyr-chat


Thanks for letting me know about this. I'd experimented with some local LLM's before, but at the time I couldn't find a good model that was small enough to run on my 3080 Ti. This one is just small enough for me to run at a useable speed (just over 1 token per second), and so far seems to be nearly as good as GPT3.5.


I didn't know about this. It's pretty damn good. Thanks!


How do they make money if its free?


They don't. They're on several rounds of VC.


TIL about Spaces. Really cool stuff!




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: