Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I did not claim llama was open source, but I see the url I posted insinuates that (probably for a contorted meaning of open source, as in source available for approved academics).

Anyway, T5 being available for download from Huggingface only makes my question more pertinent...



I made an app for running t5 locally - compiled version allows you to run without installing anything.

https://capsizegames.itch.io/chat-ai

https://github.com/Capsize-Games/chatai


interesting, what are the hardware requirements?

does it happen to run on CPU on a server with 96GB RAM?


the compiled app is meant for people to install and use with their GPU and runs on as low as a GTX 1080. I haven't tested against CPU only builds.

You can take a look at the source code and see if it would be useful to you.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: