Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Llama.cpp has an interactive mode, but I don't think text-generation-webui uses it. https://github.com/ggerganov/llama.cpp/blob/master/examples/...


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: