Related question: what is everyone using to run a local LLM? I'm using Jan.ai an... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

		nosecreek 12 days ago \| parent \| context \| favorite \| on: Ask HN: What is the best LLM for consumer grade ha... Related question: what is everyone using to run a local LLM? I'm using Jan.ai and it's been okay. I also see OpenWebUI mentioned quite often.

Havoc 12 days ago | [–]

LM studio if you just want an app. openwebui is just a front end - you'd need to have either llama.cpp or vllm behind it to serve the model

op00to 12 days ago | | [–]

LMStudio, and sometimes AnythingLLM.

fennecfoxy 12 days ago | [–]

KoboldCPP + SillyTavern, has worked the best for me.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact