Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
evilduck
24 days ago
|
parent
|
context
|
favorite
| on:
Ask HN: What is the best LLM for consumer grade ha...
With a 16GB GPU you can comfortably run like Qwen3 14B or Mistral Small 24B models at Q4 to Q6 and still have plenty of context space and get much better abilities than an 8B model.
Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: