Is the output as good? I'd love the ability to run the LLM locally, as that woul... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		mooreds 4 months ago \| parent \| context \| favorite \| on: Show HN: I built an AI that turns GitHub codebases... Is the output as good? I'd love the ability to run the LLM locally, as that would make it easier to run on non public code.

fforflo 4 months ago [–]

It's decent enough. But you'd probably have to use a model like llama2, which may set your GPU on fire.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact