Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Does it ever just use the code that works and no longer makes calls to any LLM?


Great question! That is one of the ideas that we have on the roadmap and seems quite exciting to us. The general feasibility of switching the function execution over from a LLM to synthesised code depends on the specific use-case and if a deterministic program can solve the use-case well enough (or atleast as well as the SOTA LLMs can). But for all those cases where this could be done, the cost and latency of executing the program would become essentially 0




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: