Not the original commenter but I’ve done this too with Pydantic AI (actually the... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

richin13 14 days ago | parent | context | favorite | on: Progressive JSON

Not the original commenter but I’ve done this too with Pydantic AI (actually the library does it for you). See “Streaming Structured Output” here https://ai.pydantic.dev/output/#streaming-structured-output

tough 14 days ago [–]

Thanks yes! Im aware of structured outputs, llama.cpp has also great support with GBNF and several languages beyond json.

I've been trying to create go/rust ones but its way harder than just json due to all the context/state they carry over

Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact