Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Why wouldn't you turn on prompt caching? There must be a reason why it's a toggle rather than just being on for everything.


Writing to the cache is more expensive than a request with caching disabled. So it only makes economic sense to do it when you know you're going to use the cached results. See https://docs.claude.com/en/docs/build-with-claude/prompt-cac...


When you know the context is a one-and-done. Caching costs more than just running the prompt, but less than running the prompt twice.




Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: