Comment by pzh
19 hours ago
Because it's typically cached for 5min (1hr is a setting you have to explicitly opt into), and very few people run loops at a cadence of < 5 mins.
19 hours ago
Because it's typically cached for 5min (1hr is a setting you have to explicitly opt into), and very few people run loops at a cadence of < 5 mins.
https://code.claude.com/docs/en/prompt-caching#on-a-claude-s...
"On a Claude subscription, Claude Code requests the one-hour TTL automatically. Usage is included in your plan rather than billed per token, so the longer TTL costs you nothing extra and only affects how long your cache stays warm. If you’ve gone over your plan’s usage limit and Claude Code is drawing on usage credits, you are billed for that usage, so Claude Code automatically drops the TTL to five minutes."
Oh! I thought Anthropic cached for one hour (by default), am I wrong about that? Or is this an OpenAI thing?
Anthropic changed their cache duration for some reason a while back.