Slacker News Slacker News logo featuring a lazy sloth with a folded newspaper hat
  • top
  • new
  • show
  • ask
  • jobs
Library
← Back to context

Comment by StevenWaterman

17 hours ago

Cached tokens are cheaper (90% discount ish) but not free

2 comments

StevenWaterman

Reply

moyix  17 hours ago

Also, unlike OpenAI, Anthropic's prompt caching is explicit (you set up to 4 cache "breakpoints"), meaning if you don't implement caching then you don't benefit from it.

  • netcraft  16 hours ago

    thats a very generous way of putting it. Anthropic's prompt caching is actively hostile and very difficult to implement properly.

Slacker News

Product

  • API Reference
  • Hacker News RSS
  • Source on GitHub

Community

  • Support Ukraine
  • Equal Justice Initiative
  • GiveWell Charities