Comment by dymk
2 days ago
It’s crazy that people don’t understand cached tokens despite them being priced separately on the cost pages of every single provider.
2 days ago
It’s crazy that people don’t understand cached tokens despite them being priced separately on the cost pages of every single provider.
Its crazy that people think caching is such a silver bullet, despite the cost of long context windows still being ridiculously high even with caching. https://news.ycombinator.com/item?id=47000034
> It’s crazy that people don’t understand cached tokens despite them being priced separately on the cost pages of every single provider.
Depends on your subscription type. Some are just a flat monthly fee.
Those aren't the people worrying about token counts, then.