Comment by jauntywundrkind

Its crazy that people think caching is such a silver bullet, despite the cost of long context windows still being ridiculously high even with caching. https://news.ycombinator.com/item?id=47000034