Comment by hiq
2 days ago
I didn't know about this limitation from openrouter, and I thought plenty of users were using it to quickly switch as needed without incurring such a penalty. Why does there seem to be so many users then? Are some folks just fine paying multiples of what they could?
I really don't know. It was built before prompt caching was common, and the switching cost was much lower.