Comment by KronisLV
13 hours ago
Note that you also might need to think a little bit about caching: https://openrouter.ai/docs/guides/best-practices/prompt-cach...
Depending on the way how the context grows, it can matter quite a bit!
13 hours ago
Note that you also might need to think a little bit about caching: https://openrouter.ai/docs/guides/best-practices/prompt-cach...
Depending on the way how the context grows, it can matter quite a bit!
Great call out! Yes I have tried to follow these, to make Consensus compliant with OpenRouter's prompt caching best practices.