Comment by denverllc 3 hours ago Write a detailed plan using a more expensive model and implement it using the cheaper one. 3 comments denverllc Reply blfr 3 hours ago How much are you saving once the more expensive model already has all the context loaded and ready to go? csullivannet 3 hours ago API calls get more expensive, not less, as you've loaded more context. This is exactly when you want to switch to cheaper models. camdenreslink 7 minutes ago There is caching to consider. Switching models throws away the cached tokens.
blfr 3 hours ago How much are you saving once the more expensive model already has all the context loaded and ready to go? csullivannet 3 hours ago API calls get more expensive, not less, as you've loaded more context. This is exactly when you want to switch to cheaper models. camdenreslink 7 minutes ago There is caching to consider. Switching models throws away the cached tokens.
csullivannet 3 hours ago API calls get more expensive, not less, as you've loaded more context. This is exactly when you want to switch to cheaper models. camdenreslink 7 minutes ago There is caching to consider. Switching models throws away the cached tokens.
camdenreslink 7 minutes ago There is caching to consider. Switching models throws away the cached tokens.
How much are you saving once the more expensive model already has all the context loaded and ready to go?
API calls get more expensive, not less, as you've loaded more context. This is exactly when you want to switch to cheaper models.
There is caching to consider. Switching models throws away the cached tokens.