← Back to context Comment by sebzim4500 4 days ago Presumably it drops back to 4.8 in those cases so it's not really worse 2 comments sebzim4500 Reply bobbylarrybobby 4 days ago If it switches mid conversation, this is a massive increase in token consumption because it has to re-read your conversation into cache, right? tyre 4 days ago yes. At the bottom of the release post it says that they are releasing two new features, one of which is customizing fallback behavior instead of blocking for restricted models
bobbylarrybobby 4 days ago If it switches mid conversation, this is a massive increase in token consumption because it has to re-read your conversation into cache, right?
tyre 4 days ago yes. At the bottom of the release post it says that they are releasing two new features, one of which is customizing fallback behavior instead of blocking for restricted models
If it switches mid conversation, this is a massive increase in token consumption because it has to re-read your conversation into cache, right?
yes. At the bottom of the release post it says that they are releasing two new features, one of which is customizing fallback behavior instead of blocking for restricted models