Comment by couldaidothis

I think OpenAI and Anthropic have both been doing similar "routing" approaches for a while. Wasn't OpenAI one of the first to have a small model start responding to you for the first several tokens so that you got an instant response while the big model became available?

Similarly, Grok has been routing to Opus internally for a little while now I think.