Comment by lukethorham

19 hours ago

I wonder if something like this is the undisclosed new approach from Anthropic that presumably has massive improvements by combining multiple models. Leveraging decision models as much as possible seems logical for extra speed and token efficiency.

4 comments

lukethorham

Reply
couldaidothis  19 hours ago

I think OpenAI and Anthropic have both been doing similar "routing" approaches for a while. Wasn't OpenAI one of the first to have a small model start responding to you for the first several tokens so that you got an instant response while the big model became available?

Similarly, Grok has been routing to Opus internally for a little while now I think.

2001zhaozhao  19 hours ago

> undisclosed new approach from Anthropic

Any source on that?

  • lukethorham  15 hours ago

    There’s a METR audit document which apparently describes various unreleased models. This is discussed in a YT video by Wes Roth. I have no firsthand knowledge about it.