Comment by dudeinhawaii

To echo this, this is where Astra begins to stand out as a larger model and Opus begins to show certain cracks. I find Astra more adaptive, even as Opus is more capable in most coding/execution/tool-use domains. Fable-5.1 would be interesting here as it would presumably have a similar "large model" expansive reasoning and adaptation.

Anecdotally, in game benchmarks I've run, OpenAI models seem particularly adept at finding the meta game and exploiting it...