Comment by chriddyp

Ran on our Data Analytics benchmark: https://plotly.com/blog/gemini-4-argon-plotly-data-analytics...

Excellent model. Same price and score as Opus 5.5 in our 23 question exam.

This size / class of model is now a bit overpowered for these short-horizon data analytics tasks. OpenAI 6.1-Sol, Haiku 5.5, GLM 5.3 Flash all achieve about the same results but for ~1/10th the cost.

In other words, we're getting to the stage where models are "good enough" for certain tasks like data analytics and competitiveness is going towards size & speed.