← Back to context

Comment by spwa4

12 hours ago

... and it was not SOTA at the time of release. Gemini 3.1 Pro was previewed on 19 February 2026. It just barely beat GPT-5.3 and was roughly equal with Sonnet 4.6. Better according to some, worse according to others. And that lasted about 10 days (until GPT-5.4 came out which was also not a huge jump). And these are large averages. On coding or terminal Gemini 3.1 Pro was not close to Opus 4.6. Also it only matches the GLM 5 open model, more or less.

Last time Google had a "everybody agrees" SOTA model was Gemini 3 in November 2025, it beat GPT-5.1, it really was better and held it for a month.

Currently Google's best model doesn't match open models, in any category (performance, price or speed), in fact the last 4 open weight champions all beat Google's best model.

Here's a plot of the evolution: https://www.reddit.com/r/LocalLLaMA/comments/1v20g29/kimik3_...

I don't agree with you on what the term SOTA means. Gemini Pro 3.1 was the only frontier model that had native video input at launch. It was certainly SOTA at some tasks.