Comment by nl

On my Agentic SQL benchmark it scores 19/25. That's... mediocre.

It means performs worse than 3.1 Flash Lite Preview (22/25), is slower (367s vs 142s) and is more expensive (75c vs 2c).

It is outperformed by Gemma4 26B-A4B in every way(!)

https://sql-benchmark.nicklothian.com/?highlight=google_gemi...

(Switch to the cost vs performance chart to see how far this is off the Pareto frontier)