Comment by chriddyp
2 hours ago
Just ran this through our data analytics benchmark (I work at Plotly).
It's 10x cheaper than Mistral Medium 3.5 from April and goes from 58% to 74% correct. Definitely a generational shift.
It's not on the Pareto curve yet, but it's good enough for data analytics, and at this rate I suspect it'll be excellent in another few months.
Full write up: https://plotly.com/blog/mistral-large-4-plotly-data-analytic...
If I'm reading that plot correctly, qwen3.8-27b beats in accuracy and price?