← Back to context

Comment by nik736

6 hours ago

Mistral has solid OCR, STT and TTS models and I would love to support them by switching with all of our business workloads to Mistral... but their LLM models are sadly not competitive at all. In our business benchmarks their Mistral Medium 3.5 with reasoning is worse than Gemma 4 31B and Glimmer 30B. It's a 128B dense model that's priced accordingly! Mistral Small 4 is way worse than Gemma 4 26B A4B. I applaude the effort that they release those models as open weight but Gemma 4 models are currently way easier to run with more tok/s and less hardware. Their API pricing is just insane for what you get. But I guess enterprise customers don't care about it, this is why they are probably not lowering it.

> Mistral Small 4 is way worse than Gemma 4 26B A4B

Depends for what purpose? I found large Mistrals are massively better than Gemma 4 at creative writing: have more natural tone, better consistency than 26B as it is MoE.