Comment by esafak
5 hours ago
Look at the Intelligence Index vs. Cost per Task. Mistral 4 is not competitive. https://artificialanalysis.ai/#intelligence-efficiency-tabs
5 hours ago
Look at the Intelligence Index vs. Cost per Task. Mistral 4 is not competitive. https://artificialanalysis.ai/#intelligence-efficiency-tabs
Irregardless of wether or not Mistral Large 4 is competitive or not, I do not trust the AA numbers anymore, for various reasons. Them changing their numbers around so much recently brings the entire validity of this in question, not to mention if such a combined number is even important at all. The combined "intelligence" score of AA includes areas I do not care about or need at all.