Comment by peri-cl

10 hours ago

The writeup fails to disclose that they quietly redacted several open-weight models from the new benchmark. Popular ones. They're not on the charts; they're not available to manually add to the charts; and their individual model pages now display scores of "N/A".

GLM 5.3-flash: N/A

https://artificialanalysis.ai/models/glm-5-3-flash/

Qwen 3.8-flash-next: N/A

https://artificialanalysis.ai/models/qwen3-8-flash-next

Why did they do that? Any ideas?

  • Their previous updates have sometimes been really bad for Chinese models. Either by exclusion, delays or simply weighting things differently so OpenAI looks better.

    This feels like the opposite of benchmaxing. Maybe "minbenching" can become a word now?