Comment by mariopt

13 hours ago

I think it's pretty evident that Artificial Analysis loves to change the benchmark to place US models on the top, it's no the first time either.

The current placement of many models simply doesn't makes sense, GLM 5.3 is so much better than Astra at backend tasks, Astra does the most weird nonsensical bugs.

This is what happens when the benchmark team is funded by VC capital.

The thing that makes the least sense is that Haiku 5.5 is apparently better than every single open weight model in existence except Kimi K3.1. Which is just... not true. I feel like I don't even have to explain it to anyone who has touched both sides of that equation for more than three minutes.

Even and especially for frontend UI, GLM 5.3 is a whole world better than Astra.

I can see (and believe) Astra beating GLM 5.3 on verifiable hard domains like maths, etc; but we’re at this stage where intelligence scores and even ‘frontier real world unsaturated benchmarks’ really doesn’t reflect real world use anymore.