← Back to context

Comment by terhechte

5 hours ago

There's an issue with this index where many models are listed in the model chooser, but missing from the index. E.g. Qwen 3.8 Flash Next is listed but missing, as are older Claude (4.6, 4.5, etc) or OpenAI models. This makes it a bit tricky to see the improvements over time.

3 comments

terhechte

Reply
peri-cl  5 hours ago

They removed Qwen Flash Next and GLM Flash from their benchmarks, as of two days ago. They're not publishing any figures at all for them (they show as "N/A").

https://artificialanalysis.ai/models/qwen3-8-flash-next

https://artificialanalysis.ai/models/glm-5-3-flash/

edit to add: It's very disturbing, because these open models (GLM particularly) were among the best of all LLM's on their benchmarks. On the intelligence/cost frontier, specifically. Archive.org remembers that GLM Flash was in their green quadrant just a few days ago, next to Haiku:

https://web.archive.org/web/20261014031624/https://artificia...

It's completely gone now. AAI (as far as I've seen) haven't publicly commented about why they did this.

  • auspiv  4 hours ago

    well if there was any doubt about why openweight models were ranking lower on every iteration of the benchmarks... this should remove all doubt. to just flat out remove is very overt