Comment by zarzavat
6 hours ago
I don’t care and in my opinion AA does a disservice to their users by allowing such blatant manipulation. What would happen if every AI company were to include their unreleased models like this? Put the unreleased models on a separate page and leave the headline benchmark rankings for models that you can actually use.
AA (like most other VC-funded benchmark sites) is pay-to-play.
Want a private benchmark and see where you'd rank? $$$.
Want to show up day 0? $$$$.
Want to show up day -0? $$$$$.
What the AA charts say is irrelevant to me.