Comment by ActionHank
12 hours ago
"Going forward we will capitulate and still try to keep the integrity of our benchmark in tact, but from now on every benchmark will be compromised with providers being able tweak things sufficiently to game at least a 30% bump in results."
"I'll twist the words of the author of the benchmark itself to make a point"
"I refuse to see the wall that I am running directly into, because if I see it I will hit it"
If you mean a capability wall, the author of the benchmark says this
>We see Astra as a major breakthrough in model intelligence.
You think the author of the benchmark is also in the conspiracy