Comment by hashstring

No, we have benchmarks for (pseudo-)objective measurements of capabilities. We have flashy news stories on repeat for marketing.

The point is that they are separate things. If you start mixing them up, analysis becomes more biased and less objective.

EDIT: And do not mistake this for transparency of ClosedAI either. Their incident report was so generic that no one serious can learn much from it anyway except that “a zeroday” was allegedly used. Very helpful…