Comment by petesergeant

I use it purely for finding stuff in text documents and OCR, at which it excels, but I've found that for any kind of analysis it's some bewildering mixture of smug, defensive, paranoid, cheerful, and wrong about everything.

I feel like the headline here is "the Artificial Analysis index is becoming an increasingly poor measure of capability, having previously been quite good".