Comment by londons_explore
1 day ago
Grok is according to most benchmarks pretty close to SOTA. It is where the leaders were just a few weeks ago.
Which exactly is best changes on almost a weekly basis as different companies tweak their best model. I doubt the military would want to be switching supplier every week.
I think that tells you more about the uselessness of SOTA benchmarks.
I think it says more about people's ability to ignore the truth if it doesn't support their world view. Oh you don't want Grok to be SOTA? Then it isn't! Problem solved