Comment by timr

6 days ago

It’s not a universal win, but grok outperforms on 2 of the metrics, and is close on a third.

Image editing: banana 1308, grok 1329

Image generation: banana 1251, grok 1174 (grok loses, but is close)

Cost: banana 3.4 cents, grok 2 cents

Grok is a good image model, so it isn’t totally surprising, but it’s weird that they’d pick a set of metrics where they’re not the clear winner.