Comment by scosman

5 hours ago

Excluding Opus 5.1 from the coding benchmarks is telling. Opus 5 already matches Astra, Opus 5.1 is much better than 5, and 5.5 is much better again.

OpenAI seems really competitive in most areas, and extremely competitive on cost, but still behind on coding.