Comment by A_D_E_P_T
14 hours ago
OpenAI's models -- and even Google's Argon -- have particular niches where they shine. For GPT-6/6.1, it's 3D modeling; Astra is hands-down the best at making .step files, Blender files, etc. For Argon, it's natural language writing and everything that hooks up to Google, e.g. search and maps-based itinerary planning.
Anthropic and DeepSeek (+ GLM) are definitely solving coding, though!
They're all quite different tools.
Artificial Analysis recently released a dedicated 3D benchmark, where Astra lags behind both Opus and Sonnet 5.5 (and yes, open weight models seem to be quite far behind).
https://artificialanalysis.ai/articles/aa-3d
Interesting!
For me it's large files in Blender (in some cases >400MB), mostly, where Astra excels. I gave it a look, but I don't know if the benchmark encompasses that sort of thing.
.step files are simpler pieces of straightforward code, so it makes sense that Opus and Sonnet 5.5 do very well...
its unfortunate they didn't include deepseek in the initial batch of benchmarks