Comment by Macuyiko
15 days ago
Adding my five cents: initial usage through OpenRouter has been great. Very fun model to spar with, clever, intelligent. On par with Opus 5.5 but without the Claudism's and more of a Sol type of conversation. Though speaking of Sol, I've been very dissapointed with Sol 6.1 to the extent that I feel OpenAI has neutered it compared to a few months ago. Especially when giving it goals it will happily run in dumb circles just burning tokens without any real work.
Here are sites with ongoing measurements checking if a model has been nerfed:
https://www.bridgebench.ai/nerf-bench
https://marginlab.ai/trackers/claude-code/ https://marginlab.ai/trackers/codex/
https://github.com/ninjahawk/livenerf
https://isitnerfed.org/
Sol 6.1 was released two weeks ago!
Yes sorry, I meant compared to the flagship models of a few months ago, < 6.1.
Definitely agree. Sol 5.6 was great when it was released and for nearly a month.
Since then they cut the price but the intelligence (of 6 and 6.1) has gone down to Sonnet 4 levels. I am back in a world where the model is lazy, cuts corners, ignores existing coding standards and context, makes stupid mistakes etc.
I am not sure how those models still rank so high in benchmarks when real-life usage is so obviously bad.