Comment by alex_sf
2 days ago
Open models, in actual practice, don't match up to even one or two generation prior models from Anthropic/OpenAI/Google. They've clearly been trained on the benchmarks. Entirely possible it was by mistake, but it's definitely happening.
GLM 5.1 is absolutely on par with Sonnet 4.5, sometimes better in practice (it holds abstractions over longer context windows better)
It’s about the only one that is at that level though to be fair. They’re all still useful, still!
That hasn’t been my experience. For coding at least I find little difference between closed and open models