Comment by HarHarVeryFunny
10 hours ago
There was an interesting interview by MLST with a team doing well on ARC AGI 3 who are using Qwen 3.6 27B, and said that it's actually better at coding than the larger 3.6 35B.
I guess which of the smaller 3.8 models is best for coding will depend on which one they put the training effort into.
The larger 3.6 35B is actually a mixture of experts (MOE). This means a small proportion of those B's are actually active. It's fast and suitable for agentic tasks but nowhere near good as the dense 27B model, which has all of its parameters loaded.
I have found 27 to just be so much more coherent than 35:
https://humanparadox.org/local-vs-frontier-benchmarks-for-my...
It can complete multi-step tasks much better, and has a bit more curiosity.