Comment by magicalhippo

Training data plays a huge role. As an example, Qwen 3 was generally considered a significant improvement over Qwen 2.5, but the architecture only had minor tweaks. The major change was the quantity and quality of training data they used for Qwen 3.