Comment by gunalx
8 days ago
Sad to not see smaller distills of this model being released alongside the flaggship. That has historically been why i liked qwen releases. (Lots of diffrent sizes to pick from from day one)
8 days ago
Sad to not see smaller distills of this model being released alongside the flaggship. That has historically been why i liked qwen releases. (Lots of diffrent sizes to pick from from day one)
Judging by the code in the HF transformers repo[1], smaller dense versions of this model will most likely be released at some point. Hopefully, soon.
[1]: https://github.com/huggingface/transformers/tree/main/src/tr...
Per https://github.com/QwenLM/Qwen3.5, more are coming:
> News
> 2026-02-16: More sizes are coming & Happy Chinese New Year!
I get the impression the multimodal stuff might make it a bit harder?