Comment by manmal

Slightly tangential, I‘m testdriving an MLX Q4 variant of Qwen3.5 32B (MoE 3B), and it’s surprisingly capable. It’s not Opus ofc. I‘m using it for image labeling (food ingredients) and I‘m continuously blown away how well it does. Quite fast, too, and parallelizable with vLLM.

That’s on an M2 Max Studio with just 32GB. I got this machine refurbed (though it turned out totally new) for €1k.