Comment by labcomputer

Large mixture-of-experts models, like Muse Spark or Kimi K3.

MoE models want a different ratio of memory/compute/$ than dense models like a Gemma4 31B or Qwen3.8 27B.

Since only some of the experts are active each round, you don’t need as much compute to get good tok/sec, but you do need a lot of memory to avoid streaming weights from SSD or system RAM.

You could run a full Muse Spark on one of these for $24k at probably around 50 tok/sec.

You’d need 5x RTX 6000 Pros at $80k for Muse Spark (albeit at much higher tok/sec).

On a $24k budget, you’re looking at a maximum of 96GB from Nvidia or 384GB from Intel or AMD. So you’re bottlenecked by PCIe bandwidth, and all those TFLOPS go to waste.

Other configurations of the Studio have similar logic for other MoE models. For instance, Qwen3.8 flash-next runs at a very acceptable 75 tok/sec on a 128GB M5 Max for about 1/3rd the price of an RTX 6000 or 40% less than 4x B70’s.