Comment by tony_cannistra
3 days ago
Not exactly your average "desk", but still neat.
In this post, we show how to run the latest frontier-class model — Muse Spark Open, with nearly a trillion parameters — right from your desk, using the latest version of MLX, released today. On a cluster of four Mac Studios, Muse Spark Open generates over 36 tokens per second (see Figure 1), well above average human reading speed. Beginning on a single Mac Studio (up to 512GB of unified memory), then scaling out across multiple Macs with the RDMA over Thunderbolt driver, below we share an overview of the range of models you can now run on Mac Studio.
Yes, I'm very glad they're doing this, but as of 2026, it's a bit academic. Pricing for the 512GB Mac Studio hasn't even been announced yet, but the 256GB version starts at $9499. So when you start talking about four of those puppies, it's substantial.
Someone else will do the math on how many years it would take to spend $40k on Muse Spark Open via OpenRouter.
But there are definitely people out there that will need to run these models locally (contractual or legal requirements). By validating a Mac Studio as an option for running local models, it might be the more appealing option.
For most of us though, you're right -- the OpenRouter option is far more cost effective.
It seems Apple figured they could sell more Mac Studios on the basis of frontier local AI models, profit to be made while users haven't figured out the math yet.
Don't get me wrong; in the long term I see the price of local inference falling as their chips continue to get 15-20% faster every year, and meanwhile the "intelligence per billion parameter" chart is rising. There will be a magic point where they cross, and "good enough" reaches your phone. That's when Apple starts to drink Nvidia's milkshake.
4 replies →
There was the M3 Ultra 512GB Mac Studio, though.
…which is in the region of €20k on eBay, so the calculus doesn’t really shift…
9 replies →
Puts into perspective how cheap the frontier models are via subs or even API.
You can't really compare API prices though. The cards that they are running frontier models on in the datacenter can service hundreds of simultaneous requests and are at nearly 100% utilization. This thing would sit on your desk and be used to service a single user for a couple hours per day.
1 reply →
The main subsidy, from OpenAI, is ending 10/26. It’s still “cheap” for now compared to all the other non-open weight frontier models, but it won’t last since OpenAI’s stated goal is to make it so that there’s no much of a difference price wise between on demand API calls and subscriptions