Comment by ryanschaefer
4 days ago
Read it again. Two M5s.
Wait read that again. Two 512GB, unreleased model M5s.
This is gonna cost like 50k to run at home.
4 days ago
Read it again. Two M5s.
Wait read that again. Two 512GB, unreleased model M5s.
This is gonna cost like 50k to run at home.
Closer to ~$30K if I had to guess. A 256 version is $11,299.00 (2TB SSD, 256GB RAM, 36-core CPU, 80‑core GPU), so yeah, 4 of those would be close to $50K but the 96->256 RAM upgrade is $4K, if we assume 512 will be double that it's ~$15K/ea.
But yes, still a massive amount of money and that's before we know the TPS or any other stats.
The closest equivalent to something like that is a GB300 based workstation, those go from 90K and up.
How much does the engineers at Meta make? Spend enough time together with others making $250k+ and eventually you start suggesting that two 512 GB M5s is something you can put on your desktop. I mean, it's one banana, Michael. What could it cost? 10 dollars?
Why would anyone want to run an LLM on Apple's hardware? Why not buy an NVIDIA GPU?
Try to find a NVIDIA GPU with 256/512 GB of RAM.