Comment by mixtureoftakes
4 days ago
day one support for all inference engines so that whichever kind of capable computer you have, you can run it. you do need a really capable computer though
4 days ago
day one support for all inference engines so that whichever kind of capable computer you have, you can run it. you do need a really capable computer though
> you do need a really capable computer though
They suggest a pair of Mac Studios w/ M5 Ultra chips and 512 GB of RAM. A single Mac Studio w/ M5 Ultra and half that RAM (256 GB) is around $11k, and the 512 GB option isn't even available yet. So.... yeah.
You can just use your old dual 512GB M3 Ultras until you get the M5s. Man, people always whine about something...
This comment has the unusual property of being applicable whether or not it's sarcasm!
O shit, I didn't even think of that. I've got a few of those kicking around, honestly I was just using them as doorstops at this point.