Comment by nickysielicki
12 days ago
This is such a weird project. Like where is this running at scale? Where’s the realistic plan to ever run this at scale? What’s the end goal here?
Don’t get me wrong... It’s super cool, but I fail to understand why money is being spent on this.
The end goal is that Macs become good local LLM inference machines and for AI devs to keep using Macs.
The former will never happen and the latter is a certainty.
The former is already true and will become even more true when M5 Pro/Max/Ultra release.