Comment by hirako2000
3 days ago
It seems Apple figured they could sell more Mac Studios on the basis of frontier local AI models, profit to be made while users haven't figured out the math yet.
3 days ago
It seems Apple figured they could sell more Mac Studios on the basis of frontier local AI models, profit to be made while users haven't figured out the math yet.
Don't get me wrong; in the long term I see the price of local inference falling as their chips continue to get 15-20% faster every year, and meanwhile the "intelligence per billion parameter" chart is rising. There will be a magic point where they cross, and "good enough" reaches your phone. That's when Apple starts to drink Nvidia's milkshake.
Apple and NVIDIA prices are not going to fall.
Their competitors will. Anyone locked into these two ecosystems are willingly going along with it.
It’s not about the price of Apple products falling—I was commenting that the price of inference will continue to fall (chips getting faster). If “good enough” inference is in your pocket, this benefits Apple and harms Nvidia.
1 reply →
Apple’s problem is memory the biggest question is whether or not they will design and engineer around it their recent history says they will.