Comment by concinds
3 days ago
An Apple-developed LLM would likely be worse than SOTA, even if they dumped billions on compute. They'll never attract as much talent as the others, especially given how poorly their AI org was run (reportedly). The weird secrecy will be a turnoff. The culture is worse and more bureaucratic. The past decade has shown that Apple is unwilling to fix these things. So I'm glad Apple was forced to overcome their Not-Invented-Here syndrome/handicap in this case.
Apple might have gotten very lucky here ... the money might be in finding uses, and selling physical products rather than burning piles of cash training models that are SOTA for 5 minutes before being yet another model in a crowded field.
My money is still on Apple and Google to be the winners from LLMs.
And when the cost of training LLMs starts to come down to under $1B/yr, Apple can jump on board, having saved >$100B in not trying to chase after everyone else to try to get there first.
I agree. That’s why I think EU‘s DMA is visionary, even if not perfect. LLM wars will prove EU regulators right I anticipate.
Apple has also never been big on the server side equation of both software and hardware - don't they already outsource most of their cloud stack to Google via GCP ?
I can see them eventually training their own models (especially smaller and more targeted / niche ones) but at their scale they can probably negotiate a pretty damn good deal renting Google TPUs and expertise.
Mostly AWS actually. Apple uses Amazon’s Trainium and Graviton chips to serve search services. "Fruit Stand" is the internal name for Apple at AWS.
Xserve was always kind of a loss. Wrote a piece about it a number of years back. It became pretty much a commodity business--which isn't Apple.
12 replies →
Yeah… there’s this “bro— do you even business?” vibe in the tech world right now pointed at any tech firm not burning oil tankers full of cash (and oil, for that matter,) training a giant model. That money isn’t free — the economic consequences of burning billions to make a product that will be several steps behind, at best, are giant. There’s a very real chance these companies won’t recoup that money if their product isn’t attractive to hoards of users willing to pay more money for AI than anyone currently is. It doesn’t even make them look cool to regular people — their customers hate hearing about AI. Since there are viable third party options available, I think Apple would have to be out of their goddamned minds to try and jump in that race right now. They’re a product company. Nobody is going to not buy an iPhone because they’re using a third-party model.
Something weird has gone wrong in the psyche of humans.
Why are we even talking about 'AI'? When I heat up food in a microwave, I dont care about the technology - I care about whether it heats up the food or not.
For some bizarre reason people keep talking about the technology (LLMs) - the consumers/buyers in the market for the most part dont give a hoot about it. They want to know how the thing fits in their life and most importantly what are the benefits.
Ive unfortunately been exposed to some Google Ads re. Gemini and let me tell you - their marketing capabilities are god awful.
>Nobody is going to not buy an iPhone because they’re using a third-party model.
You're right, and this is proven. Apple has fumbled a whole release cycle on AI and severely curbed expectations, and they still sell 200m iPhones a year and lead the market [0]
[0] https://www.reuters.com/business/media-telecom/apple-leads-g...
1 reply →
Reportedly, Meta is paying top AI talent up to $300M for a 4 year contract. As much as I'm in favor of paying engineers well, I don't think salaries like this (unless they are across the board for the company, which they are of course not) are healthy for the company long term (cf. Anthony Levandowski, who got money thrown after him by Google, only to rip them off).
So I'm glad Apple is not trying to get too much into a bidding war. As for how well orgs are run, Meta has its issues as well (cf the fiasco with its eponymous product), while Google steadily seems to erode its core products.
Why would paying everyone $300M across the board be healthier than using it as a tool to (attempt to) attract the best of the best?