That is actually a reasonable prediction. By 2045, even tablets and high end phones will be able to locally run large enough models for real time chat.
But don't forget, "the hype is real".
Apple fanboys are something else.
At this point it's not even clear that the LLMs will have much use outside of chatbots spitting questionable reality faking but it's pretty clear that the small local models are largely useless.
Outside of the poor user experience the lack of large dataset make them an exercice out technical feasibility more and anything else.
Apple feeling like they have to partner with Google to replace their own "Apple Intelligence" should tell you everything you need to know about local AI but I guess believers gotta believe.
Yeah but this is what I mean. They are unable to produce a decent AI solution so they have to outsource. And if it was just about being limited by on device processing power, they could just switch to using their cloud infrastructure.
To me that's just dumb. They are spending money for a competitor solution just to keep control and appearances. At this point they could just forget about AI altogether and/or open their OSs to let others integrate their solutions.
But Apple is way too proud to admit being wrong and we will get a half-assed solution that will both cost them money and be inferior to the competition because of their own self-imposed limitations.
They have been riding on their privacy/security narrative for a while, yet they work with governments and ads/tracking hasn't gone anywhere.
And they'll have to open up the App Store golden goose at some point anyway.
They should recognise when the strategy isn't working for the long run and switch it up...
But they have tried to compete with Google for maps, it is still largely inferior in many ways and they seem to be fine with that. So I think it will end up in a similar situation.
> Prompt ingested (time to first token) in "18 seconds" with the new chip... end of the joke
18 seconds on the M5; 4.4x times faster than the previous M4 running one of Qwen’s 8 billion parameter local models.
That’s quite impressive for a tablet and faster than most laptops available today.
At this rate, Apple will be primed to replace OpenAI for realtime use somewhere around 2045.
That is actually a reasonable prediction. By 2045, even tablets and high end phones will be able to locally run large enough models for real time chat.
But don't forget, "the hype is real". Apple fanboys are something else.
At this point it's not even clear that the LLMs will have much use outside of chatbots spitting questionable reality faking but it's pretty clear that the small local models are largely useless. Outside of the poor user experience the lack of large dataset make them an exercice out technical feasibility more and anything else.
Apple feeling like they have to partner with Google to replace their own "Apple Intelligence" should tell you everything you need to know about local AI but I guess believers gotta believe.
> Apple feeling like they have to partner with Google to replace their own "Apple Intelligence"
They’re not replacing Apple Intelligence; the partnership with Google is for the backend of Siri.
Yeah but this is what I mean. They are unable to produce a decent AI solution so they have to outsource. And if it was just about being limited by on device processing power, they could just switch to using their cloud infrastructure.
To me that's just dumb. They are spending money for a competitor solution just to keep control and appearances. At this point they could just forget about AI altogether and/or open their OSs to let others integrate their solutions. But Apple is way too proud to admit being wrong and we will get a half-assed solution that will both cost them money and be inferior to the competition because of their own self-imposed limitations.
They have been riding on their privacy/security narrative for a while, yet they work with governments and ads/tracking hasn't gone anywhere. And they'll have to open up the App Store golden goose at some point anyway. They should recognise when the strategy isn't working for the long run and switch it up...
But they have tried to compete with Google for maps, it is still largely inferior in many ways and they seem to be fine with that. So I think it will end up in a similar situation.
2 replies →