Comment by apetresc
16 hours ago
What on earth would you do with an iOS device that has 96GB of RAM? You realize the last generation (i.e, the most powerful consumer phone in the world today) had 12 GB of RAM? You feel the need for eight times that amount?
Number go up, I guess? A lot of people derive great satisfaction from ever larger (or sometimes smaller) number. But, uh, 8X is probably too much, need to spread that out over a few generations.
They obviously want to run AI models on their phone.
Very obviously you get a Mac Studio for that, not a phone. (Oh, the 96GB Studio is almost $6000, you counter? Imagine how much it would cost in a phone form factor).
You can't possibly expect Apple to take that market segment seriously.
In theory it sounds alright, although in reality, the heat and power consumption make this less than ideal.
I am not sure single digit tk/s on weak model like ChatGPT OSS 20b @ Q3_K_M is going to be worthwhile.
Not to mention this has to be <0.01% of users who "want" to do this. The iPhone tooling would make it hard to even configure and spin up a local LLM.
> the most powerful consumer phone in the world today
According to what? (I don't disagree, just curious)