Comment by sebastiennight
1 year ago
I'm not on iOS these days, can you elaborate how "Apple's Intelligence thing" has solved the 7B-sized on-portable-device model for everyday users?
My understanding of the zeitgest on HN about Apple Intelligence was definitely not leaning towards "they nailed it". Not even in the ballpark of "promising", I'd say.
I didn't say they nailed it. I don't know since I can't run it, but ten years is a long time for any technology. I toyed with the 7B Mistral through MLC Chat and, while slow, the responses were good.
The Llama-3.2-3B-Instruct it comes with is fast but sometimes takes questioning to get accurate answers.
The older Phi variant it has was thorough and accurate, Phi's selling point, but made my phone run hot being too thorough.
I don't know much about Apple's model.