Comment by jayd16
4 days ago
I mean, look at these examples. Is a big LLM really needed to hit most of what people want?
Seems like Android just needs to lean into the voice command hooks API. A local LLM can grease the natural language into the mechanical APIs installed on your device. That's a much simpler task than an omniscient robot with access to all of your data.
Smaller specialised and targeted models are cheaper, faster and more accurate.