Comment by jayd16

5 days ago

I mean, look at these examples. Is a big LLM really needed to hit most of what people want?

Seems like Android just needs to lean into the voice command hooks API. A local LLM can grease the natural language into the mechanical APIs installed on your device. That's a much simpler task than an omniscient robot with access to all of your data.

Smaller specialised and targeted models are cheaper, faster and more accurate.