Comment by Tepix
11 hours ago
With AI being more useful with access to more of your data, I can't see myself using cloud AI models for purposes such as personal assistants.
Perhaps with differential privacy or confidential compute...
But ideally these models run locally.
I'm not sure how useful a personal assistant would be if it doesn't have internet access, and at that point you're vulnerable to the lethal trifecta so I'm not sure local versus cloud model is the most important distinction to index on
This is just lazy thinking.
E.g. having an agent that alerts you when subscriptions are close to renewal etc - yeah seems easy to understand / see happening on the surface.
Until you get into the implementation details and realise 'yeah errr. not gonna work'.
That openclaw nonsense is an example of this.
Local model doesn’t mean you have to run it locally. It just means that you aren’t locked into a provider. Nothing stops you from using a hosting service. The point is you get to choose if and who gets access to your data.
Additionally, the only use case for LLM is not fully autonomous agentic harnesses. There’s tons of use cases for LLMs where you would like to avoid a round trip to the internet or perhaps there is no connectivity. We’re only starting to scratch the surface!
Which implementation details? I very much already have this, today.