Comment by lugu
10 hours ago
What we need today is a standard local API (think of it as a POSIX extension). So that each desktop app that needs AI to enhance a feature can simply call that. This way, those apps will need to handle the case where AI is not availabile. This will empower users.
All major operating systems Windows, macOS, iOS, and Android have local APIs for using AI.
Why would I use those instead of just grabbing a model from hugging face? Are they as good as qwen 30B?