Comment by Bootvis
16 hours ago
I can upgrade to a bigger LLM I use through an API with one click. If it runs on my device device I need to buy a new phone.
16 hours ago
I can upgrade to a bigger LLM I use through an API with one click. If it runs on my device device I need to buy a new phone.
I* can run the model on my device, no matter if I have an internet connection, nor if I have a permission from whoever controls the datacenter. I can run the model against highly private data while being certain that the private data never leaves my device.
It's a different set of trade-offs.
* Theoretically; I don't own an iPhone.