Comment by snvzz

The LLM can run elsewhere, such as the cloud.

For the part that runs locally, efficiency might matter.