Comment by cientifico

Right now, local inference only make sense for privacy reasons.

This is common when processing PII. Lawyers, doctors our similar should not be using cloud solutions.

Also it's harder to setup and always more expensive than any cloud solution.