Comment by sparkling
6 days ago
What is your motivation? Privacy and/or data protection?
I currently don't see a world where it makes sense to run a local model that will eats up 60% of my RAM, 20-30% of my disk space while providing worse quality output than a $20/month subscription.
> What is your motivation? Privacy and/or data protection?
For me, those things are nice benefits but not the motivation. It's just a desire to own my tools and remove the magic wherever possible, and not pay a big corporation who is constantly tweaking/changing things that I might not like. It's the same reason I migrated everything I host off of Azure and onto a VPS, and why I moved from Jetbrains Rider to Neovim, and so on.
You can let a local LLM run loops all night or all weekend and it costs nothing. It works offline. There's no rate limits. Privacy. You aren't tied to the whims of the US Government banning models. You can tie it in to HomeAssistant for home automation tasks very easily.