Comment by mrheosuper
6 days ago
I disagree.
Self-hosting has always have a lot of drawbacks compared with commercial solutions. I bet my self-host file server has worse reliability than Google Drive, or my self-host git server has worse number of concurrent user than github.
It's one thing you must accept when self-host.
So when you self-host LLM, you must either accept a drop in output quality, or spend a small fortune on hardware
Those aren’t good analogies because it costs nearly nothing to make that availability tradeoff and run things on your computer for your own fun.
Raspberry pi was a huge step forward, the move to LLMs is two steps back.