Comment by jypepin
18 hours ago
it feels like this is a bit similar to the famous dropbox comment.
I guess maybe another anecdotal comment, but I'm an engineer myself, have a home server for simple stuff, and I pay $200 a month to chatGPT for a pretty simple usage and really don't see myself go and run my own open source model, especially at the speed at which they evolve and change.
99% of the world will not setup their own open source model, just like 99% of the world is not setting up their own servier with ssh copy whatever the dropbox comment was saying.
You don't have to rub it yourself though. There's lots of pure inference providers which are way cheaper than the big guys and have cheaper models
If you were paying API prices (for ZDR), I suspect you would be eyeing local hosting. But if you’re comfortable selling your data, then the subscription prices are going to be hard to beat, for however long they may last.
99% of the world is also not spending $200/month for chatGPT. They're using whatever free shit they can get to ask basic questions.
Right. And FWIW those people are actually quite close to being able to do what they need with their phones.
If it were not for the x86 architecture they would almost have models that could answer those queries on their desks. (Gemma 4 E4B QAT is surprisingly good at this stuff; Gemma 4 12B QAT is great at it).
If I was Sam Altman I would consider giving Intel and AMD money to not develop unified memory architectures.