Comment by ai_fry_ur_brain
5 days ago
Open source doesnt matter if you still need to make 100k year to have your own mediocre model.
There is no magic compression. There is no magic post training. Your phone or laptop will never do what you think its going to be able to.
There are limits to what consumer hardware will ever be able to run, in its current form. Open source isn't going to save us if they gatekeep access to hardware, which idk if you've been paying attention. They dont plan on making consumer grade hardware more powerful, they want to rent that power to you.
Technological serfdom is coming if they get their way.
You don't need to be able to self-host it. It's fine to pay someone else for it. If it's open-source, competition will ensure inference providers support it well enough, and if an open-source provider is dumb enough to nerf their model for (useful) coding tasks, there's plenty of incentive for inference companies to do some lightweight finetuning to restore the capability.
I disagree, I think being able to self-host it to some extent is very important.
Personal computing democratized the means of (software) production and enabled real upward class mobility for a lot of people.
The efforts happening now are threatening to completely lock up the ability to compute locally, seizing the means of production from us. That must not happen.
your parent said "You don't need to be able to self-host it", you countered with "I disagree, I think being able to self-host it to some extent"
Bro, I don't know what you're disagreeing with, the two statements can and should be true at the same time. It's not only unnecessary but also impossible for everyone to self-host, for the vast majority this isn't a necessity and it shouldn't be. Actually being stuck on self-hosting for all is mighty silly from economics standpoint, pushing on it can ruin the entire enterprise.
But being able to self host? Sure why not, if you insist and are ready to suffer... knock yourself out, but that's a socially insignificant act which doesn't scale, good only as a backup option.
3 replies →
> Technological serfdom is coming if they get their way.
I'm deeply concerned about this. We're seeing all these moves towards remote attestation, identity verification. Now we're being literally priced out of hardware...