Comment by antonvs
1 month ago
> The future is going to be locally hosted and ad free and there’s nothing Big Tech can do about it.
I wouldn't be so certain of that. Someone is paying to train and create these models. Ultimately, the money to do that is going to have to come from somewhere.
Good News! The Models are done, and you can download them for free. Even if they stopped being worked on this moment, those are finished and usable right now, and won't get any worse over time.
Good News! I have a copy of a search engine from 2005, so I don't need Google!
That's a false equivalency and you know it.
They wouldn't get any worse, but I assume they'd get behind really fast.
Old models become outdated. Not sure how useful an outdated model can still be.
Depending on the pre-training structure, you can fine-tune old local models (even locally if you have a nice GPU) to steer behavior towards your desires.
https://www.youtube.com/watch?v=yGkJj_4bjpE
Exactly as useful as they are today. Sure, it might not hold a candle to a model trained in 10 years, but it'll still be exactly as useful then as it is today, and run a lot faster too.
They can still be very useful because new models are reaching an asymptote in performance. Meanwhile as hardware gets cheaper in the future (current RAM prices notwithstanding), these models will become faster to run on local hardware.
P2P training is a possibility. With so much compute running the block chain I can see this utilized for AI.
Big tech is bought and paid for by consumers. We can do the same for oss trained models.