Comment by torben-friis
10 hours ago
Can you run an industry level LLM at home?
If not, you're changing learning to cook for Uber only meals.
And since the alternative is starving, Uber will boil the pot.
Don't give up your self sufficiency.
10 hours ago
Can you run an industry level LLM at home?
If not, you're changing learning to cook for Uber only meals.
And since the alternative is starving, Uber will boil the pot.
Don't give up your self sufficiency.
> Can you run an industry level LLM at home?
Assuming that by "at home" you mean using ordinary hardware, not something that costs as much as a car. Yes, very slowly, for simple tests. (Not proprietary models obviously, but quite capable ones nonetheless.) Not exactly viable for agentic coding that needs boatloads of tokens for the simplest things. But then you can run smaller local models that are still quite capable for many things.
I’m very good at the handcrafted stuff, I’ve been doing this a while. I don’t feel like giving up my self sufficiency, I just feel like the writing is on the wall.
By "you" I actually meant this hypothetical person who's only good enough for AI assisted. Though even for us who are already experienced, we should keep the manual stuff even if it's just as going to the gym. I don't see myself retaining my skills for long by just reviewing LLM output.
Yes sorry, I didn’t think you were addressing me directly, just adding my own thoughts.
I agree totally with the sentiment, and I am concerned about my own skills atrophying.
The costs just aren't that high. They could be 10x higher and it still wouldn't be a huge deal.
Can you build a computer at home?
There is absolutely nothing self-sufficient about computer hardware
Or generate electricity? Or grow enough food to survive? Medicines?
"Self-sufficiency" arguments coming from tech nerds are so tiring.
No, and that's the reason we're now paying twice what we paid a couple years ago. But I can write software at home.
We're already vulnerable to enshittification in so many areas, why increase the list? How does that work in my favor at all?