Comment by Stevvo

1 day ago

I've learnt more since the advent of LLMs than I did in the 10 years prior. And it's not just me; that is most people's experience with LLMs. But most of those people would also concur with your apocalyptic thinking. AI is the apocalypse for thinking, except for me, only I am smart enough and experienced enough to maintain my cognitive ability while using LLMs.

The problem is that if you take away the LLM, all of a sudden you can't do any of the things you "learned". It's confusing familiarity with understanding.

  • I did actually use an LLM to teach myself photoshop recently for a fantasy map building project. Mostly I'd just ask it things like "I have a mask with 50/50 gray and would like an elevation height map to be an embossed layer on it. Where do I find that in the menus?" those sorts of questions.

    I finished the project out feeling pretty confident in my photoshop abilities. Then I did a similar project later and realized I had to open up the LLM again as there were still a ton of holes in my knowledge. After this second time though I'm feeling confident enough on my own that referring back to the LLM is increasingly less common, as it's just a waste of time if I already know what to do.

    • but this is not how people use - or providers sell - LLMs. They don't ask questions about how to do small steps, they just ask it to do the entire project, finish quickly and learn nothing. If the workflow was many, tight iterations it would be closer to a tool than an automation.

      5 replies →

  • I don't think this is true. The LLM provides confidence that it won't be a tremendous waste of time to try something you don't already know how to do. But eventually it gets tedious to consult the LLM all the time so you stop doing so. That initial "couldn't hurt to try" boost is worth a lot.

  • The learning is at that level of abstraction, so yes taking away the abstraction prevents will stymy you.

    Just like if you pressed a button to wipe out our main language stack at our job, yeah none of us would know how to do anything with assembly or machine code.

    • > Just like if you pressed a button to wipe out our main language stack at our job, yeah none of us would know how to do anything with assembly or machine code.

      All the devs would spend a couple weeks learning assembly and go on coding. And all the non-dev vibe coders would be unable to continue.

      So I don't think it's quite the same.

      28 replies →

    • Which one is more at risk of having the wipe-out and cost levers: your FOSS language/compiler or your paid third party LLM?

      Sure, there are similarities, but while we're figuring out a FOSS solution that will run on your machine and we'll have access to more than the weights, the abstraction ladder isn't as equivalent as we think they are.

      2 replies →

  • I recently spent a day coding by hand. I was able to build a project, about 200-300 lines in python. Took me half day. But I could still do it. LLM would have done this in less than half an hour.

    After this I realized why I personally choose LLM to write code: it is simply more convenient.

    As a parallel, once you learn how to drive you stop walking, as for the primary mode of transportation.

    • > As a parallel, once you learn how to drive you stop walking, as for the primary mode of transportation.

      If I could, I would certainly walk everywhere.

    • Then you get fat and suffer "diseases of civilization" because walking is good for you and extended sitting is not.

    • >As a parallel, once you learn how to drive you stop walking, as for the primary mode of transportation.

      Is this the reason people prefer to drive, or is it due to city planning, societal expectations, etc.?

      Plenty of people who live within cities don't own a car, or if they do, walk more than they drive.

      1 reply →

  • We are in the Matrix with the internet.

    "Please download the ability to do X"

    Just that there is still a big latency. Its smaller than finding the correct information on the web, but you can do so. Especially with MCP. The question is when this goes over into the physical world.

    Watching Youtube videoas about anything that requires skill does the same.

  • I think it's like driving without navigation systems. Yes, you have to make an effort to do it, but then it's fine. You don't have to use LLMs every minute of the (work)day.

  • I have sat down and figured out how to program an Apple //e this year for fun. It is possible. It was quite instructive on how much has been added to the idea of what a computer is these days.

  • Take away all reference books/material/notes, from any engineer, in any field, and see how well they do.

    Human memory is shite. Understanding, and knowing what you need to reference, is ludicrously more valuable than rote memorization.

  • > The problem is that if you take away the LLM, all of a sudden you can't do any of the things you "learned".

    Even if that were true, LLMs aren't going away, so that isn't a problem.

    • I don't think we could be so confident in that. They likely aren't, depending where you live and your socioeconomic status.

  • > if you take away the LLM, all of a sudden you can't do any of the things you "learned"

    What? That is absolutely not true. I've been using LLMs for language learning, math/physics, clarify home improvement best practices that I now regularly think about, etc. and that knowledge is not LLM-bound at all. Instead of acquiring from a regular textbook, I acquired it from a model.

As an educator (of working professionals / continuing education), I see first-hand the range of AI use amongst the population (and even my population is not a representative sample, as it's people who are intrinsically geared towards being interested in building with AI), but your experience unfortunately probably reflects around ~30% of the population. The other third I'm slightly less hopeful about, but they might have a chance merely surviving, and the latter third I'd place in the 'full cognitive offloading / total abdication of all thinking and learning to machines' - for them, as the kids say: ngmi. Even within me as a single individual, I can sense the times AI is so tempting to offload cognition, and other times where it has been like a 100x speedup in my own innate skills and abilities. The future has come on quick, and we are barely getting to adjust healthily to it.

>I've learnt more since the advent of LLMs than I did in the 10 years prior. And it's not just me; that is most people's experience with LLMs

My own usage too. Yet I believe that your environment is biased towards ambitious adults aligned with your values, who want to learn things. I don't think it's representative of world as a whole, and I'm even further worried about the youth, being a particularly vulnerable group. Let's hope that teachers and parents of today and tomorrow will keep reinforcing the idea that knowing things and having skills is worthwhile.

Remove LLM and 80 pct of people will have to jump to start. LLM assistance is a huge dependence on something owned by few. And although I use it daily since Nov 22, I don’t see any big progress in productivity. Yes, I have done a lot of projects (that I can’t remember), I see a lot of sites made without human touch, I have heard fairy tales about llm’s breakthroughs to internet from a cage.

What I see that everybody is somehow a blacksmith now without knowing how to forge iron. And we call it progress.

I am optimistic, and I am not against LLM. I like a quote from OP’s article:

> One of my colleagues used to say, "AI is a mirror." I find that insightful: it reflects who you are, including the curiosity, judgment, and habits you bring to it. The questions you ask and the standards you apply to its answers matter.

  • My first project with it was in Jan 22, back when it was just sentence completion. Really hard to implement practically.

    But in the past year the production boost is just insane. LLM assistance took away so many of the barriers that prevented me from executing on ideas.

    I've also learned more than ever before, although it is admittedly getting harder to stay involved when the models are becoming more and more reliable.

    What I have not figured out yet is why most developers around me do not share this effect. It's like it mostly works for a very specific subset of people, that do understand code, but it's not their main focus.

    Just take a look at what is happening with the M-Wave FM1. Stating those devs would be lost without Ai won't stop the tide. It's not going to go away.

  • You can't remove LLMs. Once models are released as open weights, they cannot be removed. As long as the compute to run them exists, so will LLMs.

  • "LLM assistance is a huge dependence on something owned by few."

    Open models are capable and owned by everyone who wants to.

    • Fair point. How many people know OpenCode, Pi? How many pct of ppl code? How many pct of companies buy their own hardware with GPUs? It is similar situation e.g. as Salesforce vs Odoo. Imho 99 pct of companies choose SF, not Odoo.

      1 reply →

    • And the overwhelming majority of LLM users will never use them or even understand what they are or how to set them up. Those people will remain dependent, and we shouldn’t ignore that.

  • > Remove LLM and 80 pct of people will have to jump to start.

    Isn't the same true for every service and technology we start to rely on?

    Remove GPS and people will have to figure out how to read maps again.

    Remove search engines and people will have to figure out how domains work.

    Remove Wikipedia and we have to go back to the library to check encyclopedias.

    • > Remove GPS and people will have to figure out how to read maps again.

      It's not GPS, but turn-by-turn navigation. Remove that and people's spatial understanding of their environment improves significantly, and this improvement persists even long after the experiment, and they'll even be able to use turn-by-turn navigation better.

      Which aligns with Anthropic's reports that people are able to use Claude better if they understand their own codebase better, and that increased Claude usage leads to reduced understanding of the codebase.

      When society replaced walking as the primary mode of transportation with driving, people started going to the gym to keep their body in shape.

      We should probably be training spatial perception (replaced by GPS), understanding of algorithms and data structures (replaced by coding agents), too.

      2 replies →

    • Yes, you’re right. How many times a day do you really use GPS? Dependence on LLM is much bigger stake.

    • And much like society has rebuilt itself around, for example, the cellular phone and even the car, it’s rebuilding itself around LLMs. Yes, now you have to buy a thing you didn’t in the past. A bunch of capitalists have found a new way to build capital. I guess we get some value out of it too, but once it becomes built-in it can be hard to see it.

> I've learnt more since the advent of LLMs than I did in the 10 years prior. And it's not just me; that is most people's experience with LLMs.

I wonder. I agree that LLMs are great teaching assistants but, also, I often feel like watching the game instead of playing it. Sure I'll be an expert at football after watching all the games, but will I be an athlete?

But can you retain, process, and make use of that learning?

For me it's more like googling the capital of Nova Scotia. I used to know that, but I can google it more easily than memorize it.

  • But thinking requires mental manipulation of the things that are in your memory. The less structures you have there, the lesser the ability to reason.

  • DynamoDb has a max item size of 400kb.

    That was months ago. It often surfaces pertinent info which is memorable cos it relates to whatchu doin.

  • I mean, it depends.

    Like, unless it is somehow relevant to your daily life knowing the capital of Nova Scotia is literally useless. Same with all the history I learned in middle school. Remembering takes repetition, and so retaining the information I learn needs a habit of review and processing. And a lack thereof (alongside the brain seeking to offload information, bc information is expensive) is why you forgot the capital city.

    I find I remember things best when I jot them down, and personally I’ve been needing to journal more, writing down my ideas and what I learn when discussing my ideas with LLMs, though I’ve also noticed that using the LLM as a rubber duck has actively helped my memory due to more review and processing and needing to “teach” my ideas to the model.

I too use LLMs to learn different technical topics and generally like them for this. That said I think we’re in the minority. I don’t think most people use these tools to learn.

  • "I don’t think most people use these tools to learn."

    I often hear the phrase "use chatgpt" when common people don't know something but want to understand something new. So they use it for learning, even though most likely never think of checking the sources ever.

I find this absolute certainty completely alien and perplexing. We are terrible, untrustworthy observers, record keepers, and judges of ourselves, and the assertion begs so many questions that I can't guess what you actually mean or how serious you are.

You just feel like you have learned those things. Without the LLM all of the “skills” are lost.

  • I push back on this idea hard. There's some things I consider not worth my time since an LLM will always be available to do it for me. But a whole lot of things you can learn far better with a LLM than almost anywhere else.

    Been learning Linux, how to build a homelab, and quite a few other related topics since about chatgpt 3.5. If the LLM went away tomorrow I'd still know how to do most things in Linux, set up my opnsense router, reinstall xcp-ng, do everything in docker, and a boatload of other things that would've been so much more tedious to learn before an LLM. Simplicity of access to knowledge doesn't mean you don't learn it. A google search didn't make us learn slower than when we had to scour for books at the library, it increased the pace dramatically. Same goes for LLMs.

    You can use LLMs and learn nothing. People who like to learn won't ever use it that way.

    • > Simplicity of access to knowledge doesn't mean you don't learn it

      Except that it does, learning is mediated by _effort_.

      Was it hard? Then what did you gain by using AI?

      Was it easy? Then you didn't learn

      6 replies →

    • > If the LLM went away tomorrow I'd still know how to do most things in Linux, set up my opnsense router, reinstall xcp-ng, do everything in docker, and a boatload of other things that would've been so much more tedious to learn before an LLM.

      This makes sense, but i'm assuming you have some sort of technical background to begin with? I imagine people that have been around pre-LLMs would be better equipped for not only prompting the LLMs for accurate information, but also internalizing that information. I wonder if the post-LLM generation would be the same.

      : Though I imagine that there's going to be a cutoff date for people born before a certain point pre-LLMs too. Old people rn seem to be much more blindly accepting of whatever the LLMs spit out than younger adults.

      1 reply →

  • I think there are truths in there but depends on your view.

    If you have a finite time and have a goal, is learning something that takes a longer time better towards that goal than being able to move fast and accumulate more capabilities that are on hand when you ‘forget’ them?

    The answer engines and the context around my goals allow me to move at an unprecedented pace and move into places that were just not possible before.

    But, the nuances learned concepts are indeed skipped over or Pareto’d

I’m in the same boat as you, but sadly I’m not convinced of this:

> that is most people's experience with LLMs

I think the median LLM user in high school, for example, is mostly using it to avoid writing essays themselves.

I don’t have great evidence here, mainly just the plummeting exam scores. It could be that kids are also using llms to learn about the things they do care about. I’m skeptical.

i partially agree, but a little doubtful too. i remember feeling like i learned a ton after coming out of wikipedia rabbit holes, similar to when chatting with an AI now.

that's good!

but i also don't make any effort to write clearly anymore, might give up easier on a task, will very easily to defer to an AI for x/y/z technical decision, ...

that's not good!

  • > but i also don't make any effort to write clearly anymore

    This seems like a huge mistake considering that prompting AI clearly seems to yield better results.

>> I've learnt more since the advent of LLMs than I did in the 10 years prior.

You read more. "Learned" is if you actually manually applied it. Otherwise its like reading fiction - illusion of productivity or brain function.

Solving sudoku would be a better exercise for your brain and more load.

  • You think reading fiction is supposed to be productive? I suspect even aphantasics will be using brain function when reading fiction.

    • You read that part of their comment backwards. They called it an illusion, not actually productive.

> And it's not just me; that is most people's experience with LLMs.

Uh... bold claim. What's your evidence?

> And it's not just me; that is most people's experience with LLMs. But most of those people would also concur with your apocalyptic thinking

Most of the people in your bubble.

Who are probably significantly above average intelligence, and many of whom have pretty keen awareness of that fact and its implications.

> except for me, only I

... and others in that bubble.

    And it's not just me; that is most people's experience with LLMs

Got a source better than vibes on that one?

> that is most people's experience with LLMs.

citation needed. my (university) students don't seem to learn as much as before.

I feel like language models help me search through concepts really quickly, and will also help me understand things just well enough to use those concepts more quickly. So they kind of narrow what I learn down to exactly what I need in the moment.

I don't think I'm actually learning more though. I think the act of banging my head against the wall to learn something the hard way teaches me more, but feels harder and is slower.

But then I really retain it, and I've also learned a bunch of meta-skill in the process.

So I think it's just different. Now it's harder to force myself to bang my head against the wall when the easier path is so accessible. Used to just have far fewer available paths because they were too hard.

Hear, hear. We had the entirety of human knowledge available online for decades now. Are people more educated? Nah, cos most people aren't interested in looking for much beyond validation.

Perhaps me finding your comment and replying has similarities but at least this is validation of curiosity.

I love llms cos history isnt typically indexed by the sort of questions i wanna ask but an llm can cut a wide array of sources by an arbitrary metric and i can keep poking for more and more.

I see a wikipedia parallel. There's peeps among us that will 2am doom scroll wikipedia, peeps that will only do that same on social media and peeps who do a bit of both.

If and when smart glasses ubiquitious do all humans become know it alls with the answers to our questions always right in front of us? If so how will that change how we learn?

>And it's not just me; that is most people's experience with LLMs

Don't just assert shit you have no backing for.

In my experience people take what they read from LLMs at face value. I guess my anecdote is as good as yours.

Honestly using it less and less for exactly this reason. A lot of the time now even when I have a question for it, I think of the answer before I even send the question to it. And I just don't use it in IDE's at all anymore, period. Chat only.