← Back to context

Comment by silver_silver

12 hours ago

The reality is that it’s not possible to learn if one offloads the work itself to an LLM

A more accurate phrasing is: It's significantly less likely that one learns the portion of the work they offload to an LLM.

A random anecdote is that most of the people I know who went very far in theoretical math are relatively poor at basic mental arithmetic, because they always think in the abstract and offload addition and multiplication to the calculator. It doesn't mean they can't do it, they just aren't as practiced or as fast at it.

  • That's just a poor analogy. A better one would be with lobotimized people doing math.

  • The difference is that at one point they could do basic arithmetic. They went through the fundamentals/building blocks to get where they are currently. Getting weaker at something is not the same as never having to put in the effort to learn it in the first place. Just because they’re not particularly good at it anymore doesn’t mean they don’t understand how arithmetic fundamentally works (which would be incredibly concerning). They can look at a problem on a piece of paper and completely understand what it means.

    Also, they are leaning on a calculator, a specific tool with a proven use that literally everyone knows how to use. LLM’s are glorified beta tests where the VC-backed companies are begging the rest of us to figure out the billion dollar application for them. It doesn’t even remotely compare from a utility standpoint. I don’t need to promise you what a calculator will eventually do when it gets better or convince you of their usefulness. It is self evident and consistent

Just like how you significantly increased the difficulty of exams in "open book" exams in the past where the only way to pass the open book exam was to know the material well, you similarly need to increase the difficulty of other work where it won't matter if you have an LLM, because you won't pass without knowing your shit either!

  • The problem is that only works at the advanced courses. However people need to learn the basics before they reach that level, specially when they are starting and are in many regards below the LLM's baseline.

  • Says who?

    Your work will be ‘graded’ by other humans who don’t know what they are talking about, or an LLM which will assume the median answer is correct?

They learn if they have to, like we always did. In-person exams (proctored) are good for testing that.