It's genuinely unthinkable... this sort of technology opens up a universe of bespoke micro-explainers and apps that meet you exactly where you are, for your exact, specific needs. I don't think we've ever seen a quantum leap in technological advancement that results in such a multiple orders of magnitude reduction in input effort related to volume and quality and type of output... ever. I mean, innovations like electric light, radio, television, the internet, and smart phones are huge transformative tools that similarly changed the fabric of what's possible. But this technology compresses work that would have taken pyramid-building effort and cost and condenses it down to... minutes of matrix multiplication for pennies worth of tokens. The mind boggles.
These are not explanations. They're visualizations. There's a huge gap between the two.
Explanations give you a mental model: when I move this parameter this the effect it has. This just shows you the obvious, make a thing bigger, it gets bigger on screen. That's not an explanation.
Models are quite horrible at explaining things. They produce local narrow views that don't take into account the mental model of the listener nor do they attempt to produce the kind of long-term knowledge gain that a teacher does. I taught for over a decade.
This is why models are extremely good for people who already know what they're doing. That narrow why is all you need, like, tell me the 3 sentences that describe the mechanism behind this paper, and I'll get the rest. But building the scaffolding onto which to hang a lot of knowledge?
Give it a try. Try to have a model teach you something new. Not like "how do I tie a knot" but like a new area of math where you're going to dedicate 3 months of your free time to learning it. The results are pretty horrible.
Thank you for calling this out. There are certainly a lot of legitimate gripes with LLM generated code, but also a lot of never-before-practical solutions to manage code as well.
FWIW, I haven't seen the Gemini 4 explainers, but Codex and (particularly) Claude have been pretty decent at this for a while.
I have no idea how I’d have even started on a project like this in 2020… certainly not by writing raw WebGL — ha!
It's genuinely unthinkable... this sort of technology opens up a universe of bespoke micro-explainers and apps that meet you exactly where you are, for your exact, specific needs. I don't think we've ever seen a quantum leap in technological advancement that results in such a multiple orders of magnitude reduction in input effort related to volume and quality and type of output... ever. I mean, innovations like electric light, radio, television, the internet, and smart phones are huge transformative tools that similarly changed the fabric of what's possible. But this technology compresses work that would have taken pyramid-building effort and cost and condenses it down to... minutes of matrix multiplication for pennies worth of tokens. The mind boggles.
These are not explanations. They're visualizations. There's a huge gap between the two.
Explanations give you a mental model: when I move this parameter this the effect it has. This just shows you the obvious, make a thing bigger, it gets bigger on screen. That's not an explanation.
Models are quite horrible at explaining things. They produce local narrow views that don't take into account the mental model of the listener nor do they attempt to produce the kind of long-term knowledge gain that a teacher does. I taught for over a decade.
This is why models are extremely good for people who already know what they're doing. That narrow why is all you need, like, tell me the 3 sentences that describe the mechanism behind this paper, and I'll get the rest. But building the scaffolding onto which to hang a lot of knowledge?
Give it a try. Try to have a model teach you something new. Not like "how do I tie a knot" but like a new area of math where you're going to dedicate 3 months of your free time to learning it. The results are pretty horrible.
4 replies →
Thank you for calling this out. There are certainly a lot of legitimate gripes with LLM generated code, but also a lot of never-before-practical solutions to manage code as well.
FWIW, I haven't seen the Gemini 4 explainers, but Codex and (particularly) Claude have been pretty decent at this for a while.