Comment by amelius
7 hours ago
The problem is that AI is just too smart to explain complicated topics to humans. It has an immense context window that humans simply don't match. AI labs should work on bridging that, but you cannot really put any blame on them currently.
AI Boosters: AIs are just getting better at everything and so their broad capacity can be defined as "intelligence".
Also AI Boosters: These entities are too intelligent to explain what they are doing to people...
I mean, Terry Tao actually used ChatGPT to explain one of the earlier OpenAI results. Humans working with AI can explain this stuff. If nothing else, OpenAI could be releasing things at the rate that it can get human mathematicians to explain the results. Which is to say, "yes, I can blame them", I don't expect them to behave differently but I can certainly blame them.
If humans with the background to understand the proof can get the AI to satisfactorily explain itself, then OpenAI doesn't need to publish explanations or release things at a rate that a human can explain. They have an interactive explainer that you can just ask!
It's still of course useful to have some of this distilled understanding be written down, just like I had it generate high level descriptions of our code at work so it doesn't have to rediscover everything every time, but that's more of a cache/optimization.
To Archetypal Aunt Tillie, perhaps programmers already looked like some sort of priest trying to rationalize and convey the ineffable decisions of the fickle computer spirit... but I really hope that the job doesn't start looking like that from the inside too.
It'd be some sort of... epistemic step backwards by civilization.
Please, that’s just bullshit. Humans have been at the forefront of intelligent reasoning for millennia. A few dozen results by AI don’t change that.
Indeed, as we speak mathematicians are taking the time and effort to (successfully) digest and explain these results.
There has always been a smartest creature on the planet, whichever species was smartest has changed thousands of times and there is nothing special about humans that keeps them from being superseded.
You didn't understand me. What I'm saying is that current AI is not good at explaining things because their "brain" works differently. Imagine someone with a 10x larger working memory explaining something to you, even though they are equally intelligent. They would try to overflow your working memory where a better matched teacher would chop it up in human digestible pieces.