Comment by exevp
2 hours ago
The majority of humans is not delusional all the time. But every human is delusional some times. Same as the majority of LLMs hallucinating some times but not all the time.
So if the bar for proper reasoning is never ever being delusional then humans and LLMs sit in the same bucket.
They are delusional in ways that don't overlap, though. An LLM will not be delusional in the way Van Gogh or Howard Hughes was, but humans (sane ones anyways) will not hallucinate the exact kind of odd, unpredictable LLM output that makes you go "huh? why the heck did it do this in this way or write this." Things which are extremely obvious well within the limits of even elementary human reasoning are completely outside the purview of model capability; it's much easier for a model to "reason" when it comes to systems and ideas that are very discrete (which is why it's so useful when writing code, esp. in higher-level languages -- little uncertainty there and a round-robin verification process for workflows like mathematics. However once you ask it to intuit anything that falls apart quickly; its main utility lies in being able to compensate for these deficiencies with sheer volume and burning through tokens)
Even on the frontier models these blips still happen fairly often and it's intrusive to a lot of workflows.