Comment by danielbarla

In general, I completely agree with you. Personally, as a human: I have fallible memory, beliefs that are not as sound as I may believe, and all of those notwithstanding, I may not correctly reason, even if my "inputs" were perfect. Let's not even get into cognitive biases, etc. I am acutely aware of my, and other humans' fallibilities.

I think when people are irritated by the "hallucination" aspect of LLMs, they are often running into something of a slightly different nature. I mean, firstly, there seems to be a higher-than-normal ratio of these "little mistakes". And secondly, there are some pretty odd ones - e.g. in my team, Claude regularly just straight up makes up Jira ticket numbers, and then refers to them with high confidence. I guess what I'm saying is that a human would probably not just make up an id, and run with it (they may be off by one, or mix two up, etc). In my opinion, these can be successfully treated, but I guess you can never fully eliminate the tendency that irks people.