← Back to context

Comment by johnea

8 months ago

To cite integrative-psych:

https://www.integrative-psych.org/resources/confabulation-no...

"...this usage is misleading, as it suggests a perceptual process that LLMs, which lack sensory input, do not possess."

They prefer the word "confabulation", but I would also differ with that.

They define confabulation: "the brain creates plausible but incorrect memories to fill gaps".

Since, as with the lack of perceptions, LLMs are not retaining anything like a memory, I would also argue this term is inappropriate.

In terms of differentiating error categories, it's straightforward to specify, math error, spelling error, grammatical error, when those occur.

In the case of syntactically correct, but factually incorrect output, the word "wrong" describes this specific error category much more accurately than "hallucinate", which carries a host of inaccurate psychological implications.

This also speaks to a main point of my original post, that the use of "hallucinate" is euphemistic.

When we use a s/w tool for the input of human language questions, with the objective of receiving correct human language answers, just having a syntactically correct answer is not sufficient.

It needs to be emphasized that answers in this category are "wrong", they are not factually correct.

Using the word "hallucinate" is making an excuse for, and thus obfuscating, this factual error generated by the s/w tool.