Comment by robocat
6 months ago
I imagine asking for anything obscure where there's plenty of noise can cause hallucinations. What Google search provides the answer? If the answer isn't in the training data, what do you expect? Do you ask people obscure questions, and do you then feel better than them when they guess wrong?
I just tried:
What MS-DOS program contains an easter-egg of an Amiga game?
And got some lovely answers from ChatGPT and Gemini.
Aside I personally would associate "productivity program" with productivity suite (like MS Works) so I would have trouble googling an answer (I started as a kid on Apple ][ and have worked with computers ever since so my ignorance is not age or skill related).
The good option would be for the LLM to say it doesn't know. It's the making up answers that's the problem.