Comment by ogogmad
6 months ago
Hallucinations might get solved by faster, cheaper and more accurate, vision and commonsense-physics models. Hypothesis: Hallucinations are a problem only because physical reality isn't text. Once people switch to models that predict physical states instead of missing text, then we'll have domestic robots and lower hallucination rates.
Where is the training data for that? LLMs work because we already had tons of text that could be obtained cheaply. Where is the training data for physical reality?