← Back to context

Comment by actuallyalys

16 days ago

In this case, it appears to be just that the author didn't properly qualify the sentence (see their reply to my comment).

But certainly it does seem like a potential risk of LLMs that they will synthesize people's notes and early marketing materials into "experience reports" that describe benefits and uses that never actually happened. Potentially these could then become part of training data or future contexts via search for other people writing, further exacerbating the effect. We already see similar phenomenon with human errors getting magnified via word-of-mouth.