Comment by ryandv

16 days ago

At this point I can't tell if all these blog posts hyping LLMs are themselves written by LLMs, and thus hallucinating alleged productivity boosts and "next-generation development practices" that are nowhere to actually be found in reality.

Shame, because it's a bunch of nice looking words - but it doesn't matter if they're completely false.

In this case, it appears to be just that the author didn't properly qualify the sentence (see their reply to my comment).

But certainly it does seem like a potential risk of LLMs that they will synthesize people's notes and early marketing materials into "experience reports" that describe benefits and uses that never actually happened. Potentially these could then become part of training data or future contexts via search for other people writing, further exacerbating the effect. We already see similar phenomenon with human errors getting magnified via word-of-mouth.