Comment by dgellow
15 hours ago
A bit different, but one thing I’ve seen is models repackaging Reddit slop. Like, it will do a search, find a Reddit thread somewhat related where someone in a comment casually mentioned incorrect information that any human would have dismissed. The model takes that as granted, but expands on it and present it as a well established fact, presented in a very plausible fashion.
In general I don’t find models to be good at evaluating the quality of a source :(
As if it needs results to do that. You can give it a description of what you're looking for and get back some nonsense about how it's a "viral" and "legendary" page, with plenty of entirely fake details because it didn't actually find the page you wanted.
The other day Gemini gave me the correct answer, but cited an outdated Reddit thread which basically said the opposite.
Newspapers have been doing this for a long time, notably the Metro in London.
There’s also whole TikTok (etc) channels who take random posts from Ask Reddit and just AI narrate the question and the top n highly-voted answers while showing a screenshot of each comment.
What percentage reads Metro and what percentage uses LLMs
i actively assume it is worse since, for example, spez signed a 60 million dollar deal to give Google access to the firehose. so then if you have niche, highly engaged subreddits infested by AI bots creating posts, then commenting on posts, then being trained on that content... you have Ouroburos eating its own poop, and models have less then zero incentive to evaluate the quality of a source, especially if they are the source