Comment by tyingq
2 years ago
Which is good background to this story about Reddit locking down robots.txt and trying to get money from the AI teams scraping their content.
2 years ago
Which is good background to this story about Reddit locking down robots.txt and trying to get money from the AI teams scraping their content.
If they're considering Reddit content to be free of generated material, I've got bad news for them. It's not quite the Chernobyl-grade hole that Pinterest has become, but it's hardly "low background".
I still believe reddit is an amazing source. Any article you read on reddit, chances are the comments are better than the original text. They will debunk the article, present a diversity of reactions, and most importantly, they will be grounded in public opinion unlike the press which caters to money interests.
You just copy-paste a conversation into the LLM and ask for an article. For taste, here is one generated from this very conversation. https://pastebin.com/raw/JFH6PGqg
> Any article you read on reddit, chances are the comments are better than the original text.
We're talking about reddit dot com here? Seriously? I find it difficult to find any comments worth reading at all on that website. 99% of the stuff that isn't buried is just the same recycled jokes again and again and again.
1 reply →
Sure. I think Reddit is aware though, that time is running out to get paid for whatever human generated content is there that isn't already scraped.