Comment by VoidWhisperer

2 years ago

Wow, reddit found a way to make themselves even less useful somehow. After the API fiasco, that seemed like it'd be pretty hard to do.

But, apparently, they did finally find a way to make money.

If they kept their API open then by now the entirety of the site would be ai slop that was built with chatgpt and launched with the api.

Then again most of what that site does is just blend and regurgitate the information that's currently on it anyway.

which is ironic because pre-AI every solid piece of obscure information and non-programming question usually had an answer on reddit, its an extremely valuable dataset looking back. but moving forward i think its only going to become less valuable and people will probably manually/custom-scrape all the questions out of worthwhile subreddits and open up their data for free

  • When I was young, my brother knew a guy who was really into movies. If you wanted to know about a movie you couldn't remember, you would go talk to that guy.

    For a while, the internet had an end-run play that made that guy less useful. You can just go on the internet for obscure movie information, buddy.

    But now it seems like knowing a movie guy is going to be the only way to get a real person's opinion on movies. The internet is about to forget everything without a profit motive and just start telling you that the latest product from a monolith corp like disney is the only movie worth watching. If someone scrapes all the useful movie opinions off of reddit and spends their time crafting it into a usable format, that guy's probably got a company. But not Bill. Bill's just a guy you can know or not know. You can't monetize knowing Bill. Sidenote that's probably why it irked me so bad when some bozo coined the phrase "social capital".

The API changes and these robots.txt were part of the same strategy - preventing third parties from scrapping their data and reducing the AI generated content that makes it into their data. So they can sell that data and make money.

The only things it does for me is forcing me to use Google as a large amount of the answers I need is on reddit.

  • So then this gambit worked. It sucks and I hate it. I will continue to use DDG/Bing first but it looks like I'll be hitting up Google more often too.

  • > The only things it does for me is forcing me to use Google

    Startpage, Kagi and Lukol are 3 that source from Google. I imagine there are others.