Comment by benjiro29
13 hours ago
As somebody who did plenty of scraping for his own little projects, lets just say that reddit their security concerns are just PR for "we do not want to keep supporting old.reddit".
While yes, you can not simply scrap new reddit as easily as a pure html scraper is cheaper to run. And while the new reddit its js "slow down" scraping as it need to run over a headless browser. Do you slow scraping down a lot?
No. Because you can simply spin up more instances and route over more proxies. Given the fact that you can scrap millions of pages per day, on a single cheap 1 CPU node...
The limiting factor for scraping a website is not html vs js / client vs headless browser. Its avoiding detection by running from different ips, faking browser information and masking your traffic to not give off the smell of automatization (and avoiding tls fingerprinting).
I wrote this type of stuff before we had AI to help write it, in a few days time. Now with a LLM at your fingertips in a few hours, you will have a complete working version with cloaking build in.
And the larger size difference does not matter, you can block irrelevant files via faked cache responds, to give the server the impression that your a repeat client, and no need to flood your browser instance with images, fonts etc. Some think that this is a defense, aka throttling you with increased bandwidth usage lol
So in my personal opinion, its not about dealing with scrapers, but trying to push people to new reddit, so they can finally phase out old reddit.
PS: So much fun reading new reddit on your phone browser, to have it pop-up a "use our app" banner, that prevents you from interacting with the website anymore. And even blocks firefox its scroll ability (and thus accessing to the browser its nav bar). Tip for people: delete the sites cookies and cache regularly, to prevent this usage tracking, so the banner newer shows.
> "we do not want to keep supporting old.reddit"
the second old.reddit goes is the second I stop using that site
it's already very obviously chock full of slop and AI bullshit, with some subs having long unavoidable lists of "your post was removed because you did not verify" trails that imply that automated posters found a thread and went hard
but add in privacy crushing bs -- no reason to be there anymore. Back to old school forums
I never used to be an old.reddit die-hard, but new got so bad it chased me there to where I now use a browser extension to redirect all reddit links to old. I was convinced that the website continued to get worse so they could steer you into the app which hoovers up all your personal information. But then the app is so godawful unusable that I think we're just looking at straight-up incompetence.
So yeah, I'm in the same boat: if they drop old, they drop me.
Old–school forums never left, still inhabited by the few boomers and genXers who could figure out the Internets back in the day and aren't dead yet.
The gamification of Reddit and the ephemeral nature of the main page along with subreddits with varying amounts of overlap contributed to more active interactions, though.
Some of the volume was lower quality but not all.
The boomer posts about his petunia breeding program on a BBS and he gets feedback half a year later after the other active user gathers the energy to travel to the computer room again.
On Reddit, maybe a zoomer would have asked if you can smoke petunias in Brazilian Portuguese, but that may still count as welcome human interaction to the old man.
None of that applies to new deaddit, though.
Forms are sadly dead. They cost a lot to operate and maintain security updates for so without a critical mass of users they are dead
the big click of reddit like yahoo forums and other earlier things is that each 'sub' reddit can have its own rules culture, etc. its like facebook groups in a way. Unfortunately with how bad reddit is, I see mostly my interest niche hobbies moving to facebook.