Comment by ilamont
13 hours ago
Shouldn't the solution be to gate bulk access for automated services for a price? Not just the wayback machine, any personal or corporate website?
My blogs are getting slammed and there are issues with cloudflare or captchas.
This! But only wayback machine, other services I'm not sure.
But maybe the problem is that they can't serve the data from the other websites like this, if they use it commercially. Right now they have non-commercial use, from what I understand.
> Shouldn't the solution be to gate bulk access for automated services for a price?
Fine in theory but determined scrapers will use residential proxies in bulk.
These should be illegal unless users sign off on every fucking byte.