Comment by Sophira

I'm guessing you use search engines, right? Those use scrapers and have to use scrapers. It's how they work.

A "scraper" is simply an automated process that fetches URLs intended for display to a human, and processes it. The act of scraping doesn't imply anything about:

1. The frequency of the fetches,

2. The way that the resulting page is processed.

Search engines scrape. Again, they have to. Same goes for archive.org.

Thing is, there aren't tens of thousands of search engines/archive.orgs that can overload a site at once.