Comment by matkoniecz

Unfortunately scrappers are problematic enough that for more and more organizations alternative is to stop serving traffic.

For example OpenStreetMap is using nowadays this or equivalents to prevent downtime and/or runaway costs.