Comment by binarymax

> If you try to rate-limit them, they’ll just switch to other IPs all the time. If you try to block them by User Agent string, they’ll just switch to a non-bot UA string (no, really). This is literally a DDoS on the entire internet.

I am of the opinion that when an actor is this bad, then the best block mechanism is to just serve 200 with absolute garbage content, and let them sort it out.