Comment by arcastroe

> If you try to block them by User Agent string, they'll just switch to a non-bot UA string (no, really).

Instead of blocking them (non-200 response), what if you shadow-ban them and instead serve 200-response with some useless static content specifically made for the bots?