← Back to context Comment by jandrese 20 days ago If a bot ignores robots.txt that's a paddlin'. Right to the blacklist. 5 comments jandrese Reply nabla9 20 days ago The linked article explains what happens when you block their IP. gs17 20 days ago For reference:> If you try to rate-limit them, they’ll just switch to other IPs all the time. If you try to block them by User Agent string, they’ll just switch to a non-bot UA string (no, really).It's really absurd that they seem to think this is acceptable. viraptor 20 days ago Block the whole ASN in that case. therealdrag0 19 days ago What about adding fake sleeps?
nabla9 20 days ago The linked article explains what happens when you block their IP. gs17 20 days ago For reference:> If you try to rate-limit them, they’ll just switch to other IPs all the time. If you try to block them by User Agent string, they’ll just switch to a non-bot UA string (no, really).It's really absurd that they seem to think this is acceptable. viraptor 20 days ago Block the whole ASN in that case. therealdrag0 19 days ago What about adding fake sleeps?
gs17 20 days ago For reference:> If you try to rate-limit them, they’ll just switch to other IPs all the time. If you try to block them by User Agent string, they’ll just switch to a non-bot UA string (no, really).It's really absurd that they seem to think this is acceptable. viraptor 20 days ago Block the whole ASN in that case. therealdrag0 19 days ago What about adding fake sleeps?
The linked article explains what happens when you block their IP.
For reference:
> If you try to rate-limit them, they’ll just switch to other IPs all the time. If you try to block them by User Agent string, they’ll just switch to a non-bot UA string (no, really).
It's really absurd that they seem to think this is acceptable.
Block the whole ASN in that case.
What about adding fake sleeps?