Comment by evgpbfhnr

when crawlers use a botnet to only make one request per ip per long duration that's not realistic to implement though..