Comment by cyrnel
14 hours ago
Seems some of these bots are behaving abusively on sites with lots of links (like git forges). I have some sites receiving 200 requests per day and some receiving 1 million requests per day from these AI bots, depending on the design of the site.
No comments yet
Contribute on Hacker News ↗