Comment by Saris
16 hours ago
What I don't understand is why a bot/scraper needs to load every page and image multiple times in the same hour or whatever session it's doing on my site. If I have say 10 pages and 100 images, surely 110 requests should be all it needs to load everything.
No comments yet
Contribute on Hacker News ↗