Comment by inigyou
2 months ago
Scrapers generally aren't looking for random websites to scrape. They have a specific URL in mind. Only if the goal was DDoS would they not care which URL was accessed.
2 months ago
Scrapers generally aren't looking for random websites to scrape. They have a specific URL in mind. Only if the goal was DDoS would they not care which URL was accessed.
They also don't care which URL was accessed when the goal is scraping as much text as possible for AI training.