Comment by lblume

1 day ago

The linked page claims that most identified crawlers are related to scraping for training data of LLMs, which seems likely.

0 comments