Comment by lblume

2 days ago

The linked page claims that most identified crawlers are related to scraping for training data of LLMs, which seems likely.

0 comments