Comment by lblume

7 months ago

The linked page claims that most identified crawlers are related to scraping for training data of LLMs, which seems likely.

0 comments