Comment by daft_pink 1 month ago isn’t it going to be easy to just block those websites? 2 comments daft_pink Reply elsjaako 1 month ago I don't know what this particular author has against LLMs, but a lot of people are bothered by the very intense, robots.txt ignorming, scraping of their sites.The website being blocked by the scrapers would be a positive outcome. rk3000 1 month ago or an agent block?
elsjaako 1 month ago I don't know what this particular author has against LLMs, but a lot of people are bothered by the very intense, robots.txt ignorming, scraping of their sites.The website being blocked by the scrapers would be a positive outcome.
I don't know what this particular author has against LLMs, but a lot of people are bothered by the very intense, robots.txt ignorming, scraping of their sites.
The website being blocked by the scrapers would be a positive outcome.
or an agent block?