Comment by coldpie

9 hours ago

> allowing Googlebot to crawl my sites

As far as I know, you don't have a choice. They have no obligation to respect your wishes, and LLMs are legally allowed to scrape & republish your content.

9 comments

coldpie

Reply
margalabargala  9 hours ago

> They have no obligation to respect your wishes

I have no obligation to not send all scraper-looking traffic to a black hole full of zip bombs.

  • vntok  8 hours ago

    Spreading malware to your website's visitors is wild and illegal in most jurisdictions. I certainly wouldn't confess about it online.

    • margalabargala  6 hours ago

      Malware? It's just a large file. A very, very large file.

      But fine. How about I just...don't respond to those requests at all. I have no obligation to send them data period.

    • ChoGGi  7 hours ago

      Is AI a visitor or malware? It certainly steals paid resources (bandwidth).

      Disclaimer: his website is for hosting malware for "testing" purposes. Testing how well AI can't deal with it.

  • charcircuit  8 hours ago

    You do have an obligation because what you are describing is illegal, at least in the US under the CFAA.