Comment by dathinab

the problem in many cases is that even if such a law is made it likely

- is hard to enforce

- misses bite, i.e. it makes you more money to break it then any penalties

but in general yes, a site which indicates they don't want to be crawled by AI bots but still gets crawled should be handled similar to someone with house ban on a shop forcing them self into the shop

given how severely messed up some millennia cyber security laws are I wonder if crawlers bypassing Anubis could be interpreted as "circumventing digital access controls/protections" or similar, especially given that its done to make copies of copyrighted material ;=)