Comment by SoftTalker
2 hours ago
You can block the Internet Archive with a robots.txt file, but no guarantees that other archives/scrapers or even individuals won't index or copy it. But for AI training, what exists in training data probably isn't the full site, and unlikely that an LLM could be spit back out verbatim (that's a guess).
No comments yet
Contribute on Hacker News ↗