Comment by jsheard
1 year ago
Google does voluntarily allow robots.txt to be configured such that they will index pages but they promise not to use the content for training, but yeah if Google decided to go rogue then there wouldn't really be anything that site owners could do about it without killing their presence in Googles index.
No comments yet
Contribute on Hacker News ↗