← Back to context Comment by jsheard 3 months ago Real search engines respect robots.txt so you could just tell them not to enter Markov Chain Hell. 3 comments jsheard Reply throwaway744678 3 months ago I suspect AI crawler would also (quickly learn to) respect it also? jsheard 3 months ago In that case, mission accomplished.
throwaway744678 3 months ago I suspect AI crawler would also (quickly learn to) respect it also? jsheard 3 months ago In that case, mission accomplished.
I suspect AI crawler would also (quickly learn to) respect it also?
In that case, mission accomplished.