← Back to context Comment by dspillett 13 hours ago The same could be said of robots.txtAnd anything else that might tell them not to access something. 2 comments dspillett Reply reddalo 10 hours ago robots.txt predates the modern web though dspillett 7 hours ago My point was that llms.txt not working is no different from them ignoring everything else that came before and probably everything that is yet to come.If they want it, they will take it, polite directives in text files will have no effect.
reddalo 10 hours ago robots.txt predates the modern web though dspillett 7 hours ago My point was that llms.txt not working is no different from them ignoring everything else that came before and probably everything that is yet to come.If they want it, they will take it, polite directives in text files will have no effect.
dspillett 7 hours ago My point was that llms.txt not working is no different from them ignoring everything else that came before and probably everything that is yet to come.If they want it, they will take it, polite directives in text files will have no effect.
robots.txt predates the modern web though
My point was that llms.txt not working is no different from them ignoring everything else that came before and probably everything that is yet to come.
If they want it, they will take it, polite directives in text files will have no effect.