← Back to context Comment by dspillett 16 hours ago The same could be said of robots.txtAnd anything else that might tell them not to access something. 2 comments dspillett Reply reddalo 13 hours ago robots.txt predates the modern web though dspillett 10 hours ago My point was that llms.txt not working is no different from them ignoring everything else that came before and probably everything that is yet to come.If they want it, they will take it, polite directives in text files will have no effect.
reddalo 13 hours ago robots.txt predates the modern web though dspillett 10 hours ago My point was that llms.txt not working is no different from them ignoring everything else that came before and probably everything that is yet to come.If they want it, they will take it, polite directives in text files will have no effect.
dspillett 10 hours ago My point was that llms.txt not working is no different from them ignoring everything else that came before and probably everything that is yet to come.If they want it, they will take it, polite directives in text files will have no effect.
robots.txt predates the modern web though
My point was that llms.txt not working is no different from them ignoring everything else that came before and probably everything that is yet to come.
If they want it, they will take it, polite directives in text files will have no effect.