← Back to context

Comment by GaggiX

9 days ago

Openclaw agents use the same browser and ASN that me and you use, also the llms.txt (as shown) is displayed as a normal blog page so it can be discover by the agents without having to fetch /llms.txt at random.

6 comments

GaggiX

Reply
reconnecting  9 days ago

When I look at LLMs.txt, I see every request and there are no ASNs from residential networks or browsers UA.

  • GaggiX  9 days ago

    For the third time I'm telling you on Anna’s Archive they have displayed the llms.txt as a standard blog page, not hidden in /llms.txt, so that agents can notice it without having to fetch /llms.txt at random. That's why it's meant for openclaw agents and not openai/anthropic crawlers.

    • supermatt  9 days ago

      I don’t understand your reasoning.

      Are you suggesting that openclaw will magically infer a blog post url instead? Or that openclaw will traverse the blog of every site regardless of intent?

      Anyway, AA do provide it as a text file at /llms.txt, no idea why you think it is a blog post, or how that makes it better for openclaw.

      1 reply →