The /llms.txt file, helping language models use your website 8 months ago (github.com) 1 comment mooreds Reply Add to library TimorousBestie 8 months ago LLMs broadly speaking disregard robots.txt, so I don’t see why they would bother regarding this.
TimorousBestie 8 months ago LLMs broadly speaking disregard robots.txt, so I don’t see why they would bother regarding this.
LLMs broadly speaking disregard robots.txt, so I don’t see why they would bother regarding this.