Comment by wilg

5 months ago

robots.txt bro https://developers.openai.com/api/docs/bots/

"bro": https://www.businessinsider.com/openai-anthropic-ai-ignore-r...