← Back to context Comment by baobun 2 years ago Mind sharing a decent robots.txt and/or user-agent list to block the AI crawlers? 2 comments baobun Reply jazzyjackson 2 years ago Linked upthread: https://github.com/ai-robots-txt/ai.robots.txt/blob/main/rob... hooloovoo_zoo 2 years ago Any of the big chat models should be able to reproduce it :)
jazzyjackson 2 years ago Linked upthread: https://github.com/ai-robots-txt/ai.robots.txt/blob/main/rob...
Linked upthread: https://github.com/ai-robots-txt/ai.robots.txt/blob/main/rob...
Any of the big chat models should be able to reproduce it :)