← Back to context Comment by inigyou 13 hours ago Everyone ignores robots.txt because every robots.txt blocks everyone. 2 comments inigyou Reply nubinetwork 12 hours ago I allow Google, Bing, Yahoo, Kagi, and Apple on my personal blog... who else do I need to allow? Claude, OpenAI, Alibaba, and perplexity can go to hell. inigyou 3 hours ago Think about incentives, what benefit does Anthropic obtain by going to hell?
nubinetwork 12 hours ago I allow Google, Bing, Yahoo, Kagi, and Apple on my personal blog... who else do I need to allow? Claude, OpenAI, Alibaba, and perplexity can go to hell. inigyou 3 hours ago Think about incentives, what benefit does Anthropic obtain by going to hell?
I allow Google, Bing, Yahoo, Kagi, and Apple on my personal blog... who else do I need to allow? Claude, OpenAI, Alibaba, and perplexity can go to hell.
Think about incentives, what benefit does Anthropic obtain by going to hell?