Comment by jerhewet

> picking a fight with the one company that actually seems to be trying to play

> it straight in this sector (Anthropic)

https://stephenfollows.com/p/what-just-happened-to-thenumber...

Search for "Anthropic crawls over 38,000 pages for every single visitor".

If they can't get their bots to work correctly, what makes you think Anthropic is doing anything else correctly?