← Back to context

Comment by tom1337

11 hours ago

I wonder if the three search engines get access to cloudflare protected sites without any captcha or bot interventions

Most likely not. Their Crawling service for example does not bypass the cloudflare protections either.

  • You are conflating a couple of different things here

    There actually is such a thing as verified bots on Cloudflare that gets through most blocks (and these services are likely are part of that), but ultimately it just depends on how the website owner has things set up in Cloudflare

    • > There actually is such a thing as verified bots on Cloudflare that gets through most blocks

      Verified bot is just a label. What you do with that information is entirely up to you as the operator. It doesn't say anything anything about the service and doesn't provide any guarantees about the traffic.

      2 replies →

    • I hate to be rude but once again I am begging people to actually read the post. It is mentioned in the second paragraph that they are all verified bots.

      1 reply →