Slacker News Slacker News logo featuring a lazy sloth with a folded newspaper hat
  • top
  • new
  • show
  • ask
  • jobs
Library

Comment by ncruces

3 days ago

It's not random internet people saying it's training. It's Cloudflare, among others.

Search for “A graph of daily requests over time, comparing different categories of AI Crawlers” on this blog: https://blog.cloudflare.com/ai-labyrinth/

1 comment

ncruces

Reply

johnea  2 days ago

In the feed today:

AI crawlers and fetchers are blowing up websites, with Meta and OpenAI the worst offenders

https://www.theregister.com/2025/08/21/ai_crawler_traffic/

Slacker News

Product

  • API Reference
  • Hacker News RSS
  • Source on GitHub

Community

  • Support Ukraine
  • Equal Justice Initiative
  • GiveWell Charities