Comment by nojs
9 months ago
Charge site owners to protect the site from aggressive crawlers, charge crawlers/agents to bypass the protection. Like a good old fashioned protection racket
9 months ago
Charge site owners to protect the site from aggressive crawlers, charge crawlers/agents to bypass the protection. Like a good old fashioned protection racket
That's not what protection racket means. Cloudflare isn't the one building LLMs and scraping websites.
I guess it would be if Cloudflare was operating the bots.
huh? they can block the bots
Usually the protection racket (https://en.wikipedia.org/wiki/Protection_racket) is when the people who will cause the destruction charge to prevent it from happening.
Paying a security guard isn't considered a protection racket, while paying a member of the mob so that nothing happens to my store is considered a protection racket.
1 reply →
Charge crawlers and pay site owners, and take a cut of course
Thanks for the tl;dr . Why is this blog post so long? Will they charge per token?