Comment by ranger_danger

4 months ago

How is a curl user-agent automatically a well-behaved automation?

One assumes it is a human, running curl manually, from the command line on a system they're authorized to use. It's not wget -r.

  • Sounds like the perfect opportunity for bots to use the curl user-agent. How do we know they're not already doing this?

    • We don’t but now that we’ve talked about it publicly on the Internet they’re gonna start doing that. I'm sure they previously were, but now we've gone and told them, uh yeah.