Comment by hinkley
2 months ago
Google’s spiders will punish you for giving them too many 429 responses. It’s hell for hosting sites with vanity urls. They can’t tell they’re sending you 50+ req/s.
It’s practically a protection racket. Only AWS gets the money.
50 requests/sec? Did you forget a few zeros?
Little’s law is a bitch, and you can get away with a little throttling but not much.
Also, that’s a bit dismissive for HN.