Comment by oriettaxx

last week we had to double AWS-RDS database CPU, ... and the biggest load was from AmazonBot:

the weird is:

1. AmazonBot traffic imply we give more money to AWS (in terms of CPU, DB cpu, and traffic, too)

2. What the hell is AmazonBot doing? what's the point of that crawler?