Comment by arjie

2 days ago

Amazonbot does this despite my efforts in robots.txt to help it out. I look at all the Singapore requests and they’re Amazonbot trying to get various variants of the Special:RecentChanges page. You’re wasting your time, Amazonbot. I’m trying to help you.

5 comments

arjie

Reply
reconnecting  2 days ago

Did you check IP address of this UA?

  • arjie  2 days ago

    Yeah, a while ago, they're all Singapore reporting Amazonbot. Here is an example request:

        "GET /w/A_Wedding_at_City_Hall HTTP/1.1" 200 9677 "-" "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36"

    The actual IP is in X-Forwarded-For and I didn't keep that.