Comment by reconnecting 2 days ago Did you check IP address of this UA? 4 comments reconnecting Reply arjie 2 days ago Yeah, a while ago, they're all Singapore reporting Amazonbot. Here is an example request: "GET /w/A_Wedding_at_City_Hall HTTP/1.1" 200 9677 "-" "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36" The actual IP is in X-Forwarded-For and I didn't keep that. reconnecting 1 day ago This is just a spoofed UA, because Amazon has a publicly available range of their bots and they are not in Singapore. arjie 1 day ago That makes sense. I wonder why Amazonbot specifically as a target to spoof.I hoped to get them not stuck using a robots.txt but they refuse to obey it and keep hitting that page with various params. No problem for me, but they are going nowhere. 1 reply →
arjie 2 days ago Yeah, a while ago, they're all Singapore reporting Amazonbot. Here is an example request: "GET /w/A_Wedding_at_City_Hall HTTP/1.1" 200 9677 "-" "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36" The actual IP is in X-Forwarded-For and I didn't keep that. reconnecting 1 day ago This is just a spoofed UA, because Amazon has a publicly available range of their bots and they are not in Singapore. arjie 1 day ago That makes sense. I wonder why Amazonbot specifically as a target to spoof.I hoped to get them not stuck using a robots.txt but they refuse to obey it and keep hitting that page with various params. No problem for me, but they are going nowhere. 1 reply →
reconnecting 1 day ago This is just a spoofed UA, because Amazon has a publicly available range of their bots and they are not in Singapore. arjie 1 day ago That makes sense. I wonder why Amazonbot specifically as a target to spoof.I hoped to get them not stuck using a robots.txt but they refuse to obey it and keep hitting that page with various params. No problem for me, but they are going nowhere. 1 reply →
arjie 1 day ago That makes sense. I wonder why Amazonbot specifically as a target to spoof.I hoped to get them not stuck using a robots.txt but they refuse to obey it and keep hitting that page with various params. No problem for me, but they are going nowhere. 1 reply →
Yeah, a while ago, they're all Singapore reporting Amazonbot. Here is an example request:
The actual IP is in X-Forwarded-For and I didn't keep that.
This is just a spoofed UA, because Amazon has a publicly available range of their bots and they are not in Singapore.
That makes sense. I wonder why Amazonbot specifically as a target to spoof.
I hoped to get them not stuck using a robots.txt but they refuse to obey it and keep hitting that page with various params. No problem for me, but they are going nowhere.
1 reply →