Comment by reconnecting
1 day ago
This is just a spoofed UA, because Amazon has a publicly available range of their bots and they are not in Singapore.
1 day ago
This is just a spoofed UA, because Amazon has a publicly available range of their bots and they are not in Singapore.
That makes sense. I wonder why Amazonbot specifically as a target to spoof.
I hoped to get them not stuck using a robots.txt but they refuse to obey it and keep hitting that page with various params. No problem for me, but they are going nowhere.
Perhaps result of A/B testing, because web masters less frequently block them.