Comment by arjie

1 day ago

That makes sense. I wonder why Amazonbot specifically as a target to spoof.

I hoped to get them not stuck using a robots.txt but they refuse to obey it and keep hitting that page with various params. No problem for me, but they are going nowhere.