Amazon's AI crawler is making my Git server unstable 2 years ago (xeiaso.net) 11 comments bitbasher Reply Add to library alphan0n 2 years ago Have you verified that they are actually Amazon crawlers as outlined here:https://developer.amazon.com/amazonbot xena 2 years ago Yes. alphan0n 2 years ago Can you share the list of offending ip’s, here or your website so we can use them in block lists?Also, there is an email to contact:amazonbot@amazon.com 2 replies → JSTrading 2 years ago How much of a problem is it? xena 2 years ago 3Ti of egress and climbing, I'm in the hole financially and it's making my personal infra that relies on it unstable. jsheard 2 years ago Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude... 2 replies →
alphan0n 2 years ago Have you verified that they are actually Amazon crawlers as outlined here:https://developer.amazon.com/amazonbot xena 2 years ago Yes. alphan0n 2 years ago Can you share the list of offending ip’s, here or your website so we can use them in block lists?Also, there is an email to contact:amazonbot@amazon.com 2 replies →
xena 2 years ago Yes. alphan0n 2 years ago Can you share the list of offending ip’s, here or your website so we can use them in block lists?Also, there is an email to contact:amazonbot@amazon.com 2 replies →
alphan0n 2 years ago Can you share the list of offending ip’s, here or your website so we can use them in block lists?Also, there is an email to contact:amazonbot@amazon.com 2 replies →
JSTrading 2 years ago How much of a problem is it? xena 2 years ago 3Ti of egress and climbing, I'm in the hole financially and it's making my personal infra that relies on it unstable. jsheard 2 years ago Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude... 2 replies →
xena 2 years ago 3Ti of egress and climbing, I'm in the hole financially and it's making my personal infra that relies on it unstable. jsheard 2 years ago Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude... 2 replies →
jsheard 2 years ago Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude... 2 replies →
Have you verified that they are actually Amazon crawlers as outlined here:
https://developer.amazon.com/amazonbot
Yes.
Can you share the list of offending ip’s, here or your website so we can use them in block lists?
Also, there is an email to contact:
amazonbot@amazon.com
2 replies →
How much of a problem is it?
3Ti of egress and climbing, I'm in the hole financially and it's making my personal infra that relies on it unstable.
Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude...
2 replies →