Amazon's AI crawler is making my Git server unstable 2 days ago (xeiaso.net) 11 comments bitbasher Reply Add to library alphan0n 2 days ago Have you verified that they are actually Amazon crawlers as outlined here:https://developer.amazon.com/amazonbot xena 2 days ago Yes. alphan0n 2 days ago Can you share the list of offending ip’s, here or your website so we can use them in block lists?Also, there is an email to contact:amazonbot@amazon.com 2 replies → JSTrading 2 days ago How much of a problem is it? xena 2 days ago 3Ti of egress and climbing, I'm in the hole financially and it's making my personal infra that relies on it unstable. jsheard 2 days ago Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude... 2 replies →
alphan0n 2 days ago Have you verified that they are actually Amazon crawlers as outlined here:https://developer.amazon.com/amazonbot xena 2 days ago Yes. alphan0n 2 days ago Can you share the list of offending ip’s, here or your website so we can use them in block lists?Also, there is an email to contact:amazonbot@amazon.com 2 replies →
xena 2 days ago Yes. alphan0n 2 days ago Can you share the list of offending ip’s, here or your website so we can use them in block lists?Also, there is an email to contact:amazonbot@amazon.com 2 replies →
alphan0n 2 days ago Can you share the list of offending ip’s, here or your website so we can use them in block lists?Also, there is an email to contact:amazonbot@amazon.com 2 replies →
JSTrading 2 days ago How much of a problem is it? xena 2 days ago 3Ti of egress and climbing, I'm in the hole financially and it's making my personal infra that relies on it unstable. jsheard 2 days ago Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude... 2 replies →
xena 2 days ago 3Ti of egress and climbing, I'm in the hole financially and it's making my personal infra that relies on it unstable. jsheard 2 days ago Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude... 2 replies →
jsheard 2 days ago Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude... 2 replies →
Have you verified that they are actually Amazon crawlers as outlined here:
https://developer.amazon.com/amazonbot
Yes.
Can you share the list of offending ip’s, here or your website so we can use them in block lists?
Also, there is an email to contact:
amazonbot@amazon.com
2 replies →
How much of a problem is it?
3Ti of egress and climbing, I'm in the hole financially and it's making my personal infra that relies on it unstable.
Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude...
2 replies →