Amazon's AI crawler is making my Git server unstable 2 months ago (xeiaso.net) 11 comments bitbasher Reply Add to library alphan0n 2 months ago Have you verified that they are actually Amazon crawlers as outlined here:https://developer.amazon.com/amazonbot xena 2 months ago Yes. alphan0n 2 months ago Can you share the list of offending ip’s, here or your website so we can use them in block lists?Also, there is an email to contact:amazonbot@amazon.com 2 replies → JSTrading 2 months ago How much of a problem is it? xena 2 months ago 3Ti of egress and climbing, I'm in the hole financially and it's making my personal infra that relies on it unstable. jsheard 2 months ago Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude... 2 replies →
alphan0n 2 months ago Have you verified that they are actually Amazon crawlers as outlined here:https://developer.amazon.com/amazonbot xena 2 months ago Yes. alphan0n 2 months ago Can you share the list of offending ip’s, here or your website so we can use them in block lists?Also, there is an email to contact:amazonbot@amazon.com 2 replies →
xena 2 months ago Yes. alphan0n 2 months ago Can you share the list of offending ip’s, here or your website so we can use them in block lists?Also, there is an email to contact:amazonbot@amazon.com 2 replies →
alphan0n 2 months ago Can you share the list of offending ip’s, here or your website so we can use them in block lists?Also, there is an email to contact:amazonbot@amazon.com 2 replies →
JSTrading 2 months ago How much of a problem is it? xena 2 months ago 3Ti of egress and climbing, I'm in the hole financially and it's making my personal infra that relies on it unstable. jsheard 2 months ago Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude... 2 replies →
xena 2 months ago 3Ti of egress and climbing, I'm in the hole financially and it's making my personal infra that relies on it unstable. jsheard 2 months ago Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude... 2 replies →
jsheard 2 months ago Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude... 2 replies →
Have you verified that they are actually Amazon crawlers as outlined here:
https://developer.amazon.com/amazonbot
Yes.
Can you share the list of offending ip’s, here or your website so we can use them in block lists?
Also, there is an email to contact:
amazonbot@amazon.com
2 replies →
How much of a problem is it?
3Ti of egress and climbing, I'm in the hole financially and it's making my personal infra that relies on it unstable.
Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude...
2 replies →