Amazon's AI crawler is making my Git server unstable 10 months ago (xeiaso.net) 11 comments bitbasher Reply Add to library alphan0n 10 months ago Have you verified that they are actually Amazon crawlers as outlined here:https://developer.amazon.com/amazonbot xena 10 months ago Yes. alphan0n 10 months ago Can you share the list of offending ip’s, here or your website so we can use them in block lists?Also, there is an email to contact:amazonbot@amazon.com 2 replies → JSTrading 10 months ago How much of a problem is it? xena 10 months ago 3Ti of egress and climbing, I'm in the hole financially and it's making my personal infra that relies on it unstable. jsheard 10 months ago Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude... 2 replies →
alphan0n 10 months ago Have you verified that they are actually Amazon crawlers as outlined here:https://developer.amazon.com/amazonbot xena 10 months ago Yes. alphan0n 10 months ago Can you share the list of offending ip’s, here or your website so we can use them in block lists?Also, there is an email to contact:amazonbot@amazon.com 2 replies →
xena 10 months ago Yes. alphan0n 10 months ago Can you share the list of offending ip’s, here or your website so we can use them in block lists?Also, there is an email to contact:amazonbot@amazon.com 2 replies →
alphan0n 10 months ago Can you share the list of offending ip’s, here or your website so we can use them in block lists?Also, there is an email to contact:amazonbot@amazon.com 2 replies →
JSTrading 10 months ago How much of a problem is it? xena 10 months ago 3Ti of egress and climbing, I'm in the hole financially and it's making my personal infra that relies on it unstable. jsheard 10 months ago Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude... 2 replies →
xena 10 months ago 3Ti of egress and climbing, I'm in the hole financially and it's making my personal infra that relies on it unstable. jsheard 10 months ago Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude... 2 replies →
jsheard 10 months ago Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude... 2 replies →
Have you verified that they are actually Amazon crawlers as outlined here:
https://developer.amazon.com/amazonbot
Yes.
Can you share the list of offending ip’s, here or your website so we can use them in block lists?
Also, there is an email to contact:
amazonbot@amazon.com
2 replies →
How much of a problem is it?
3Ti of egress and climbing, I'm in the hole financially and it's making my personal infra that relies on it unstable.
Damn that's rude. At least you appear to be using Vultr, imagine if it was running on one of those newfangled cloud providers which mark bandwidth up by a few orders of magnitude...
2 replies →