Comment by paranoidrobot
5 months ago
I wouldn't put it past any company these days doing crawling in an aggressive manner to use proxy networks.
5 months ago
I wouldn't put it past any company these days doing crawling in an aggressive manner to use proxy networks.
With the amount of "if cloud IP then block" rules in place for many things (to weed out streaming VPNs and "potential" ddos-ing) I wouldn't doubt that at all.