Comment by paranoidrobot
18 hours ago
I wouldn't put it past any company these days doing crawling in an aggressive manner to use proxy networks.
18 hours ago
I wouldn't put it past any company these days doing crawling in an aggressive manner to use proxy networks.
With the amount of "if cloud IP then block" rules in place for many things (to weed out streaming VPNs and "potential" ddos-ing) I wouldn't doubt that at all.