Comment by Kwpolska

2 days ago

With all the SPAs out there, if you want to crawl the entire Web, you need a headless browser running JavaScript. Which will pass Anubis for free.

0 comments