Comment by toomuchtodo

6 hours ago

Anyone can leverage common crawl and/or run their own crawler, to do so isn’t novel.