Comment by toomuchtodo

7 hours ago

Anyone can leverage common crawl and/or run their own crawler, to do so isn’t novel.