Comment by JK-Swizzle
10 days ago
I have been working on an indexer for myself using data from common crawl. They do all the leg work and just host the outcome.
10 days ago
I have been working on an indexer for myself using data from common crawl. They do all the leg work and just host the outcome.
Common Crawl is a really cool project! We're looking to implement a similar EU-based version: https://openwebindex.eu