Comment by zppln

8 hours ago

I feel at this point you'd almost be better off hand-curating a set of domains and only crawl those.

not sure if this was intentional, but everything old is new again; back to OH yahoo? or Craig's list?

  • Not quite, in that you can curate domains but crawl all the urls on those domains.

    I think SEO plam + AI slop is likely to lead us back to human curation.