← Back to context

Comment by Dwedit

1 day ago

A well-written scraper would check the image against a CLIP model or other captioning model to see if the text there actually agrees with the image contents.

Ain't nobody got the processing time for that! Scraping is about more, more, more. If they do any filtering it'll be afterwards.

Then captions that are somewhat believable? "Abstract digital art piece by F. U. Botts resembling wide landscapes in vibrant colors"

Do scrapers actually do such things on every page they download? Sampling a small fraction of a site to check how trustworthy it is, I can see happen, but I would think they’d rather scrape many more pages than spend resources doing such checks on every page.

Or is the internet so full of garbage nowadays that it is necessary to do that on every page?