← Back to context

Comment by kabacha

6 years ago

Web-scraping is hard man, especially with mom-and-pop restaurant websites that are often exported straight from microsoft word or some ancient "platform" that got reconfigured 20 times over.

As article pointed out it picked up full-toppings pizza as plain cheese.

It could be so easy to game this.

Table Column A, menu items, lowest to highest in cost.

Table Column B, prices, highest to lowest in cost.

Naive scraper associates rows as menu item and cost.

You use CSS, etc., to rearrange things correctly. People looking at your site get info as intended, scrapers have problems, and it's only a dark pattern to them.

Surely it's cheaper to just pay someone to do data entry at that point.

  • Cheaper, less sexy, and doesn't justify the jobs of several dozen engineers, a few managers and a director.

    If you're the director, which would you go for?

  • But that would that get VC funding? It's not their own money they are spending.