← Back to context

Comment by saalweachter

2 days ago

So I worked on a comparison shopping website.

We crawled the Internet, identified stores, found item listings, extracted prices and product details, consolidated results for the same item together, and made the whole thing searchable.

And this was the pre-LLM days, so that was all a lot of work, and not "hey magic oracle, please use an amount of compute previously reserved for cancer research to find these fields in this HTML and put them in this JSON format".

We never really found a user base, and neither did most of our competitors (one or two of them lasted longer, but I'm not sure any survived to this day). Users basically always just went to Google or Amazon and searched there instead.

However, shortly after we ran out of money and laid off most of the company, one of our engineers mastered the basics of SEO, and we discovered that users would click through Google to our site to an item listing, then through to make a purchase at a merchant site, and we became profitable.

I suppose we were providing some value in the exchange, since the users were visiting our item listings which displayed the prices from all the various stores selling the item, and not just a naked redirect to Amazon or whatever, but we never turned any significant number of these click-throughs into actual users, and boy howdy was that demoralizing as the person working on the search functionality.

Our shareholders had mostly written us off by that point, since comparison shopping had proven itself to not be the explosive growth area they'd hoped it was when investing, but they did get their money back through a modest sale a few years later.