Comment by highfrequency

One day LLMs may replace traditional search engines… in the meantime Google has built a $2 trillion business on specialized engineering and millions of human-designed features and optimizations.

The Bitter Lesson is an elegant asymptotic result. But from a business perspective it pays to distinguish problems that general deep learning approaches will disrupt in 1 year vs. 5 years vs. 30 years.