Comment by pgraf

This problem really bothers me as well. I think that ultimately this problem boils down to reducing search cost[0], which the internet has already partially done. I think AI will reduce them further if it is not captured by the advertisement industry for the average user. However, we cannot assume a fully rational customer in the real world. Especially in software, the customer does not know what they are looking for most of the time. Further they cannot evaluate how good your offering is vs competitors without investing a significant amount of time, which in turn increases search cost.

[0] https://en.wikipedia.org/wiki/Search_cost