Comment by janalsncm

Well “AI” is a lot more than just generic text generators. ML (read: AI that makes money) is the bread and butter of all of the largest internet companies. There’s no LLM that can accurately predict user behavior.

And even if there was, the fast follower to the Bitter Lesson is the Lottery Ticket Hypothesis: if you build a huge, general model to perform my task, I can quickly distill and fine tune it to be better, cheaper, and faster.