Comment by btrlsnqtn
5 hours ago
The article mentions the bitter lesson. I'm confused about the status of Sutton's opinion of the bitter lesson. On the one hand, he invented the concept. On the other hand, he appears to be saying that LLMs are not the correct approach to artificial intelligence, which to a naive outsider looks like a contradiction. What gives?
Maybe he means that LLM will hit a ceiling glass or that the "right" approach will give equivalent with less training/less intensive compute requirements ?