Comment by revetkn
2 days ago
It's understood that LLMs have limitations and people are working on "the next thing" to try and make it to real AGI, e.g. Yann LeCun.
2 days ago
It's understood that LLMs have limitations and people are working on "the next thing" to try and make it to real AGI, e.g. Yann LeCun.
Many people have tried before, but the bitter lesson has come for them all.
This is not what the bitter lesson is about. It's not "don't develop better methods, just scale", it's that those methods which scale best win. LeCun's work is fundamentally about devising a method that scales better with data than LLMs. Agree with him or not about the feasibility of it, but this is fundamentally still a bitter lesson-pilled mindset.