Comment by anon373839
1 day ago
This, 100%. I don’t think the industry knows how to scale LLMs’ general intelligence much further. The training paradigm is about maximizing very specific behaviors / very specific tasks, but doing lots and lots of them. Which can create the illusion of general intelligence if your tasks are similar to the ones the models were fitted for.
If you have watched The Substance, the transformation feels a bit like when things start falling apart in that one.
I tend to agree. We will see this demonstrated in novel research done by agents, or, more meta-cognitively research direction guidance.-