Comment by lostmsu
2 days ago
> But raising kids, I can clearly see that intelligence isn't just solved by LLMs
Funny, I have the opposite experience. Like early LLMs kids tend to give specific answers to the questions they don't understand or don't really know or remember the answer to. Kids also loop (give the same reply repeatedly to different prompts), enter highly emotional states where their output is garbled (everyone loves that one), etc. And it seems impossible to correct these until they just get smarter as their brain grows.
What's even more funny is that adults tend to do all these things as well, just less often.
Same failure modes, but not a general solution to intelligence.
What makes you think so?
The lack of results so far. The observable behavior exhibits many uncanny similarities but also clearly has missing pieces.
As the person you initially responded to said, observing children growing up should make it obvious.
Or if we shift to stating the obvious, there's the minor detail that the vast majority of architectures lack the ability to learn during inference. That's one of the basic things that biological systems are capable of.