Comment by scarmig
2 months ago
LLMs have basic reasoning and a whole lot of memorization. Through that basic reasoning and pruned search, combined with piles of compute, you can prove lots of things. But the memorization of human failure prunes that possibility, and you need to expend effort convincing the LLM not to prematurely prune based on previous human failure.
The current foundational models have basic reasoning with glimpses of brilliant reasoning.
LLMs have almost no fluid intelligence or capacity for abstract inductive reasoning, relying on crystallized intelligence for basically everything.
If anything their capability of abstract inductive reasoning is way beyond the average human given how much better LLMs are at solving math problems, it's the paradox that they can do complicated reasoning before they can do intuitive peep-pe-boo.
1 reply →
I think they have some fluid intelligence, if somewhat brittle