Comment by sdwr
14 days ago
That's not true, symbols emerge out of the statistics. Just look at the imagenet analysis that identified distinct concepts in different layers, or the experiments with ablation in LLMs.
They may not be doing strict formal logic, but they are definitely compressing information into, and operating using, symbols.
Which argues much symbolic manipulation is formulaic, and not inductive reasoning or indicative of intelligence.
Sentence parsing with multiple potential verb-noun-adjective interpretations are an example of old, Chomsky made fruit flies like a banana famous for a reason.
(without the weights and that specific sentence programmed in, I would be interested exactly how the symbol models cope with that, and the myriad other examples)