Comment by YeGoblynQueenne
2 days ago
>> So any exclamation of "it was just using common sense", is missing the forrest for the trees.
I don't know why you say this, I didn't say anything about common sense.
However, you mention CYC. That's a system that is perfectly capable of common sense reasoning and very much like an LLM in many ways. And that should be no surprise: LLMs are giant Expert Systems trained on a human knowledge-base, i.e. the web. OpenAI basically managed to achieve what Doug Lenat was trying to achieve except they did it with machine learning over massive data and compute instead of painstaking manual coding, but it's the same kind of system in the end.
That claim really needs either an argument by mechanism, or a demonstration by capability. Neither exist.
Neural fuzzy systems can represent complex superpositions succinctly, knowledge graphs are collapsed and crisp.
It's like saying the tree unfolding of a graph is the same as that graph. Sure in the limit at infinite space requirements.
Sorry, I don't understand what you mean. Unfortunately it's not easy to try the current version of Cyc and there's not a lot of information about it easily accessible either.
You can also consider Watson, different to Cyc in that its knowledge base was built with a lot of machine learning, including some neural nets. It wasn't an LLM but the original version (before corporate went at it and destroyed it) was perfectly capable of interacting in an open-ended manner, notably winning at Jeopardy years before BERT was a glimmer in Jacob Devlin's eye.
I note again that you were the one who brought common sense reasoning in the conversation but there's a large literature on rule-based systems that do that based e.g. on non-monotonic logics. You should familiarise yourself with that literature before engaging in dares with strangers on the internets.