Comment by ragebol
2 years ago
Are there any efforts to combining a knowledge base like Cyc together with LLMs and the like? Something like RAG could benefit I suppose.
Have some vector for a concept match a KB entry etc, IDK :).
2 years ago
Are there any efforts to combining a knowledge base like Cyc together with LLMs and the like? Something like RAG could benefit I suppose.
Have some vector for a concept match a KB entry etc, IDK :).
This is a significant part of my vision for Web 10! https://www.lesswrong.com/posts/jRf4WENQnhssCb6mJ/davidad-s-...
Are there any efforts to combining a knowledge base like Cyc together with LLMs and the like?
Yes. It's something I've been working on, so there's at least 1 such effort. And I'm reasonably sure there are others. The idea is too obvious for there to not be other people pursuing it.
Too obvious indeed. Can I read anywhere about what you're working on? What other approaches exist?
> Can I read anywhere about what you're working on?
Not yet. It's still early days.
> What other approaches exist?
Loosely speaking, I'd say this entire discussion falls into the general rubric of what people are calling "neuro-symbolic AI". Now within that there are a lot of different ways to try and combine different modalities. There are things like DeepProbLog, LogicTensorNetworks, etc.
For anybody who wants to learn more, consider starting with:
https://en.wikipedia.org/wiki/Neuro-symbolic_AI
and the videos from the previous two "Neurosymbolic Summer School" events:
https://neurosymbolic.github.io/nsss2023/
https://www.neurosymbolic.org/summerschool.html (2022)