Comment by atleastoptimal
19 hours ago
>It needs to learn new information, create novel connections, be creative.
LLM's can do all those things
19 hours ago
>It needs to learn new information, create novel connections, be creative.
LLM's can do all those things
Nope. Can't learn anything after the training data, only within the very narrow context window.
Any novel connections are through randomness, hence hallucinations instead of useful connections with background knowledge of involved systems or concepts.
About creativity, see my previous point. If I spit out words that go next to eachother, it won't be creativity. Creativity implies a goal, a purpose, or sometimes by chance, but utilising systematic thinking with understanding of the world.