← Back to context

Comment by 4gotunameagain

16 hours ago

Nope. Can't learn anything after the training data, only within the very narrow context window.

Any novel connections are through randomness, hence hallucinations instead of useful connections with background knowledge of involved systems or concepts.

About creativity, see my previous point. If I spit out words that go next to eachother, it won't be creativity. Creativity implies a goal, a purpose, or sometimes by chance, but utilising systematic thinking with understanding of the world.