Comment by Dansvidania
1 day ago
That’s not learning. That’s carrying over context that you are trusting is correctly summarised over from one conversation to the next.
1 day ago
That’s not learning. That’s carrying over context that you are trusting is correctly summarised over from one conversation to the next.
Which sounds uncomfortably like human memory, which gets rewritten from one recollection to the next. Somehow, we cope.
I disagree. Human memory is literally changing the weights in your neural network. Like, exactly the same.
So in the machine learning world, it would need to be continuous re-training (I think its called fine-tuning now?). Context is not "like human memory". It's more like writing yourself a post-it note that you put in a binder and hand over to a new person to continue the task at a later date.
Its just words that you write to the next person that in LLM world happens to be a copy of the same you that started, no learning happens.
It might guide you, yes, but that's a different story.
Ever seen the movie Memento? That's LLM memory.