Comment by nullpoint420
4 days ago
Do you need a notebook to remember who you are? The point is to update the model weights so it learns.
4 days ago
Do you need a notebook to remember who you are? The point is to update the model weights so it learns.
No, but I don't need floating point weights either. My evolved biological systems work very differently from artificial digital systems.
My point is that it's not the "model" that is the thing that is demonstrating cognition here, it's the "system" that uses the model and stores information and can retrieve it later. To that system, these notes are more the equivalent of my memories than my notebooks.
These are not "memories", as with every new session these are entirely new, never-before seen files that the "system" may or may not use.
And it is not "learning" (which was the initial claim) as the system never learns beyond what was already there in the training data, and any new information you supply are new data, from scratch, that is immediately forgotten once the session is over.
It's easy to prove: start a new session in your project and ask "what is this project about". Two days from now, in a new session, ask the same thing. Observe how in both cases it re-reads the files, greps source code etc. Meanwhile a system with actual memories and learning wouldn't have to do that.
[flagged]