Comment by troupo

5 days ago

No, no they don't. Actual learning survives beyond "sufficient context window".

Start a new chat, and the "agentic" system will be as clueless as before

6 comments

troupo

Reply
reverius42  5 days ago

They can write to the filesystem, and future instances can read it (and write more). The agentic system does not remain as clueless as its LLM's first instantiation.

  • nullpoint420  5 days ago

    Do you need a notebook to remember who you are? The point is to update the model weights so it learns.

    • reverius42  4 days ago

      No, but I don't need floating point weights either. My evolved biological systems work very differently from artificial digital systems.

      My point is that it's not the "model" that is the thing that is demonstrating cognition here, it's the "system" that uses the model and stores information and can retrieve it later. To that system, these notes are more the equivalent of my memories than my notebooks.

      2 replies →