Comment by fipar
20 hours ago
Not the model though. The model really only takes input text and produces output text. Memory within a conversation is achieved by the harness adding the conversation (or parts of it) to the input text. The LLM itself has no memory, it’s the augmented system of several orchestrated LLM calls that does.
Wait until you hear about the hippocampus!!! [1]
I don't think physical integration within one contained is relevant to system level behavior.
[1] https://en.wikipedia.org/wiki/Neuroanatomy_of_memory
I had heard (o rather, read) about the hippocampus before, but I don’t understand how that relates to my claim that the models have no memory.
> The LLM itself has no memory, it’s the augmented system of several orchestrated LLM calls that does
Your own long term memory is the orchestration of systems that make it long term.
1 reply →