Comment by sean_pedersen
4 days ago
Ok what about memory systems though (basically LLM modifies its own RAG context) - that should allow commits and changing dispositions over time?
4 days ago
Ok what about memory systems though (basically LLM modifies its own RAG context) - that should allow commits and changing dispositions over time?
RAG context memory and modifying the weights are two different things. As far as I know, models can't modify their weights reliably.
Humans change over time due to what they experience. It’s different from waking up from a ten-year coma and having access to a record of what happened to yourself in an alternative timeline where you didn’t fall into the coma.
AI systems have Reinforcement Learning