Comment by Avicebron

RAG context memory and modifying the weights are two different things. As far as I know, models can't modify their weights reliably.