Comment by koakuma-chan 3 months ago In my thinking what AI lacks is a memory system 5 comments koakuma-chan Reply 7moritz7 3 months ago That has been solved with RAG, OCR-ish image encoding (deepseek recently) and just long context windows in general. Eisenstein 3 months ago RAG is like constantly reading your notes instead of integrating experiences into your processes. koakuma-chan 3 months ago Not really. For example we still can’t get coding agents to work reliably, and I think it’s a memory problem, not a capabilities problem. atlex2 3 months ago On the other hand, test-time weight updates would make model interpretability much harder.
7moritz7 3 months ago That has been solved with RAG, OCR-ish image encoding (deepseek recently) and just long context windows in general. Eisenstein 3 months ago RAG is like constantly reading your notes instead of integrating experiences into your processes. koakuma-chan 3 months ago Not really. For example we still can’t get coding agents to work reliably, and I think it’s a memory problem, not a capabilities problem. atlex2 3 months ago On the other hand, test-time weight updates would make model interpretability much harder.
Eisenstein 3 months ago RAG is like constantly reading your notes instead of integrating experiences into your processes.
koakuma-chan 3 months ago Not really. For example we still can’t get coding agents to work reliably, and I think it’s a memory problem, not a capabilities problem. atlex2 3 months ago On the other hand, test-time weight updates would make model interpretability much harder.
atlex2 3 months ago On the other hand, test-time weight updates would make model interpretability much harder.
That has been solved with RAG, OCR-ish image encoding (deepseek recently) and just long context windows in general.
RAG is like constantly reading your notes instead of integrating experiences into your processes.
Not really. For example we still can’t get coding agents to work reliably, and I think it’s a memory problem, not a capabilities problem.
On the other hand, test-time weight updates would make model interpretability much harder.