Comment by emrah

I think he is saying we should be making fine-tuning or otherwise similar model altering methods easier rather than messing with bolt-on solutions like RAG

Those are being worked on and RAG is the ducktape solution until they become available