Comment by laborcontract

You do you, and if it works i’m not going to argue with your results, but for others, finetuning is the wrong tool for knowledge injection over a well-designed RAG pipeline.

Finetuning is good for, like you said, doing things a particular way but that’s not the same thing as being good at knowledge injection and shouldn’t considered as such.

It’s also much easier to prevent a RAG pipeline from generating hallucinated responses. You cannot finetune that out of a model.