Comment by danielbln

It's also subject to significantly more hallucination when the knowledge is baked into the model, vs being injected into the context at runtime.