Comment by ac1spkrbox
7 months ago
The set of techniques for retrieval is immature, but it's important to note that just relying on model context or few-shot prompting has many drawbacks. Perhaps the most important is that retrieval as a task should not rely on generative outputs.
It's also subject to significantly more hallucination when the knowledge is baked into the model, vs being injected into the context at runtime.