Comment by bpodgursky
23 days ago
Strict deterministic output for a given prompt prevents the use of RAG, which increasingly limits the relative utility of a LLM within an organization.
23 days ago
Strict deterministic output for a given prompt prevents the use of RAG, which increasingly limits the relative utility of a LLM within an organization.
How so? RAG is just a mechanism for querying external data sources. I don't see any need for non-determinism there.