Comment by Atotalnoob

3 days ago

LLMs CAN be deterministic. You can control the temperature to get the same output repeatedly.

Although I don’t really understand why you’d only want to store prompts…

What if that model is no longer available?

They’re typically not, since they typically rely on operators that aren’t (e.g. atomics).