Comment by _heimdall
3 days ago
Guardrails are about as good as you can get when creating nondeterministic software, putting it on the internet, and abandoning effectively every important alignment and safety concerns.
The guardrails make help make sure that most of the time the LLM acts in a way that users won't complain about or walk away from, nothing more.
LLMs are not nondeterministic. They are infinite state machines that don't 'act' but respond. Be aware of the well hidden seed parameter.
Can you help me understand how they are deterministic?
There are seed parameters for the various pseudorandom factors used during training and inference, but we can't predict what an output will be. We don't know how to read or interpret the models and we don't have any useful way of knowing what happens during inference, we can't determine what will happen.