Comment by Havoc
4 days ago
You can actually force things like respond with true or false reliably via gbnf. But yeah within those two choices it is still nondeterministic
> exact same output for the exact same input?
If you set temp to zero it gets close but as I understand it not perfect
No comments yet
Contribute on Hacker News ↗