Comment by TZubiri
17 hours ago
I think this doesn't apply if you reduce temperature to 0. Which you should always do, temperature is like a tax users pay to help the LLM providers explore the output space, just don't pay that tax and always choose the best token.
No comments yet
Contribute on Hacker News ↗