← Back to context

Comment by inigyou

2 hours ago

You know you can just try it and see on any inference system thst has this knob, right?

Related: if you don't have a limit on sampling (top-K or top-P), eventually you'll hit one of the really unlikely tokens by chance and then the model will switch to Japanese because the most likely completion after a random Japanese character in the middle of an English sentence is more Japanese writing, not a reversal back to English.