← Back to context Comment by JLCarveth 10 days ago I ran into the same looping issue with that model. 1 comment JLCarveth Reply danielhanchen 10 days ago Definitely givetemperature = 1.0, top_k = 64, top_p = 0.95, min_p = 0.0a try, and maybe repeat_penalty = 1.1
danielhanchen 10 days ago Definitely givetemperature = 1.0, top_k = 64, top_p = 0.95, min_p = 0.0a try, and maybe repeat_penalty = 1.1
Definitely give
temperature = 1.0, top_k = 64, top_p = 0.95, min_p = 0.0
a try, and maybe repeat_penalty = 1.1