← Back to context Comment by danielhanchen 11 days ago Oh :( Maybe the settings? Could you trytemperature = 1.0, top_k = 64, top_p = 0.95, min_p = 0.0 4 comments danielhanchen Reply canyon289 11 days ago Daniel, thanks for being here providing technical support as well. Cannot express enough how much we appreciate your all work and partnership. danielhanchen 10 days ago Thank you and fantastic work with Gemma models! simonw 10 days ago My topping only lets me set temperature and top_p but setting them to those values did seem to avoid the infinite loops, thanks. danielhanchen 10 days ago Oh fantastic it worked! I was actually trying to see if we can auto set these within LM Studio (Ollama for eg has params, template) - not sure if you know how that can be done? :)
canyon289 11 days ago Daniel, thanks for being here providing technical support as well. Cannot express enough how much we appreciate your all work and partnership. danielhanchen 10 days ago Thank you and fantastic work with Gemma models!
simonw 10 days ago My topping only lets me set temperature and top_p but setting them to those values did seem to avoid the infinite loops, thanks. danielhanchen 10 days ago Oh fantastic it worked! I was actually trying to see if we can auto set these within LM Studio (Ollama for eg has params, template) - not sure if you know how that can be done? :)
danielhanchen 10 days ago Oh fantastic it worked! I was actually trying to see if we can auto set these within LM Studio (Ollama for eg has params, template) - not sure if you know how that can be done? :)
Daniel, thanks for being here providing technical support as well. Cannot express enough how much we appreciate your all work and partnership.
Thank you and fantastic work with Gemma models!
My topping only lets me set temperature and top_p but setting them to those values did seem to avoid the infinite loops, thanks.
Oh fantastic it worked! I was actually trying to see if we can auto set these within LM Studio (Ollama for eg has params, template) - not sure if you know how that can be done? :)