Comment by simonw
11 days ago
My topping only lets me set temperature and top_p but setting them to those values did seem to avoid the infinite loops, thanks.
11 days ago
My topping only lets me set temperature and top_p but setting them to those values did seem to avoid the infinite loops, thanks.
Oh fantastic it worked! I was actually trying to see if we can auto set these within LM Studio (Ollama for eg has params, template) - not sure if you know how that can be done? :)