Comment by c7b
2 days ago
For those commenting on the long reasoning, it may be interesting to know that the reasoning effort is set to xhigh by default [0]. Other possible values are medium, low and none. Flag for changing it in llama.cpp below, but note that the long reasoning seems to contribute a great deal to the quality.
--chat-template-kwargs '{"preserve_thinking":true,"reasoning_effort":"medium"}'
[0] https://unsloth.ai/docs/models/qwen3.8#thinking--preserve-th...
No comments yet
Contribute on Hacker News ↗