← Back to context

Comment by c7b

2 days ago

For those commenting on the long reasoning, it may be interesting to know that the reasoning effort is set to xhigh by default [0]. Other possible values are medium, low and none. Flag for changing it in llama.cpp below, but note that the long reasoning seems to contribute a great deal to the quality.

  --chat-template-kwargs '{"preserve_thinking":true,"reasoning_effort":"medium"}'

[0] https://unsloth.ai/docs/models/qwen3.8#thinking--preserve-th...