Comment by liuliu 8 days ago Note that 3.5 9B cannot do thinking (while 3.6 27B can, pretty effectively, quite verbosely). 3 comments liuliu Reply gunalx 8 days ago 3.5 9B can do thinking. Its just disabled by default in its gguf chat template. liuliu 8 days ago It is disabled because it doesn't work :) Try it and see the doom loop it gets itself in. b89kim 8 days ago I had no failure mode in 3.6 9B thinking with llama.cpp. After release, there were updates for both model and llama.cpp.
gunalx 8 days ago 3.5 9B can do thinking. Its just disabled by default in its gguf chat template. liuliu 8 days ago It is disabled because it doesn't work :) Try it and see the doom loop it gets itself in. b89kim 8 days ago I had no failure mode in 3.6 9B thinking with llama.cpp. After release, there were updates for both model and llama.cpp.
liuliu 8 days ago It is disabled because it doesn't work :) Try it and see the doom loop it gets itself in. b89kim 8 days ago I had no failure mode in 3.6 9B thinking with llama.cpp. After release, there were updates for both model and llama.cpp.
b89kim 8 days ago I had no failure mode in 3.6 9B thinking with llama.cpp. After release, there were updates for both model and llama.cpp.
3.5 9B can do thinking. Its just disabled by default in its gguf chat template.
It is disabled because it doesn't work :) Try it and see the doom loop it gets itself in.
I had no failure mode in 3.6 9B thinking with llama.cpp. After release, there were updates for both model and llama.cpp.