Comment by andrekandre
6 days ago
supposedly you can turn it off by passing `\no_think` or `/no_think` into the prompt but it never worked for me
what did work was passing / adding this json to the request body:
{ "chat_template_kwargs": {"enable_thinking": false}}
No comments yet
Contribute on Hacker News ↗