Comment by mkatx
8 hours ago
I would say, try without thinking on. I find reasoning on any rag type request seems to increase hallucinations, probably due to the thinking tokens taking attention away from the, in this case, vision tokens.
I'd recommend non-thinking for any non-prompt input, and leave the thinking where it has to actually reason.
No comments yet
Contribute on Hacker News ↗