Comment by brookst
1 day ago
Here’s some of those sources that were apparently hard to find:
https://openai.com/index/openai-o1-system-card/
https://arxiv.org/html/2410.10630v1
https://magazine.sebastianraschka.com/p/understanding-reason...
1 day ago
Here’s some of those sources that were apparently hard to find:
https://openai.com/index/openai-o1-system-card/
https://arxiv.org/html/2410.10630v1
https://magazine.sebastianraschka.com/p/understanding-reason...
Reasoning models are mostly regular LLMs trained to output a "<thinking></thinking>" token delimiter before the answer that will be shown to the user, and that's a clever use of the Chain of Thought idea. All of which I'm completely familiar with.
GP was saying
> That would be true of non-iterative models that just emit an output from beginning to end.
Which suggests that there are
- "iterative" models
which
- do not output "from beginning to end"
which AFAIK is science-fiction.
Diffusion language models aren't GPT-5.6 level, but they're not science fiction either.
Thank you ; I had completely forgotten about those. I stand corrected.