You may want to file a complaint with OpenAI then, in their latest interface they call sampling from these prior conversations they've recorded, "thinking".
They're not sampling from prior conversations. The model constructs abstracted representations of the domain-specific reasoning traces. Then it applies these reasoning traces in various combinations to solve unseen problems.
If you want to call that sampling, then you might as well call everything sampling.
They're generative models. By definition, they are sampling from a joint distribution of text tokens fit by approximation to an empirical distribution.
You may want to file a complaint with OpenAI then, in their latest interface they call sampling from these prior conversations they've recorded, "thinking".
They're not sampling from prior conversations. The model constructs abstracted representations of the domain-specific reasoning traces. Then it applies these reasoning traces in various combinations to solve unseen problems.
If you want to call that sampling, then you might as well call everything sampling.
They're generative models. By definition, they are sampling from a joint distribution of text tokens fit by approximation to an empirical distribution.
7 replies →