Comment by Philpax

That's not necessarily incompatible. The raw output could come from RL rollouts where the model learnt from the process of solving these problems.