Comment by irthomasthomas

You can retrieve the hidden reasoning with another API call. There was a recent paper about it. They found examples where claude had been trained on the benchmark and memorized the answers, then hid this from the user, pretending it derived the answer honestly in the final answer.