Comment by atomicnumber3
10 days ago
Except we know how these work. There's no number sense. It's predicting tokens. It is able to recount the mathematical foundations because in its training dataset, that often happens, both in instructional material and in proofs.
I picked two random numbers between one and one million. The chances of it having seen that specific problem in its training set seem very low.