Comment by tehjoker

They moved away from raw text and are now working with verifiable synthetic data (eg math, games, code) to improve general reasoning.