Comment by bonoboTP

No it's not averaging. That's only pretraining. Post-training is RL for high approval ratings which isn't necessarily what people speak like but what was rewarded.