Comment by thymine_dimer

Is 'contextualised pretraining' a solution to baking in human alignment?

You can only post-train so much... Try telling a child that martial arts isn't the solution to everything right after they've watched karate kid. A weak analogy, but it seems very clear that the healthy psychological development of frontier models is something necessary to solve.

Some good insights could come from those working at the coalface of child-psychology.