Comment by conformist

It isn’t really controversial, of course, but it’s interestingly subtly sycophantic and self-promoting? You can see why RLHF might lead to such answers.