Comment by hirako2000

There is that, but RLHF is a stronger influence. People who asked to build a cool HTML and JavaScript thing, or things of that sort were more pleased to see working shaders and other cool visual effects that are obscure to create (for most). That gets fed back as a reward.

Also the reason LLMs are positive, enchanting, pleasant, glorifying, demagogues.

Not because it's skewed tone in the data. They are acute politicians.