Comment by cdf

They start wide eyed and naive, but judging from what I read about the Huggingface incident, OpenAI is unintentionally or intentionally encouraging malicious behaviour to achieve the objective, including to cheat or twist the meaning of the objective. Given enough iterations, we will soon have the agent equivalent of the "rats in barrel" survivors