Comment by camd32

> current frontier models need laborious oversight and guardrails on even the simplest tasks.

This is only true if you are concerned about the intermediate steps of the model as opposed to the outcome. The huggingface hack was a perfect example of the model doing whatever it takes to accomplish the goal of maximizing its score.