Comment by softwaredoug

Or defensively expect models to be stupid.

Seems the smart thing to do is not assume an agent will do the right thing. But to create the scaffold / harness that enforces constraints to steer them towards a good result.

Then you can swap out the really smart model for maybe something cheaper.