Comment by cadamsdotcom

Yep. Deterministic shell around the powerful abilities of the model.

Define what a good job looks like, unskippable steps, etc etc - essentially what your process is for producing your desired output in a reproducible way.

Then codify it. Have the model write code and wrap the model in a harness that ensures said code runs when you need it to, every time.