Comment by ryandrake

1 day ago

If you want to have some fun, experiment with this: add a step (maybe between 3 and 4):

3.5 Prove

Have the LLM demonstrate, through our current documentation and other sources of facts, that the planned action WILL work correctly, without failure. Ask it to enumerate all risks and point out how the plan mitigates each risk. I've seen on several occasions, the LLM backtrack at this step and actually come up with clever so-far unforeseen error cases.