Comment by fluoridation

>What's implied by that is humans needing to give the LLM explicit success criteria from the outset.

But the LLM is non-deterministic. LLM(x + y) or even LLM(LLM(x) + y) is just as non-deterministic as LLM(x).

>Well, no. Now you are waaaay overstating determinism. Deterministic results might be incorrect.

Obviously? But that's still is the reason why deterministic computers are useful. If you could enter a proven-correct program into a computer, run it, and get back a correct result only some of the time, that'd be okay maybe for some things, but we couldn't have built everything we have on top of that. It's the same reason why deductive reasoning is useful. Once you've proven something true, you're done, it's proven. No further work is necessary.