Comment by ratorx

The analogy doesn’t hold. If the entire representation of the “code” is the natural language description, then the ambiguity in the specification will lead to incompatibility in the output between executions. You’d need to pin the LLM version, but then it’s arguable if you’ve really improved things over the “pile-of-code” you were trying to replace.

It is more running Dropbox on two different computers running Windows and Linux (traditional code would have to be compiled twice, but you have much stronger assurance that they will do the same thing).

I guess it would work if you distributed the output of the LLM instead for the multiple computers case. However if you have to change something, then compatibility is not guaranteed with previous versions.