Comment by onyx228

A randomly generated program from a space of programs defined by a set of generating actions.

A simple example is a programming language that can only operate on integers, do addition, subtraction, multiplication, and can check for equality. You can create an infinite amount of programs of this sort. Once generated, these programs are quickly evaluated within a split second. You can translate them all to English programmatically, ensuring grammatical and semantical correctness, by use of a generating rule set that translates the program to English. The LLM can provide its own evaluation of the output.

For example:

program:

1 + 2 * 3 == 7

evaluates to true in its machine-readable, non-LLM form.

LLM-readable english form:

Is one plus two times three equal to seven?

The LLM will evaluate this to either true or false. You compare with what classical execution provided.

Now take this principle, and create a much more complex system which can create more advanced interactions. You could talk about geometry, colors, logical sequences in stories, etc.