← Back to context

Comment by ChrisGreenHeur

8 hours ago

That's not how it works. The text you see is primarily due to a massive amount of handwritten templates for how it should write. The semantic content the templates use is due to the training corpus. The syntax, only a bit.

But that syntax is followed by predicting the next token.

Even if it was instructed to write as if it were a robot -- it would ultimately be outputting what is statistically most likely for a human mimicking a robot, based on the training corpus.

It is all ultimately a statistical predictor of the input material.