Comment by chrisjj
19 hours ago
> why do you find "next token predictor" to be the most useful mental model?
To me it is an accurate description of the algorithm. And a sufficient explanation for the behaviour. So I don't need it or anything else as a mental model.
I accept this does not suffice for people who cannot comprehend the huge amount of processing and data the empowers it. Lacking a factual understanding, they reach for any mental model as a kind of superstition.
It is sufficiently advanced technology which to many is indistinguishable from magic. This disguises its limitations and enables its limitless false promotion to the gullible, being the reason it is so dangerous to individuals and society.
I agree with this, but I just think that with two types of training LLMs are now a two-trick pony rather than a one-trick one.