Comment by chrisjj
1 day ago
> LLMs are not simple things like a Markov model
"Large Language Models as Markov Chains" https://www.alphaxiv.org/pdf/2410.02724
1 day ago
> LLMs are not simple things like a Markov model
"Large Language Models as Markov Chains" https://www.alphaxiv.org/pdf/2410.02724
Argh, what I wrote was obviously wrong. What I meant was to refer to the simple n-state Markov models as used past decades.
Anything that's sequential, like language is, will exhibit Markovian properties, and be somewhat a "Markov" model.
Markov chains are a different concept than a Markov model, but I do agree that, technically, an LLM is a Markov model, just with an internal state space that is nothing like what is usually meant when ML people refer to Markov models.