Comment by BlueTemplar

While you can represent the probabilities as a table, IMHO the graph representation is MUCH better :

https://en.wikipedia.org/wiki/Markov_chain#/media/File:Marko...