I like to view Markov chain as simply state transition model. Let’s consider finite number of states to make thing simple. Time homogeneous: simply mean that the state transition matrix does not change over time Irreducible: I hate this term as I tend to forget what it really means. Model is irreducible if one can…
Markov chain terminology
Posted on