Markov chain matrix representation
Matrix representation of the Markov chain can be very powerful and easy to use
Note:
/ markov-chain-in-matrix-format
Some review material:
Markov chain:
• Markov basic theory
birth and death:
• Markov birth death process discrete & coun...
expected steps of absorption:
• Markov chain absorption rate, trail needed...
eigenvalue and eigen vector:
• Eigenvalues and eigenvectors of a matrix
Solving linear equations with matrix:
• Solve linear equations using linear algebra