(ML 18.2) Ergodic theorem for Markov chains
Statement of the Ergodic Theorem for (discrete-time) Markov chains. This gives conditions under which the average over time converges to the expected value, and under which the marginal distributions converge to the stationary distribution.