SERIES EXPANSIONS FOR FINITE-STATE MARKOV CHAINS

Abstract
This article provides series expansions of the stationary distribution of a finite Markov chain. This leads to an efficient numerical algorithm for computing the stationary distribution of a finite Markov chain. Numerical examples are given to illustrate the performance of the algorithm.