On the stability of the computation of the stationary probabilities of Markov chains using Perron complements

Numerical Linear Algebra with Applications

Volumn 10, Issue 7, 2003, Pages 603-618

  Neumann, Michael ^a   Xu, Jianhong ^b  

^a UNIVERSITY OF CONNECTICUT   (United States)

^b UNIVERSITY OF WEST FLORIDA   (United States)

Author keywords

Condition numbers; Group inverses; Perron complements; Stochastic matrices

Indexed keywords

EID: 0242319484     PISSN: 10705325     EISSN: None     Source Type: Journal    
DOI: 10.1002/nla.339     Document Type: Article

References (25)

1. Kemeny JG, Snell JL. Finite Markov Chains. Van Nostrand: New York, 1960.
2. Meyer CD, Jr. The role of the group generalized inverse in the theory of finite Markov chains. SIAM Review 1975; 17:443-464.
3. Ben-Israel A, Greville TN. Generalized Inverses: Theory and Applications. Academic Press: New York, 1973.
4. Campbell SL, Meyer CD, Jr. Generalized Inverses of Linear Transformations. Dover: New York, 1991.
5. Meyer CD. Uncoupling the Perron eigenvector problem. Linear Algebra and Its Applications 1989; 114/115:69-94.
6. Meyer CD. Stochastic complementation, uncoupling Markov chains, and the theory of nearly reducible systems. SIAM Review 1989; 31:240-272.
7. Courtois PJ, Semal P. Block iterative algorithms for stochastic matrices. Linear Algebra and Its Applications 1986; 76:59-70.
8. Marek I, Mayer P. Convergence theory of some classes of iterative aggregation/disaggregation methods for computing stationary probability vectors of stochastic matrices. Linear Algebra and Its Applications 2003; 363:177-200.
9. Kirkland SJ, Neumann M, Xu J. A divide and conquer approach to computing the mean first passage matrix for markov chains via Perron complement reductions. Numerical Linear Algebra with Applications 2001; 8:287-295.
10. Fallat S, Neumann M. On Perron complements of totally nonnegative matrices. Linear Algebra and Its Applications 2001; 327:85-94.
11. Meyer CD, Jr. The condition of a finite Markov chain and perturbations bounds for the limiting probabilities. SIAM Journal on Algebraic and Discrete Methods 1980; 1:273-283.
12. Bauer FL, Deutsch E, Stoer J. Abschätzungen für die Eigenwerte positive linearer Operatoren. Linear Algebra and Its Applications 1969; 2:275-301.
13. Deutsch E, Zenger C. Inclusion domains for eigenvalues of stochastic matrices. Numerische Mathematik 1971; 18:182-192.
14. Seneta E. Non-negative Matrices and Markov Chains (2nd edn). Springer: New York, 1981.
15. Hunter JJ. Characterizations of generalized inverses associated with Markovian kernels. Linear Algebra and Its Applications 1988; 102:121-142.
16. Cho GE, Meyer CD. Comparison of perturbation bounds for the stationary distribution of a Markov chain. Linear Algebra and Its Applications 2001; 335:137-150.
17. Seneta E. Perturbation of the stationary distribution measured by ergodicity coefficients. Advances Applied Probability 1988; 20:228-230.
18. Seneta E. Sensitivity analysis, ergodicity coefficients, and rank-one updates for finite Markov chains. In Numerical Solution of Markov Chains, Stewart WJ (ed.). Marcel Dekker: New York, 1991; 121-129.
19. Cho GE, Meyer CD. Markov chain sensitivity measured by mean first passage times. Linear Algebra and Its Applications 2000; 316:21-28.
20. Metzler LA. A multiple-county theory of income transfers. Journal of Political Economics 1945; 59:14-29.
21. Metzler LA. Taxes and subsidies in Leontif's input-output model. The Quarterly Journal of Economics 1951; 65:433-438.
22. Meyer CD, Jr. Sensitivity of the stationary distribution of a Markov chain. SIAM Journal on Matrix Analysis and Applications 1994; 15:715-728.
23. Xue J, Jiang E. Entrywise relative perturbation theory for nonsingular M-matrices. BIT, 1995; 417-427.
24. Funderlic R, Meyer CD. Sensitivity of the stationary distribution vector for an ergodic Markov chain. Linear Algebra and Its Applications 1986; 76:1-17.
25. Ipsen I, Meyer CD, Jr. Uniform stability for Markov chains. SIAM Journal on Matrix Analysis and Applications 1994; 15:1061-1074.