Perturbed Markov chains

Journal of Applied Probability

Volumn 40, Issue 1, 2003, Pages 107-122

  Solan, Eilon ^a,b   Vieille, Nicolas ^c  

^a NORTHWESTERN UNIVERSITY   (United States)

^b TEL AVIV UNIVERSITY   (Israel)

^c HEC PARIS   (France)

Author keywords

Conductance; Exit distribution; Markov chains; Perturbation theory; Sensitivity analysis; Stability of a Markov chain; Stationary distribution

Indexed keywords

EID: 0037573243     PISSN: 00219002     EISSN: None     Source Type: Journal    
DOI: 10.1239/jap/1044476830     Document Type: Article

References (17)

1. CATONI, O. (1999). Simulated annealing algorithms and Markov chains with rare transitions. In Séminaire de Probabilités XXXIII (Lecture Notes in Math. 1709), eds M. Ledoux, M. Yor, J. Azéma and M. Emery, Springer, Berlin, pp. 69-119.
2. CHO, G. E. AND MEYER, C. D. (2000). Markov chain sensitivity measured by mean first passage times. Linear Algebra Appl. 316, 21-28.
3. FREIDLIN, M. AND WENTZELL, A. (1984). Random Perturbations of Dynamical Systems. Springer, Berlin.
4. HUNTER, J. J. (1986). Stationary distributions of perturbed Markov chains. Linear Algebra Appl. 82, 201-214.
5. JERRUM, M. AND SINCLAIR, A. (1989). Approximating the permanent. SIAM J. Comput. 18, 1149-1178.
6. KEMENY, J. G. AND SNELL, J. L. (1960). Finite Markov Chains. Van Nostrand, New York.
7. KIRKLAND, S. J., NEUMANN M. AND SHADER, B. L. (1998). Application of Paz's inequality to perturbation bounds for Markov chains. Linear Algebra Appl. 268, 183-196.
8. LASSERRE, J. B. (1994). Formula for singular perturbations of Markov chains. J. Appl. Prob. 31, 829-833.
9. LOVASZ, L. AND KANNAN, R. (1999). Faster mixing via average conductance. In Annual ACM Symp. Theory Comput. (Atlanta, GA), ACM, New York, pp. 282-287.
10. LOVASZ, L. AND SIMONOVITS, M. (1990). The mixing rate of Markov chains, an isoperimetric inequality, and computing the volume. In 31st Annual Symp. Foundations Comput. Sci. (St. Louis, MO), Vol. I, II, IEEE Compututer Society Press, Los Alamitos, CA, pp. 346-354.
11. MEYER, C. D. (1975). The role of the group generalized inverse in the theory of Markov chains. SIAM Rev. 17, 443-464.
12. O'CINNEIDE, C. A. (1993). Entrywise perturbation theory and error analysis for Markov chains. Numerische Math. 65, 109-120.
13. SCHWEIZER, P. J. (1968). Perturbation theory and finite Markov chains. J. Appl. Prob. 5, 401-413.
14. SENETA, E. (1988) Perturbation of the stationary distribution measured by ergodicity coefficients. Adv. Appl. Prob. 20, 228-230.
15. SENETA, E. (1993). Sensitivity of finite Markov chains under perturbations. Statist. Prob. Lett. 17, 163-168.
16. SOLAN, E. AND VIEILLE, N. (2002). Correlated equilibrium in stochastic games. Games Econom. Behavior 38, 362-399.
17. VIEILLE, N. (2000). Small perturbations and stochastic games. Israel J. Math. 119, 127-142.