Stability and exponential convergence of continuous-time Markov chains

Journal of Applied Probability

Volumn 40, Issue 4, 2003, Pages 970-979

  Mitrophanov, A Yu ^a  

^a SARATOV STATE UNIVERSITY   (Russian Federation)

Author keywords

Eigenvalue; Ergodicity coefficient; Exponential convergence; Markov chain; Perturbation bounds; Sensitivity analysis; Spectral gap

Indexed keywords

EID: 0442307357     PISSN: 00219002     EISSN: None     Source Type: Journal    
DOI: 10.1239/jap/1067436094     Document Type: Article

References (22)

1. ANDREEV, D. B. et al. (2002). On ergodicity and stability estimates for some nonhomogeneous Markov chains. J. Math. Sci. (New York) 112, 4111-4118.
2. ARAKELIAN, V. B., WILD, J. R. AND SIMONIAN, A. L. (1998). Investigation of stochastic fluctuations in the signal formation of microbiosensors. Biosensors Bioelectron. 13, 55-59.
3. BALL, F. G., MILNE, R. K. AND YEO, G. F. (2000). Stochastic models for systems of interacting ion channels. IMA J. Math. Appl. Med. Biol. 17, 263-293.
4. DIACONIS, P. AND SALOFF-COSTE, L. (1996). Logarithmic Sobolev inequalities for finite Markov chains. Ann. Appl. Prob. 6, 695-750.
5. DIACONIS, P. AND SALOFF-COSTE, L. (1996). Nash inequalities for finite Markov chains. J. Theoret. Prob. 9, 459-510.
6. DIACONIS, P. AND STROOK, D. (1991). Geometric bounds for eigenvalues of Markov chains. Ann. Appl. Prob. 1, 36-61.
7. FILL, J. A. (1991). Eigenvalue bounds on convergence to stationarity for nonreversible Markov chains, with an application to the exclusion process. Ann. Appl. Prob. 1, 62-87.
8. GRANOVSKY, B. L. AND ZEIFMAN, A. I. (1997). The decay function of nonhomogeneous birth-death processes, with application to mean-field models. Stock. Process. Appl. 72, 105-120.
9. GRANOVSKY, B. L. AND ZEIFMAN, A. I. (2000). Nonstationary Markovian queues. J. Math. Sci. (New York) 99, 1415-1438.
10. GRANOVSKY, B. L. AND ZEIFMAN, A. I. (2000). The N-limit of spectral gap of a class of birth-death Markov chains. Appl. Stoch. Models Business Industry 16, 235-248.
11. HORN, R. A. AND JOHNSON, C. R. (1985). Matrix Analysis. Cambridge University Press.
12. KARTASHOV, N. V. (1986). Inequalities in theorems of ergodicity and stability for Markov chains with common state space. I. Theory Prob. Appl. 30, 247-259.
13. KARTASHOV, N. V. (1986). Inequalities in theorems of ergodicity and stability for Markov chains with common state space. II. Theory Prob. Appl. 30, 507-515.
14. PENG, N. F. (1996). Spectral representations of the transition probability matrices for continuous time finite Markov chains. J. Appl. Prob. 33, 28-33.
15. SENETA, E. (1979). Coefficients of ergodicity: structure and applications. Adv. Appl. Prob. 11, 576-590.
16. THOUMINE, O. AND MEISTER, J.-J. (2000). A probabilistic model for ligand-cytoskeleton transmembrane adhesion: predicting the behaviour of microspheres on the surface of migrating cells. J. Theoret. Biol. 204, 381-392.
17. VAN KAMPEN, N. G. (1981). Stochastic Processes in Physics and Chemistry. North Holland, Amsterdam.
18. ZEIFMAN, A. I. (1985). Stability for continuous-time nonhomogeneous Markov chains. In Stability Problems for Stochastic Models (Lecture Notes Math. 1155), eds V. V. Kalashnikov and V. M. Zolotarev, Springer, Berlin, pp. 401-414.
19. ZEIFMAN, A. I. (1995). Upper and lower bounds on the rate of convergence for nonhomogeneous birth and death processes. Stoch. Process. Appl. 59, 157-173.
20. ZEIFMAN, A. I. (1998). Stability of birth-and-death processes. J. Math. Sci. (New York) 91, 3023-3031.
21. ZEIFMAN, A. I. AND ISAACSON, D. L. (1994). On strong ergodicity for nonhomogeneous continuous-time Markov chains. Stoch. Process. Appl. 50, 263-273.
22. ZHENG, Q. (1998). Note on the non-homogeneous Prendiville process. Math. Biosci. 148, 1-5.