Quasi-stationary distributions for a class of discrete-time markov chains

Methodology and Computing in Applied Probability

Volumn 8, Issue 4, 2006, Pages 449-465

  Coolen Schrijner, Pauline ^a   Doorn, Erik A ^b  

^a DURHAM UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Absorption probability; Birth death process with killing; Decay parameter; Quasi stationarity; Rate of convergence

Indexed keywords

EID: 33751577213     PISSN: 13875841     EISSN: 15737713     Source Type: Journal    
DOI: 10.1007/s11009-006-0424-y     Document Type: Article

References (20)

1. T. S. Chihara, An Introduction to Orthogonal Polynomials. Gordon and Breach: New York, 1978.
2. J. N. Darroch and E. Seneta, "On quasi-stationary distributions in absorbing discrete-time finite Markov chains," Journal of Applied Probability vol. 2 pp. 88-100, 1965.
3. D. J. Daley, "Quasi-stationary behaviour of a left-continuous random walk," Annals of Mathematical Statistics vol. 40 pp. 532-539, 1969.
4. E. A. van Doorn and P. Schrijner, "Geometric ergodicity and quasi-stationarity in discrete-time birth-death processes," Journal of the Australian Mathematical Society. Series B. vol. 37 pp. 121-144, 1995.
5. E. A. van Doorn and P. Schrijner, "Ratio limits and limiting conditional distributions for discrete-time birth-death processes," Journal of Mathematical Analysis and Applications vol. 190 pp. 263-284, 1995.
6. E. A. van Doorn and A. I. Zeifman, "Extinction probability in a birth-death process with killing," Journal of Applied Probability vol. 42 pp. 185-198, 2005.
7. W. Feller, An Introduction to Probability Theory and Its Applications, Vol. I, rev. ed. Wiley: New York, 1970.
8. P. A. Ferrari, H. Kesten and S. Martínez, "R-positivity, quasi-stationary distributions and ratio limit theorems for a class of probabilistic automata," Annals of Applied Probability vol. 6 pp. 577-616, 1996.
9. P. A. Ferrari, H. Kesten, S. Martínez and S. Picco, "Existence of quasistationary distributions. A renewal dynamical approach," Annals of Probability vol. 23 pp. 501-521, 1995.
10. S. D. Jacka and G. O. Roberts, "Weak convergence of conditioned processes on a countable state space," Journal of Applied Probability vol. 32 pp. 902-916, 1995.
11. S. Karlin and J. L. McGregor, "Random walks," Illinois Journal of Mathematics vol. 3 pp. 66-81, 1959.
12. H. Kesten, "A ratio limit theorem for (sub)Markov chains on {0,1,2,...} with bounded jumps," Advances in Applied Probability vol. 27 pp. 652-691, 1995.
13. M. Kijima, "On the existence of quasi-stationary distributions in denumerable R-transient Markov chains," Journal of Applied Probability vol. 29 pp. 21-36, 1992. (Correction. Journal of Applied Probability vol. 30 p. 496, 1993).
14. M. Kijima, "Quasi-limiting distributions of Markov chains that are skip-free to the left in continuous time," Journal of Applied Probability vol. 30 pp. 509-517, 1993.
15. J. F. C. Kingman, "The exponential decay of Markov transition probabilities," Proceedings of the London Mathematical Society (3rd Series) vol. 13 pp. 337-358, 1963.
16. J. A. Moler, F. Plo and M. San Miguel, "Minimal quasi-stationary distribution under null R -recurrence," Test vol. 9 pp. 455-470, 2000.
17. M. G. Nair and P. K. Pollett, "On the relationship between μ-invariant measures and quasi-stationary distributions for continuous-time Markov chains," Advances in Applied Probability vol. 25 pp. 82-102, 1993.
18. A. G. Pakes, "The Galton-Watson process with killing," Mathematical Biosciences vol. 69 pp. 171-188, 1984.
19. E. Seneta and D. Vere-Jones, "On quasi-stationary distributions in discrete-time Markov chains with a denumerable infinity of states," Journal of Applied Probability vol. 3 pp. 403-434, 1966.
20. D. Vere-Jones, "Ergodic properties of nonnegative matrices-I," Pacific Journal of Mathematics vol. 22 pp. 361-386, 1967.