Series expansions for finite-state Markov chains

Probability in the Engineering and Informational Sciences

Volumn 21, Issue 3, 2007, Pages 381-400

  Heidergott, Bernd ^a   Hordijk, Arie ^b   Van Uitert, Miranda ^a  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

^b LEIDEN UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

EXPANSION;

FINITE MARKOV CHAIN; FINITE STATE; NUMERICAL ALGORITHMS; SERIES EXPANSION; STATIONARY DISTRIBUTION;

MARKOV CHAINS;

EID: 34547828309     PISSN: 02699648     EISSN: 14698951     Source Type: Journal    
DOI: 10.1017/S0269964807000034     Document Type: Article

References (14)

1. Altman, E., Avrachenkov, K.E., & Núñez-Queija, R. (2004). Perturbation analysis for denumerable Markov chains with application to queueing models. Advances in Applied Probability 36: 839-853.
2. Cao, X.-R. (1998). The Maclaurin series for performance functions of Markov chains. Advances in Applied Probability 30: 676-692.
3. Cho, G.E. & Meyer, C.D. (2001). Comparison of perturbation bounds for the stationary distribution of a Markov chain. Linear Algebra and its Applications 335: 137-150.
4. Coolen-Schrijner, P. & van Doom, E.A. (2002). The deviation matrix of a continuous-time Markov chain. Probability in the Engineering and Informational Sciences 16: 351-366.
5. Fayolle, G. & Iasnogorodski, R. (1979). Two coupled processors: The reduction to a Riemann-Hilbert problem. Zeitschrift für Wahrscheinlichkeitstheorie und verwandte Gebiete 47: 325-351.
6. Heidergott, B. & Hordijk, A. (2003). Taylor series expansions for stationary Markov chains. Advances in Applied Probability 35: 1046-1070.
7. Hordijk, A. & Popov, N. (2003). Large deviation analysis of a coupled processor system. Probability in the Engineering and Informational Sciences 17: 397-409.
8. Hordijk, A. & Spieksma, F.M. (1992). On ergodicity and recurrence properties of a Markov chain with an application to an open Jackson network. Advances in Applied Probability 24: 343-376.
9. Kirkland, S. (2003). Conditioning properties of the stationary distribution for a Markov chain. Electronic Journal of Linear Algebra 10: 1-15.
10. Knessl, C. & Morrison, J.A. (2003). Heavy traffic analysis of two coupled processors. Queueing Systems 43: 173-220.
11. Konheim, A.G., Meilijson, I., & Melkman, A. (1981). Processor sharing of two parallel lines. Journal of Applied Probability 18: 952-956.
12. Meyn, S.P. & Tweedie, R.L. (1993). Markov chains and stochastic stability. London: Springer-Verlag.
13. Mine, H. (1988). Nonnegative matrices. New York: Wiley.
14. Puterman, M.L. (1994). Markov decision processes: Discrete stochastic dynamic programming. New York: Wiley.