An overview of some stochastic stability methods

Journal of the Operations Research Society of Japan

Volumn 47, Issue 4, 2004, Pages 275-303

  Foss, Serguei ^a   Konstantopoulos, Takis ^a  

^a HERIOT WATT UNIVERSITY   (United Kingdom)

Author keywords

Applied probability; Coupling; Ergodicity; Harris chains; Lyapunov functions; Markov chains; Stability; Stationary processes; Stochastic networks; Stochastic recursive sequences

Indexed keywords

EID: 13744263867     PISSN: 04534514     EISSN: None     Source Type: Journal    
DOI: 10.15807/jorsj.47.275     Document Type: Review

References (39)

1. V. Anantharam and T. Konstantopoulos: Stationary solutions of stochastic recursions describing discrete event systems. Stochastic Processes and Applications, 68 (1997), 181-194.
2. V. Anantharam and T. Konstantopoulos: A correction and some additional remarks on: stationary solutions of stochastic recursions describing discrete event systems. Stochastic Processes and Applications, 80 (1999), 271-278.
3. L. Arnold: Random Dynamical Systems (Springer-Verlag, Berlin, 1998).
4. S. Asmussen: Applied Probability and Queues (Springer, New York, 2003).
5. F. Baccelli and P. Brémaud: Elements of Queueing Theory (Springer, Berlin, 2003).
6. F. Baccelli and S. Foss: On the saturation rule for the stability of queues. Journal of Applied Probability, 32 (1995), 494-507.
7. A. A. Borovkov: Asymptotic Methods in Queueing Theory (Wiley, New York, 1984).
8. A. A. Borovkov: Ergodicity and Stability of Stochastic Processes (Wiley, New York, 1998).
9. A. A. Borovkov and S. G. Foss: Stochastically recursive sequences and their generalizations. Siberian Advances in Mathematics 2 (1992), n.1, 16-81.
10. A. Boyarsky and P. Góra: Laws of Chaos: Invariant Measures and Dynamical Systems in One Dimension. (Birkhäuser, Boston, 1997).
11. M. Bramson: Instability of FIFO queueing networks with quick service times. The Annals of Applied Probability 4 (1993), 693-718.
12. A. Brandt, P. Franken and B. Lisek: Stationary Stochastic Models (Wiley, New York, 1992).
13. H. Chen and D. D. Yao: Fundamentals of Queueing Networks (Springer, New York, 2001).
14. K. L. Chung: A Course in Probability Theory (Academic Press, New York, 1974).
15. J. G. Dai: On positive Harris recurrence of multiclass queueing networks: a unified approach via fluid limit models. The Annals of Applied Probability, 5 (1995), 49-77.
16. P. Diaconis and P. Freedman: Iterated random functions. SIAM Review, 41 (1999), 45-76.
17. M. Duflo: Random Iterative Models (Springer, Berlin, 1997).
18. G. Fayolle, V. Malyshev and M. Menshikov: Topics in the, Constructive Theory of Markov Chains (1995).
19. S. G. Foss and D. E. Denisov: On transience conditions for Markov chains. Siberian Mathematical Journal, 42 (2001), 425-433.
20. S. Foss and T. Konstantopoulos: Extended renovation theory and limit theorems for stochastic ordered graphs. Markov Processes and Relared Fields, 9 (2003), 413-468.
21. S. G. Foss, R. L. Tweedie and J. N. Corcoran: Simulating the invariant measures of Markov chains using backward coupling at regeneration times. Probability in Engineering and Informational Sciences, 12 (1998), 303-320.
22. F. G. Foster: On the stochastic matrices associated with certain queueing processes. The Annals of Mathematical Statistics, 24 (1953), 355-360.
23. D. Gamarnik and J. Hasenbein: Instability in stochastic and fluid queueing networks. The Annals of Applied Probability, (2003 , To appear.
24. Yu. Kifer: Ergodic Theory of Random Transformations (Birkhäuser, Boston, 1986).
25. A. Lasota and M. C. Mackey: Chaos, Fractals, and Noise: Stochastic Aspects of Dynamics (Springer, New York, 1994).
26. T. M. Liggett: Interacting Particle Systems (Springer, New York, 1985).
27. T. Lindval: Lectures on the Coupling Method (Wiley, New York, 1992).
28. R. M. Loynes: The stability of queues with non-independent interarrival and service times. Mathematical Proceedings of the Cambridge Philosophical Society, 58 (1962), 497-520.
29. S. P. Meyn: Transience of multiclass queueing networks and their fluid models. The Annals of Applied Probability, 5 (1995), 946-957.
30. S. P Meyn and R. L. Tweedie: Markov Chains and Stochastic Stability (Springer, New York, 1993).
31. E. Nummelin: General Irreducible Markov Chains and Nonnegative Operators (Cambridge, U.P., Cambridge, 1984).
32. A. G. Pakes: Some conditions for ergodicity and recurrence of Markov chains. Operations Research, 17 (1969), 1048-1061.
33. A. A. Puhalskii and A. N. Rybko: Nonergodicity of queueing networks when their fluid models are unstable. Problems of Information Transmission, 36 (2000), 26-46.
34. Ph. Robert: Stochastic Networks and Queues (Springer, Berlin, 2003).
35. A. N. Rybko and A. L. Stolyar: Ergodicity of stochastic processes describing the operations of open queueing networks. Problems of Information Transmission, 28 (1992), 3-26.
36. A. N. Shiryayev: Probability (Springer, New York, 1984).
37. H. Thorisson: Coupling, Stationarity, and Regeneration (Springer, New York, 2000).
38. R. L. Tweedie: Criteria for classifying general Markov chains. Advances in Applied Probability 8 (1976), 737-771.
39. W. Whitt: Stochastic-Process Limits (Springer, New York, 2002).