Computable exponential convergence rates for stochastically ordered Markov processes

Annals of Applied Probability

Volumn 6, Issue 1, 1996, Pages 218-237

  Lund, Robert B ^a   Meyn, Sean P ^b   Tweedie, Richard L ^c  

^a UNIVERSITY OF GEORGIA   (United States)

^b University of Illinois at Urbana Champaign   (United States)

^c Department of Environmental and Radiological Health Sciences   (United States)

Author keywords

Coupling; Dam processes; Drift functions; Exponential ergodicity; Reflected diffusions; Tandem queues; Total variation

Indexed keywords

EID: 0030538347     PISSN: 10505164     EISSN: None     Source Type: Journal    
DOI: 10.1214/aoap/1034968072     Document Type: Article

References (33)

1. ABATE, J. and WHITT, W. (1987). Transient behavior of regulated Brownian motion. I. Starting at the origin. Adv. in Appl. Probab. 19 560-598.
2. AFANAS'EVA, L. G. (1985). On periodic distribution of waiting-time process. In Stability Problems for Stochastic Models. Lecture Notes in Math. 155 1-20. Springer, New York.
3. ASMUSSEN, S. (1987). Applied Probability and Queues. Wiley, New York.
4. BACCELLI, F. and FOSS, S. (1994). Ergodicity of Jackson-type queueing networks. QUESTA 17 5-72.
5. BROCKWELL, P. J., RESNICK, S. I. and TWEEDIE, R. L. (1982). Storage processes with general release rule and additive inputs. Adv. in Appl. Probab. 14 392-433.
6. COHEN, J. W. (1982). The Single Server Queue, rev. ed. North-Holland, Amsterdam.
7. DAVIS, M. H. A. (1993). Markov Models and Optimization. Chapman and Hall, London.
8. DOWN, D., MEYN, S. P. and TWEEDIE, R. L. (1995). Exponential and uniform ergodicity of Markov processes. Ann. Probab. 23 1671-1691.
9. HEATHCOTE, C. R. (1967). Complete exponential convergence and related topics. J. Appl. Probab. 4 1-40.
10. ICHIHARA, K. and KUNITA, H. (1974). A classification of the second order degenerate elliptic operators and its probabilistic characterization. Z. Wahrsch. Verw. Gebiete 30 235-254.
11. KALASHNIKOV, V. (1994). Topics on Regenerative Processes. CRC Press, London.
12. KAMAE, T., KRENGEL, U. and O'BRIEN, G. L. (1977). Stochastic inequalities on partially ordered spaces. Ann. Probab. 5 899-912.
13. KELLA, O. and WHITT, W. (1992). Useful martingales for stochastic storage processes with Lévy input. J. Appl. Probab. 29 396-403.
14. LINDVALL, T. (1992). Lectures on the Coupling Method. Wiley, New York.
15. LUND, R. B. (1994). A dam with seasonal input. J. Appl. Probab. 31 526-541.
16. LUND, R. B. (1995). A comparison of convergence rates for three models in the theory of dams. J. Appl. Probab. To appear.
17. LUND, R. B. and TWEEDIE, R. L. (1995). Geometric convergence rates for stochastically ordered Markov chains. Math. Oper. Res. To appear.
18. MEYN, S. P. and DOWN, D. (1994). Stability of generalized Jackson networks. Ann. Appl. Probab. 4 124-148.
19. MEYN, S. P. and TWEEDIE, R. L. (1993a). Stability of Markovian processes. II. Continuous-time processes and sampled chains. Adv. in Appl. Probab. 25 487-517.
20. MEYN, S. P. and TWEEDIE, R. L. (1993b). Stability of Markovian processes. III: Foster-Lyapunov criteria for continuous-time processes. Adv. in Appl. Probab. 25 518-548.
21. MEYN, S. P. and TWEEDIE, R. L. (1993c). Markov Chains and Stochastic Stability. Springer, London.
22. MORSE, P. M. (1958). Queues, Inventories and Maintenance. Wiley, New York.
23. PRABHU, N. U. (1980). Stochastic Storage Models. Springer, New York.
24. ROSENKRANTZ, W. A. (1983). Calculation of the Laplace transform of the length of the busy period for the M/G/1 queue via martingales. Ann. Probab. 11 817-818.
25. SHANTHIKUMAR, J. G. and YAO, D. D. (1989). Stochastic monotonicity in general queueing networks. J. Appl. Probab. 26 413-417.
26. STOYAN, D. (1983). Comparison Methods for Queues and Other Stochastic Models. Wiley, New York.
27. THORISSON, H. (1983). The coupling of regenerative processes. Adv. in Appl. Probab. 15 531-561.
28. TUOMINEN, P. and TWEEDIE, R. L. (1979). Exponential ergodicity in Markovian queueing and dam models. J. Appl. Probab. 16 867-880.
29. VAN DOORN, E. A. (1981). Stochastic Monotonicity and Queueing Applications of Birth-Death Processes. Lecture Notes in Statist. 4. Springer, New York.
30. VAN DOORN, E. A. (1985). Conditions for the exponential ergodicity and bounds for the decay parameter of a birth-death process. J. Appl. Probab. 17 514-530.
31. VERAVERBEKE, N. and TEUGELS, J. L. (1975). The exponential rate of convergence of the distribution of a maximum of a random walk. J. Appl. Probab. 12 279-288.
32. VERAVERBEKE, N. and TEUGELS, J. L. (1976). The exponential rate of convergence of the distribution of a maximum of a random walk. II. J. Appl. Probab. 13 733-740.
33. ZEIFMAN, A. I. (1991). Some estimates of the rate of convergence for birth and death processes. J. Appl. Probab. 28 268-277.