A liapounov bound for solutions of the poisson equation

Annals of Probability

Volumn 24, Issue 2, 1996, Pages 916-931

  Glynn, Peter W ^a   Meyn, Sean P ^b  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Foster's criterion; Functional central limit theorem; Liapounov function; Markov chain; Markov process; Perturbation theory; Poisson equation

Indexed keywords

EID: 0030522182     PISSN: 00911798     EISSN: None     Source Type: Journal    
DOI: 10.1214/aop/1039639370     Document Type: Article

References (36)

1. ALDOUS, D. J. and THORISSON, H. (1993). Shift-coupling. Stochastic Process Appl. 44 1-4.
2. ASMUSSEN, S. (1987). Applied Probability and Queues. Wiley, New York.
3. ATHREYA, K. B. and PANTULA, S. G. (1986). Mixing properties of Harris chains and autoregressive processes. J. Appl. Probab. 23 880-892.
4. BENVENISTE, A., METIVIER, M. and PRIOURET, P. (1990). Adaptive Algorithms and Stochastic Approximations. Applications of Mathematics 22. Springer, Berlin. (Translated from the French by Stephen S. Wilson.)
5. BHATTACHARAYA, R. N. (1982). On the functional central limit theorem and the law of the iterated logarithm for Markov processes. Z. Wahrsch. Verw. Gebiete 60 185-201.
6. CAINES, P. (1988). Linear Stochastic Systems. Wiley, New York.
7. CONSTANTINESCU, C. and CORNEA, A. (1972). Potential Theory on Harmonic Spaces. Springer, Berlin.
8. DAVIS, M. H. A. (1993). Markov Models and Optimization. Chapman and Hall, London.
9. DOWN, D., MEYN, S. P. and TWEEDIE, R. L. (1993). Geometric and uniform ergodicity of Markov processes. Ann. Probab. To appear.
10. DUFLO, M. (1990). Méthodes Récursives Aléatoires. Masson, Paris.
11. FOGUEL, S. R. (1969). The Ergodic Theory of Markov Processes. Van Nostrand Reinhold, New York.
12. GLYNN, P. W. (1994). Poisson's equation for the recurrent M/G/1 queue. Adv. in Appl. Probab. 26 1044-1062.
13. HALL, P. and HEYDE, C. C. (1980). Martingale Limit Theory and Its Application. Academic, New York.
14. KUMAR, P. R. and MEYN, S. P. (1995). Stability of queueing networks and scheduling policies IEEE Trans. Automat. Control 40 251-260.
15. KURTZ, T. G. (1981). The central limit theorem for Markov chains. Ann. Probab. 9 557-560.
16. KUSHNER, H. J. (1967). Stochastic Stability and Control. Academic, New York.
17. MAIGRET, N. (1978). Théorème de limite centrale pour une chaine de Markov récurrente Harris positive. Ann. Inst. H. Poincaré Probab. Statist. 14 425-440.
18. MAKOWSKI, A. and SHWARTZ, A. (1992). Stochastic approximations and adaptive control of a discrete-time single-server network with random routing. SIAM J. Control Optim. 30.
19. METIVIER, M. and PRIOURET, P. (1987). Théorèmes de convergence presque sure pour une classe d'algorithmes stochastiques a pas décroissants. Probab. Theory Related Fields 74 403-428.
20. MEYN, S. P. and DOWN, D. (1994). Stability of generalized Jackson networks. Ann. Appl. Probab. 4 124-148.
21. MEYN, S. P. and GUO, L. (1992). Stability, convergence, and performance of an adaptive control algorithm applied to a randomly varying system. IEEE Trans. Automat. Control 37 535-540.
22. MEYN, S. P. and GUO, L. (1993). Geometric ergodicity of a bilinear time series model. J. Time Ser. Anal. 14 93-108.
23. MEYN, S. P. and TWEEDIE, R. L. (1992). Stability of Markovian processes I. Discrete time chains. Adv. in Appl. Probab. 24 542-574.
24. MEYN, S. P. and TWEEDIE, R. L. (1993). Generalized resolvents and Harris recurrence of Markov processes. Contemp. Math. 149 227-250.
25. MEYN, S. P. and TWEEDIE, R. L. (1993). Markov Chains and Stochastic Stability. Springer, London.
26. MEYN, S. P. and TWEEDIE, R. L. (1993). Stability of Markovian processes II. Continuous time processes and sampled chains. Adv. in Appl. Probab. 25 487-517.
27. MEYN, S. P. and TWEEDIE, R. L. (1993). Stability of Markovian processes III. Foster-Lyapunov criteria for continuous time processes. Adv. in Appl. Probab. 25 518-548.
28. NEVEU, J. (1972). Potentiel Markovien récurrent des chaînes de Harris. Ann. Inst. Fourier (Grenoble) 22 7-130.
29. NUMMELIN, E. (1984). General Irreducible Markov Chains and Non-Negative Operators. Cambridge Univ. Press.
30. NUMMELIN, E. (1991). On the Poisson equation in the potential theory of a single kernel. Math. Scand. 68 59-82.
31. NUMMELIN, E. and TUOMINEN, P. (1982). Geometric ergodicity of Harris recurrent Markov chains with applications to renewal theory. Stochastic Process Appl. 12 187-202.
32. REVUZ, D. (1984). Markov Chains, 2nd ed. North-Holland, Amsterdam.
33. ROSS, S. M. (1984). Introduction to Stochastic Dynamic Programming. Academic, New York.
34. SCHWEITZER, P. J. (1968). Perturbation theory and finite Markov chains. J. Appl. Probab. 5 401-403.
35. SHARPE, M. (1988). General Theory of Markov Processes. Academic, New York.
36. SHWARTZ, A. and MAKOWSKI, A. (1991). On the Poisson equation for Markov chains: existence of solutions and parameter dependence. Technical report, Dept. Electrical Engineering, Technion - Israel Institute of Technology.