Ergodic Theorems and Ergodic Decomposition for Markov Chains

Acta Applicandae Mathematicae

Volumn 54, Issue 1, 1998, Pages 99-119

  Hernández Lerma, Onésimo ^a   Lasserre, Jean B ^b  

^a DEPARTAMENTO DE FÍSICA   (Mexico)

^b LAAS CNRS   (France)

Author keywords

Empirical measures; Ergodic decomposition; Ergodic theorems; Expected occupation measures; Markov chains

Indexed keywords

EID: 0007422099     PISSN: 01678019     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1006012022894     Document Type: Article

References (21)

1. Akin, E.: The General Topology of Dynamical Systems, Grad. Stud. Math., Amer. Math. Soc., Providence, 1993.
2. Billingsley, P.: Convergence of Probability Measures, Wiley, New York, 1968.
3. Brézis, H.: Analyse fonctionnelle: théorie et applications, 4ème tirage, Masson, Paris, 1993.
4. Borovkov, A. A.: Conditions for ergodicity of Markov chains which are not associated with Harris irreducibility, Siberian Math. J. 32 (1992), 543-554.
5. Chacon, R. V.: Identification of the limit of operator averages, J. Math. Mech. 11 (1962), 961-968.
6. Doob, J. L.: Measure Theory, Springer-Verlag, New York, 1994.
7. Foguel, S. R.: The Ergodic Theory of Markov Processes, Van Nostrand Reinhold, New York, 1969.
8. Hernández-Lerma, O. and Lasserre, J. B.: Invariant probabilities for Feller-Markov chains, J. Appl. Math. Stoch. Anal. 8 (1995), 341-345.
9. Hernández-Lerma, O. and Lasserre, J. B.: Existence of bounded invariant probability densities for Markov chains, Statist. Probab. Lett. 28 (1996), 359-366.
10. Hernández-Lerma, O. and Lasserre, J. B.: Discrete-Time Markov Control Processes: Basic Optimality Criteria, Springer-Verlag, New York, 1996.
11. Hernández-Lerma, O. and Lasserre, J. B.: Existence and uniqueness of fixed points for Markov operators and Markov processes, Proc. Lond. Math. Soc., in press.
12. Lasota, A. and Mackey, M. C.: Chaos, Fractals, and Noise, Springer-Verlag, New York, 1994.
13. Lasserre, J. B.: Invariant probabilities for Markov chains on metric spaces, Statist. Probab. Lett. 34 (1997), 259-265.
14. Lasserre, J. B.: Existence and uniqueness of an invariant probability measure for a class of Feller-Markov chains, J. Theoret. Probab. 9 (1996), 595-612.
15. Meyn, S. P. and Tweedie, R. L.: The Doeblin decomposition, Contemp. Math. 149 (1993), 211-225.
16. Meyn, S. P. and Tweedie, R. L.: Markov Chains and Stochastic Stability, Springer-Verlag, London, 1993.
17. Puterman, M. L.: Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, New York, 1994.
18. Revuz, D.: Markov Chains, rev. edn, North-Holland, Amsterdam, 1984.
19. Royden, H. L.: Real Analysis, 3rd edn, Macmillan, New York, 1988.
20. Rudin, W.: Real and Complex Analysis, 3rd edn, McGraw-Hill, New York, 1986.
21. Yosida, K.: Functional Analysis, 6th edn, Springer-Verlag, Berlin, 1980.