Large deviations asymptotics and the spectral theory of multiplicatively regular markov processes

Electronic Journal of Probability

Volumn 10, Issue , 2005, Pages 61-123

  Kontoyiannis, I ^a   Meyn, S P ^b  

^a Brown Univerity   (United States)

^b United States of America   (United States)

Author keywords

Empirical measures; Entropy; Large deviations; Large deviations principle; Markov process; Nonlinear generator; Stochastic Lyapunov function

Indexed keywords

EID: 15944385310     PISSN: None     EISSN: 10836489     Source Type: Journal    
DOI: 10.1214/EJP.v10-231     Document Type: Article

References (45)

1. R.R. Bahadur and R. Ranga Rao. On deviations of the sample mean. Ann. Math. Statist., 31:1015-1027, 1960.
2. S. Balaji and S.P. Meyn. Multiplicative ergodicity and large deviations for an irreducible Markov chain. Stochastic Process. Appl., 90(1):123-144, 2000.
3. R.F. Bass and P. Hsu. Some potential theory for reflecting Brownian motion in Holder and Lipschitz domains. Ann. Probab., 19(2):486-508, 1991.
4. E. Bolthausen. Markov process large deviations in t-topology. Stochastic Process. Appl., 25(1):95-108, 1987.
5. A. Bovier, M. Eckhoff, V. Gayrard, and M. Klein. Metastability and small eigenvalues in Markov chains. J. Phys. A, 33(46):L447-L451, 2000.
6. S. Boyd and L. Vandenberghe. Convex Optimization. In preparation, Department of Electrical Engineering, Stanford University, 2002.
7. N.R. Chaganty and J. Sethuraman. Strong large deviation and local limit theorems. Ann. Probab., 21(3):1671-1690, 1993.
8. E.B. Davies. Pseudospectra of differential operators. J. Operator Theory, 43:243-262, 2000.
9. D.A. Dawson and J. Gartner. Large deviations from the McKean-Vlasov limit for weakly interacting diffusions. Stochastics, 20(4):247-308, 1987.
10. A. de Acosta. Large deviations for empirical measures of Markov chains. J. Theoret. Probab., 3(3):395-431, 1990.
11. Michael Dellnitz and Oliver Junge. On the approximation of complicated dynamical behavior. SIAM J. On Numerical Analysis, 36(2):491-515, 1999.
12. A. Dembo and O. Zeitouni. Large Deviations Techniques And Applications. Springer-Verlag, New York, second edition, 1998.
13. J.D. Deuschel and D.W. Stroock. Large Deviations. Academic Press, Boston, 1989.
14. M.D. Donsker and S.R.S. Varadhan. Asymptotic evaluation of certain Markov process expectations for large time. I. II. Comm. Pure Appl. Math., 28:1-47;
15. M.D. Donsker and S.R.S. Varadhan. Asymptotic evaluation of certain Markov process expectations for large time. I. II. Comm. Pure Appl. Math.,28 (1975), 279-301, 1975.
16. M.D. Donsker and S.R.S. Varadhan. Asymptotic evaluation of certain Markov process expectations for large time. III. Comm. Pure Appl. Math., 29(4):389-461, 1976.
17. M.D. Donsker and S.R.S. Varadhan. Asymptotic evaluation of certain Markov process expectations for large time. IV. Comm. Pure Appl. Math., 36(2):183-212, 1983.
18. D. Down, S. P. Meyn, and R. L. Tweedie. Exponential and uniform ergodicity of Markov processes. Ann. Probab., 23(4):1671-1691, 1995.
19. P. Dupuis and O. Zeitouni. A nonstandard form of the rate function for the occupation measure of a markov chain. Stochastic Process. Appl., 61:249-261, 1996.
20. P. Eichelsbacher and U. Schmock. Large deviations for products of empirical measures of dependent sequences. Markov Process. Related Fields, 7(3):435-468, 2001.
21. J. Feng. Martingale problems for large deviations of Markov processes. Stochastic Process. Appl., 81:165-212, 1999.
22. J. Feng and T.G. Kurtz. Large deviations for stochastic processes. Preprint, 2000.
23. W.H. Fleming. Exit probabilities and optimal stochastic control. App. Math. Optim., 4:329-346, 1978.
24. M. Fukushima and D. Stroock. Reversibility of solutions to martingale problems. In Probability, statistical mechanics, and number theory, pages 107-123. Academic Press, Orlando, FL, 1986.
25. P. Groeneboom, J. Oosterhoff, and F.H. Ruymgaart. Large deviation theorems for empirical probability measures. Ann. Probab., 7(4):553-586, 1979.
26. A. Hordijk and F. Spieksma. On ergodicity and recurrence properties of a Markov chain with an application to an open Jackson network. Adv. in Appl. Probab., 24(2):343-376, 1992.
27. W. Huisinga, S.P. Meyn, and C. Schuette. Phase transitions and metastability in Markovian and molecular systems. Ann. Appl. Probab., 2001. to appear.
28. I. Iscoe, P. Ney, and E. Nummelin. Large deviations of uniformly recurrent Markov additive processes. Adv. Appl. Math., 6:373-412, 1985.
29. N.C. Jain. Large deviation lower bounds for additive functionals of Markov processes. Ann. Probab, 18(3):1071-1098, 1990.
30. J.L. Jensen. Saddlepoint expansions for sums of Markov dependent variables on a continuous state space. Probab. Theory Related Fields, 89(2):181-199, 1991.
31. N.V. Kartashov. Criteria for uniform ergodicity and strong stability of Markov chains with a common phase space. Theor. Probability Appl., 30:71-89, 1985.
32. N.V. Kartashov. Inequalities in theorems of ergodicity and stability for Markov chains with a common phase space. Theor. Probability Appl., 30:247-259, 1985.
33. I. Kontoyiannis and S.P. Meyn. Spectral theory and limit theorems for geometrically ergodic Markov processes. Ann. Appl. Probab., 13:304-362, February 2003.
34. H. Kunita. Stochastic Flows and Stochastic Differential Equations. Cambridge University Press, Cambridge, 1990.
35. S.P. Meyn and R.L. Tweedie. Markov Chains and Stochastic Stability. Springer-Verlag, London, 1993.
36. S.P. Meyn and R.L. Tweedie. Computable bounds for geometric convergence rates of Markov chains. Ann. Appl. Probab., 4(4):981-1011, 1994.
37. H.D. Miller. A convexivity property in the theory of random variables defined on a finite Markov chain. Ann. Math. Statist., 32:1260-1270, 1961.
38. P. Ney and E. Nummelin. Markov additive processes. I. Eigenvalue properties and limit theorems. Ann. Probab., 15(2):561-592, 1987.
39. P. Ney and E. Nummelin. Markov additive processes II. Large deviations. Ann. Probab., 15(2):593-609, 1987.
40. E. Nummelin. General Irreducible Markov Chains and Nonnegative Operators. Cambridge University Press, Cambridge, 1984.
41. R.G. Pinsky. Positive Harmonic Functions and Diffusion. Cambridge University Press, Cambridge, 1995.
42. L. Rey-Bellet and L. E. Thomas. Asymptotic behavior of thermal nonequilibrium steady states for a driven chain of anharmonic oscillators. Comm. Math. Phys., 215:1-24, 2000.
43. L. Rey-Bellet and L. E. Thomas. Fluctuations of the entropy production in anharmonic chains. Ann. Henri Poincaré, 3(3):483-502, 2002.
44. S.R.S. Varadhan. Large Deviations and Applications. Society for Industrial and Applied Mathematics (SIAM), Philadelphia, Pa., 1984.
45. L. Wu. Large and moderate deviations and exponential convergence for stochastic damping Hamiltonian systems. Stochastic Process. Appl., 91(2):205-238, 2001.