Curvature, concentration and error estimates for Markov chain Monte Carlo

Annals of Probability

Volumn 38, Issue 6, 2010, Pages 2418-2442

  Joulin, Aldéric ^a   Ollivier, Yann ^b  

^a UNIVERSITÉ DE TOULOUSE   (France)

^b UNITÉ DE MATHÉMATIQUES PURES ET APPLIQUÉES   (France)

Author keywords

Concentration of measure; Markov chain monte carlo; Ricci curvature; Wasserstein distance

Indexed keywords

EID: 77957893645     PISSN: 00911798     EISSN: None     Source Type: Journal    
DOI: 10.1214/10-AOP541     Document Type: Article

References (27)

1. BUBLEY, R. and DYER, M. E. (1997). Path coupling: A technique for proving rapid mixing in Markov chains. FOCS 223-231.
2. BAKRY, D. and ÉMERY, M. (1985). Diffusions hypercontractives. In Séminaire de Probabilités, XIX, 1983/84. Lecture Notes in Math. 1123 177-206. Springer, Berlin.
3. BISMUT, J.-M. (1981). Mécanique Aléatoire. Lecture Notes in Math. 866. Springer, Berlin.
4. BASAK, G. K., HU, I. and WEI, C.-Z. (1997). Weak convergence of recursions. Stochastic Process. Appl. 68 65-82.
5. CATTIAUX, P. and GUILLIN, A. (2008). Deviation bounds for additive functionals of Markov processes. ESAIM Probab. Stat. 12 12-29 (electronic).
6. CHEN, M. F. and WANG, F. Y. (1994). Application of coupling method to the first eigenvalue on manifold. Sci. China Ser. A 37 1-14.
7. DJELLOUT, H.,GUILLIN, A. and WU, L. (2004). Transportation cost-information inequalities and applications to random dynamical systems and diffusions. Ann. Probab. 32 2702-2732.
8. DOBRUŠIN, R. L. (1970). Definition of a system of random variables by means of conditional distributions. Teor. Verojatnost. i Primenen. 15 469-497.
9. DOBRUSHIN, R. L. (1996). Perturbation methods of the theory of Gibbsian fields. In Lectures on Probability Theory and Statistics (Saint-Flour, 1994). Lecture Notes in Math. 1648 1-66. Springer, Berlin.
10. DOBRUSHIN, R. L. and SHLOSMAN, S. B. (1985). Constructive criterion for the uniqueness of Gibbs field. In Statistical Physics and Dynamical Systems (Köszeg, 1984). Progress in Probability 10 347-370. Birkhäuser, Boston, MA.
11. DIACONIS, P. and SALOFF-COSTE, L. (1996). Logarithmic Sobolev inequalities for finite Markov chains. Ann. Appl. Probab. 6 695-750.
12. GUILLIN, A., LÉONARD, C., WU, L. and YAO, N. (2009). Transportation-information inequalities for Markov processes. Probab. Theory Related Fields 144 669-695.
13. JACOD, J. and SHIRYAEV, A. N. (2003). Limit Theorems for Stochastic Processes, 2nd ed. Grundlehren der Mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences] 288. Springer, Berlin.
14. JOULIN, A. (2007). Poisson-type deviation inequalities for curved continuous-time Markov chains. Bernoulli 13 782-798.
15. JOULIN, A. (2009). A new Poisson-type deviation inequality for Markov jump processes with positive Wasserstein curvature. Bernoulli 15 532-549.
16. LEZAUD, P. (1998). Chernoff-type bound for finite Markov chains. Ann. Appl. Probab. 8 849-867.
17. LEVIN, D. A., PERES, Y. and WILMER, E. L. (2009). Markov Chains and Mixing Times. Amer. Math. Soc., Providence, RI.
18. MARTINELLI, F. (2004). Relaxation times of Markov chains in statistical mechanics and combinatorial structures. In Probability on Discrete Structures. Encyclopaedia of Mathematical Sciences 110 175-262. Springer, Berlin.
19. MEYN, S. P. and TWEEDIE, R. L. (1993). Markov Chains and Stochastic Stability. Springer, London.
20. OLIVEIRA, R. I. (2009). On the convergence to equilibrium of Kac's random walk on matrices. Ann. Appl. Probab. 19 1200-1231.
21. OLLIVIER, Y. (2007). Ricci curvature of metric spaces. C. R. Math. Acad. Sci. Paris 345 643-646.
22. OLLIVIER, Y. (2009). Ricci curvature of Markov chains on metric spaces. J. Funct. Anal. 256 810-864.
23. PERES, Y. (2005). Mixing for Markov chains and spin systems. Available at http://www.stat. berkeley.edu/~peres/ubc.pdf.
24. ROBERTS, G. O. and ROSENTHAL, J. S. (2004). General state space Markov chains and MCMC algorithms. Probab. Surv. 1 20-71 (electronic).
25. RUDOLF, D. Error bounds for computing the expectation by Markov chain Monte Carlo. Preprint. Available at arXiv:0906.2359.
26. VILLANI, C. (2003). Topics in Optimal Transportation. Graduate Studies in Mathematics 58. Amer. Math. Soc., Providence, RI.
27. WU, L. (2000). A deviation inequality for non-reversible Markov processes. Ann. Inst. H. Poincaré Probab. Statist. 36 435-445.