Convergence in the wasserstein metric for markov chain Monte Carlo algorithms with applications to image restoration

Stochastic Models

Volumn 20, Issue 4, 2004, Pages 473-492

  Gibbs, Alison L ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

Bayesian image restoration; Coupling; Gibbs sampler; Ising model; Perfect simulation; Probability metrics; Total variation distance

Indexed keywords

ALGORITHMS; IMAGE RECONSTRUCTION; MATHEMATICAL MODELS; MONTE CARLO METHODS; RANDOM PROCESSES;

COUPLING TIMES; MARKOV CHAIN MONTE CARLO (MCMC) METHOD; RANDOM VARIABLES; STATIONARY DISTRIBUTION;

MARKOV PROCESSES;

EID: 8644241717     PISSN: 15326349     EISSN: None     Source Type: Journal    
DOI: 10.1081/STM-200033117     Document Type: Article

References (28)

1. Aldous, D.; Diaconis, P. Strong uniform times and finite random walks. Adv. Appl. Math. 1987, 8, 69-97.
2. Besag, J. On the statistical analysis of dirty pictures, with discussion. J. R. Statist. Soc. B 1986, 48, 259-302.
3. Besag, J.; Green, P.; Higdon, D.; Mengerson, K. Bayesian computation and stochastic systems. Statist. Sci. 1995, 10, 3-66.
4. Casella, G.; Lavine, M.; Robert, C. Explaining the perfect sampler. Am. Statist. 2001, 55, 299-305.
5. Cowles, M.K.; Roberts, G.O.; Rosenthal, J.S. Possible biases induced by MCMC convergence diagnostics. J. Statist. Comput. Simul. 1997, 64, 87-104.
6. Diaconis, P.; Stroock, D. Geometric bounds for eigenvalues of Markov chains. Ann. Appl. Probab. 1991, 1, 36-61.
7. Dudley, R.M. Real Analysis and Probability, Chapman and Hall: New York, 1989.
8. Fill, J.A. An interruptible algorithm for perfect sampling via Markov chains. Ann. Appl. Probab. 1998, 8, 131-162.
9. Fishman, G. Monte Carlo: Concepts, Algorithms, and Applications; Springer-Verlag: New York, 1996.
10. Gibbs, A.L. Bounding the convergence time of the Gibbs sampler in Bayesian image restoration. Biometrika 2000, 87, 749-766.
11. Green, P.J. MCMC in image analysis. In Markov Chain Monte Carlo in Practice; Gilks, W.R., Richardson, S., Spiegelhalter, D. J., Eds.; Chapman and Hall: London, 1996; 381-400.
12. Häggström, O.; Nelander, K. On exact simulation of Markov random fields using coupling from the past. Scand. J. Statist. 1999, 26, 395-411.
13. Huber, M.L. Exact sampling and approximate counting techniques. Proceedings of the 30th ACM Symposium on the Theory of Computing, 1998; 31-40.
14. Jerrum, M. A very simple algorithm for estimating the number of k-colorings of a low-degree graph. Random Structures and Algorithms 1995, 7, 157-165.
15. Jerrum, M.; Sinclair, A. Polynomial-time approximation algorithms for the Ising model. SIAM J. Comput. 1993, 22, 1087-1116.
16. Luby, M.; Randall, D.; Sinclair, A. Markov chain algorithms for planar lattice structures (extended abstract). 36th Annual Symposium on Foundations of Computer Science, 1995; 150-159.
17. Martinelli, F.; Olivieri, E. Approach to equilibrium of Glauber dynamics in the one phase region I: The attractive case. Comm. Math. Phys. 1994, 161, 447-486.
18. Møller, J. Perfect simulation of conditionally specified models. J. R. Statist. Soc. B 1999, 61, 251-264.
19. Murdoch, D.J.; Green, P. J. Exact sampling from a continuous state space. Scand. J. Statist. 1998, 25, 483-502.
20. Neal, R. Circularly-Coupled Markov Chain Sampling, Technical Report 9910, Department of Statistics, University of Toronto, 1999.
21. Propp, J.G.; Wilson, D. B. Exact sampling with coupled Markov chains and applications to statistical mechanics. Random Structures and Algorithms 1996, 9, 223-252.
22. Rachev, S.T. Probability Metrics and the Stability of Stochastic Models; John Wiley and Sons: New York, 1991.
23. Roberts, G.O.; Rosenthal, J. S. Convergence of slice sampler Markov chains. J. R. Statist. Soc. B. 1999, 61, 643-660.
24. Rosenthal, J.S. Minorization conditions and convergence rates for Markov chain Monte Carlo. J. Am. Statist. Assoc. 1995, 90, 558-566.
25. Thisted, R. Elements of Statistical Computing; Chapman-Hall: New York, 1988.
26. Tierney, L. Markov chains for exploring posterior distributions, with discussion. Ann. Statist. 1994, 22, 1701-1762.
27. Tierney, L. Introduction to general state-space Markov chain theory. In Markov Chain Monte Carlo in Practice; Gilks, W.R., Richardson, S., Spiegelhalter, D.J., Eds.; Chapman and Hall: London, 1996; 59-74.
28. Wilson, D.B. Layered multishift coupling for use in perfect sampling algorithms (with a primer on CFTP). In Monte Carlo Methods; Vol. 26 of Fields Institute Communications; Madras, N., Ed.; American Mathematical Society, 2000; 141-176.