Studying convergence of markov chain monte carlo algorithms using coupled sample paths

Journal of the American Statistical Association

Volumn 91, Issue 433, 1996, Pages 154-166

  Johnson, Valen E ^a  

^a DUKE UNIVERSITY   (United States)

Author keywords

Bayesian inference; Gibbs sampling; Metropolis Hasting algorithm; Quadrature

Indexed keywords

EID: 0001307109     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.1996.10476672     Document Type: Article

References (35)

1. Besag, J. E. (1974), “Spatial Interaction and the Statistical Analysis of Lattice Systems,” Journal of the Royal Statistical Society, Ser. B, 36, 192-225.
2. Besag, J. E. (1986), “On the Statistical Analysis of Dirty Pictures,” Journal of the Royal Statistical Society, Ser. B, 48, 259-302.
3. Besag, J. E. (1989), 'Towards Bayesian Image Analysis,” Journal of Applied Statistics, 16, 395-407.
4. Besag, J. E., and Green, P. J. (1993), “Spatial Statistics in Bayesian Computation,” Journal of the Royal Statistical Society, Ser. B, 55, 25-37.
5. Besag, J. E., York, J., and Mollie, A. (1991), “Bayesian Image Restoration With Two Applications in Spatial Statistics,” Annals of the Institute of Statistical Mathematics, 43, 1-59.
6. Doeblin, W. (1933), “Exposé de la Theorie des Chaines Simples Constantes de Markov à un Nombre Fini D'etats,” Revue Mathematique de Union Interbalkanique, 2, 77-105.
7. Frigessi, A., Hwang, C. R., and Younes, L. (1992), “Convergence Rates of the Gibbs Sampler, the Metropolis Algorithm and Other Single-Site Updating Dynamics,” Journal of the Royal Statistical Society, Ser. B, 55, 205-219.
8. Hastings, W. K. (1970), “Monte Carlo Sampling Methods Using Markov Chains and Their Applications,” Biometrikà, 57, 97-109.
9. Garren, S. T., and Smith, R. L. (1994), “Convergence Diagnostics for Markov Chain Samplers,” preprint, University of North Carolina.
10. Gelfand, A. E., Hills, S. E., Racine-Poon, A., and Smith, A. F. M. (1990), “Illustration of Bayesian Inference in Normal Data Models Using Gibbs Sampling,” Journal of the American Statistical Association, 85, 972-985.
11. Gelfand, A. E., and Smith, A. F. M. (1990), “Sampling-Based Approaches to Calculating Marginal Densities,” Journal of the American Statistical Association, 85, 398-409.
12. Gelman, A., and Rubin, D. B. (1992a), “Inference From Iterative Simulation,” Statistical Science, 7, 457-472.
13. Gelman, A., and Rubin, D. B. (1992b), “A Single Series From the Gibbs Sampler Provides a False Sense of Security,” in Bayesian Statistics 4, eds. Bernardo, Berger, Dawid, and Smith, Oxford, U.K.: Oxford University Press, pp. 625-631.
14. Geman, S., and Geman, D. (1984), “Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-6, 721-741.
15. Geyer, C. (1992), “Practical Markov Chain Monte Carlo,” Statistical Science, 7, 473-483.
16. Geyer, C., and Thompson, E. (1992), “Constrained Monte Carlo Maximum Likelihood for Dependent Data,” Journal of the Royal Statistical Society, Ser. B, 54, 657-699.
17. Goldstein, S. (1979), “Maximal Coupling,” Zeitschrift für Wahrshein- lichkeitstheorie und Verwandte Gebiete, 46, 193-204.
18. Griffeath, D. (1975), “A Maximal Coupling for Markov Chains,” Zeitschrift fur Wahrsheinlichkeitstheorie under Verwandte Gebiete, 31, 95-106.
19. Johnson, V. E. (1994), “A Model for Segmentation and Analysis of Noisy Images,” Journal of the American Statistical Association, 89, 230-241.
20. Lindvall, T. (1992), Lectures on the Coupling Method, New York: John Wiley.
21. Lund, R. B., and Tweedie, R. L. (1993), “Geometric Convergence Rates for Stochastically Ordered Markov Chains,” technical report, Colorado State University, Dept, of Statistics.
22. Meyn, S. P., and Tweedie, R. L. (1993), “Computable Bounds for Convergence Rates of Markov Chains,” technical report, Colorado State University, Dept, of Statistics.
23. Milovanovic, G. V. (1975), “On Some Integral Inequalities,” Univerzitet u Beogradu, Publikacije Elektrotehnickog Fakulteta, Serija Matematika i Fizika, No. 498-541, 119-124.
24. Mitrinovic, D. S., Peccaric, J. E., and Fink, A. M. (1991), Inequalities Involving Functions and Their Integrals and Derivatives, Dordrecht, The Netherlands: Kluwer.
25. Müller, P. (1992), “A Generic Approach to Posterior Integration and Gibbs Sampling,” Technical Report 91-09, Purdue University, Dept, of Statis-tics.
26. Odell, P. L., and Feiveson, A. H. (1966), “A Numerical Procedure to Generate a Sample Covariance Matrix,” Journal of the American Statistical Association, 61, 198-203.
27. Pitman, J. W. (1976), “On Coupling of Markov Chains,” Zeitschrift fir Wahrsheinlichkeitstheorie und Verwandte Gebiete, 35, 315-322.
28. Press, W., Teukolsky, S., Vetterling, W., and Flannery, B. (1992), Numerical Recipes in Fortran: The Art of Scientific Computing, Cambridge, U.K.: Cambridge University Press.
29. Ritter, C., and Tanner, M. (1992), “Facilitating the Gibbs Sampler: The Gibbs Stopper and Griddy-Gibbs Sampler,” Journal of the American Statistical Association, 87, 861-868.
30. Roberts, G. O. (1992), “Convergence Diagnostics of the Gibbs Sampler,” in Bayesian Statistics 4, eds. Bernardo, Berger, Dawid, and Smith, Oxford, U.K.: Oxford University Press, pp. 777-784.
31. Roberts, G. O., and Hills, S. E. (1992), “Assessing Distributional Convergence of the Gibbs Sampler,” preprint, University of Cambridge.
32. Rosenthal, J. S. (1995), “Minorization Conditions and Convergence Rates for Markov Chain Monte Carlo,” Journal of the American Statistical Association, 90, 558-566.
33. Smith, A. F. M., and Roberts, G. O. (1993), “Bayesian Computation via the Gibbs Sampler and Related Markov Chain Monte Carlo Methods,” Journal of the Royal Statistical Society, Ser. B, 55, 3-23.
34. Tanner, M., and Wong, W. H. (1987), “The Calculation of Posterior Distributions by Data Augmentation” (with discussion), Journal of the Amer-ican Statistical Association, 82, 528-550.
35. Tierney, L. (1991), “Markov Chains for Exploring Posterior Distributions,” (with discussion), Annals of Statistics, 22, 1701-1762.