Markov Chain Monte Carlo Convergence Diagnostics: A Comparative Review

Journal of the American Statistical Association

Volumn 91, Issue 434, 1996, Pages 883-904

  Cowles, Mary Kathryn ^a   Carlin, Bradley P ^b  

^a HARVARD SCHOOL OF PUBLIC HEALTH   (United States)

^b UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Autocorrelation; Gibbs sampler; Metropolis Hastings algorithm

Indexed keywords

EID: 0030539336     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.1996.10476956     Document Type: Article

References (58)

1. Albert, J. H. (1992), –A Bayesian Analysis of a Poisson Random Effects Model for Home Run Hitters,— The American Statistician, 46, 246-253.
2. Albert, J. H. (1993), –Teaching Bayesian Statistics Using Sampling Methods and MINITAB,— The American Statistician, 47, 182-191.
3. Andrews, R. W, Berger, J. O., and Smith, M. H. (1993), –Bayesian Estimation of Fuel Economy Potential due to Technology Improvements— (with discussion), in Case Studies in Bayesian Statistics, Lecture Notes in Statistics, Vol. 83, eds. C. Gatsonis, J. S. Hodges, R. E. Kass, and N. D. Singpurwalla, New York: Springer-Verlag, pp. 1-77.
4. Besag, J., and Green, P. 1. (1993), –Spatial Statistics and Bayesian Computation— (with discussion), Journal ofthe Royal Statistical Society, Ser. B, 55, 1-52.
5. Best, N. G., Cowles, M. K., and Vines, K. (1995), –CODA: Convergence Diagnosis and Output Analysis Software for Gibbs Sampling Output, Version 0. 30,— technical report, University of Cambridge, MRC Biostatistics Unit.
6. Buck, C. E., Litton, C. D., and Stephens, D. A. (1993), –Detecting a Change in the Shape of a Prehistoric Corbelled Tomb,— The Statistician, 42, 483-490.
7. Casella, G., and George, E. I. (1992), –Explaining the Gibbs Sampler,— The American Statistician, 46, 167-174.
8. Chan, K. S., and Geyer, C. J. (1995), Discussion of –Markov Chains for Exploring Posterior Distributions,— by L. Tierney, The Annals of Statistics, 22, 1747-1758.
9. Cleveland, W S. (1979), "Robust Locally Weighted Regression and Smoothing Scatterplots, ' Journal of the American Statistical Association, 74, 829-836.
10. Cui, L., Tanner, M. A., Sinha, D., and Hall, W J. (1992), –Comment: Monitoring Convergence of the Gibbs Sampler: Further Experience With the Gibbs Stopper,— Statistical Science, 7, 483-486.
11. Garren, S. T., and Smith, R. L. (1993), –Convergence Diagnostics for Markov Chain Samplers,— technical report, University of North Carolina, Dept. of Statistics.
12. Gelfand, A. E., and Carlin, B. P. (1993), –Maximum Likelihood Estimation for Constrained or Missing Data Models,— Canadian Journal of Statistics, 21, 303-312.
13. Gelfand, A. E., and Sahu, S. K. (1994), –On Markov Chain Monte Carlo Acceleration,— Journal of Computational and Graphical Statistics, 3, 261-276.
14. Gelfand, A. E., Sahu, S. K., and Carlin, B. P. (1995a), –Efficient Parameterizations for Normal Linear Mixed Models,— Biometrika, 82, 479-488.
15. Gelfand, A. E., Sahu, S. K., and Carlin, B. P. (1996), –Efficient Parameterizations for Generalized Linear Mixed Models,— in Bayesian Statistics 5, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Oxford, U. K.: Oxford University Press, to appear.
16. Gelfand, A. E., and Smith, A. F. M. (1990), –Sampling-Based Approaches to Calculating Marginal Densities,— Journal of the American Statistical Association, 85, 398-409.
17. Gelman, A., and Rubin, D. B. (1992a), –Inference From Iterative Simulation Using Multiple Sequences— (with discussion), Statistical Science, 7, 457-511.
18. Gelman, A., and Rubin, D. B. (1992b), –Rejoinder: Replication Without Contrition,— Statistical Science, 7, 503-507.
19. Geman, S., and Geman, D. (1984), –Stochastic Relaxation, Gibbs Distributions and the Bayesian Restoration of Images,— 1EEE Transactions on Pattern Analysis and Machine 1ntelligence, PAMI 6, 721-741.
20. Geweke, J. (1992), –Evaluating the Accuracy of Sampling-Based Approaches to the Calculation of Posterior Moments. — in Bayesian Statistics 4, eds. J. M. Bernardo, J. Berger, A. P. Dawid, and A. F. M. Smith, Oxford, U. K.: Oxford University Press, pp. 169-193.
21. Geyer, C. J. (1992), –Practical Markov Chain Monte Carlo,— Statistical Science, 7, 473-483.
22. Geyer, C. J., and Thompson, E. A. (1992), –Constrained Monte Carlo Like— lihood for Dependent Data" (with discussion), Journal ofthe Royal Statistical Society, Ser. B, 54, 657-699.
23. Geyer, C. J., and Thompson, E. A. (1995), –Annealing Markov Chain Monte Carlo With Applications to Ancestral Inference,— Journal ofthe American Statistical Association, 90, 909-920.
24. Gilks, W R., Thomas, A., and Spiegelhalter, D. J. (1994), –A Language and Program for Complex Bayesian Modelling,— The Statistician, 43, 169-178.
25. Hastings, WK. (1970), –Monte Carlo Sampling Methods Using Markov Chains and Their Applications,— Biometrika, 57, 97-109.
26. Heidelberger, P., and Welch, P. D. (1983), –Simulation Run Length Control in the Presence of an Initial Transient,— Operations Research, 31, 11091-144.
27. Hills, S. E., and Smith, A. F. M. (1992), –Parameterization Issues in Bayesian Inference— (with discussion), in Bayesian Statistics 4, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Oxford, U. K.: Oxford University Press, pp. 227-246.
28. Johnson, V. E. (1994), –Studying Convergence of Markov Chain Monte Carlo Algorithms Using Coupled Sample Paths,— Journal of the American Statistical Association, 91, 154-166.
29. Lange, N., Carlin, B. P., and Gelfand, A. E. (1992), –Hierarchical Bayes Models for the Progression of HIV Infection Using Longitudinal CD4+ Counts— (with discussion), Journal of the American Statistical Association, 87, 615-625.
30. Liu, c., Liu, J., and Rubin, D. B. (1992), –A Variational Control Variable for Assessing the Convergence of the Gibbs Sampler,— in Proceedings of the American Statistical Association, Statistical Computing Section, pp. 74-78.
31. Liu, J., Wong, W. H., and Kong, A. (1995), –Correlation Structure and Convergence Rate of the Gibbs Sampler With Various Scans,— Journal of the Royal Statistical Society, Ser. B, 57, 157-169.
32. MacEachern, S. N., and Berliner, L. M. (1994), –Subsampling the Gibbs Sampler,— The American Statistician, 48, 188-190.
33. Metropolis, N., Rosenbluth, A. W, Rosenbluth, M. N., Teller, A. H., and Teller, E. (1953), –Equations of State Calculations by Fast Computing Machines,— Journal of Chemical Physics, 21, 1087-1091.
34. Meyn, S. P., and Tweedie, R. L. (1993) Markov Chains and Stochastic Stability, London: Springer-Verlag.
35. Mykland, P., Tierney, L., and Yu, B. (1995), –Regeneration in Markov Chain Samplers,— Journal of the American Statistical Association, 90, 233-241.
36. Polson, N. G. (1996). –Convergence of Markov Chain Monte Carlo Algorithms,— in Bayesian Statistics 5, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Oxford, U. K.: Oxford University Press, to appear.
37. Raftery, A. E., and Lewis, S. (1992), –How Many Iterations in the Gibbs Sampler—, ' in Bayesian Statistics 4, eds. J. M. Bernardo, J. Berger, A. P. Dawid, and A. F. M. Smith, Oxford, U. K.: Oxford University Press, pp. 763-773.
38. Ripley, B. D. (1987), Stochastic Simulation, New York: John Wiley.
39. Ritter, C, and Tanner, M. A. (1992), –Facilitating the Gibbs Sampler: The Gibbs Stopper and the Griddy-Gibbs Sampler,— Journal ofthe American Statistical Association, 87, 861-868.
40. Roberts, G. O. (1992), –Convergence Diagnostics of the Gibbs Sampler,— in Bayesian Statistics 4, eds. I. M. Bernardo, J. Berger, A. P. Dawid, and A. F. M. Smith, Oxford, U. K.: Oxford University Press, pp. 775-782.
41. Roberts, G. O. (1996), –Methods for Estimating £2 Convergence of Markov Chain Monte Carlo,— in Bayesian Statistics and Econometrics: Essays in Honor ofArnold Zellner, eds. D. Berry, I. Chaloner, and J. Geweke, Amsterdam: North-Holland, pp. 373-384.
42. Roberts, G. O., and Hills, S. (1991), –Assessing Distributional Convergence of the Gibbs Sampler,— technical report, University of Cambridge, Dept. of Mathematics.
43. Rosenthal, J. S. (1993), –Rates of Convergence for Data Augmentation on Finite Sample Spaces,— Annals ofApplied Probability, 3, 819-839.
44. Rosenthal, J. S. (1995a), –Minorization Conditions and Convergence Rates for Markov Chain Monte Carlo,— Journal of the American Statistical Association, 90, 558-566.
45. Rosenthal, J. S. (1995b), –Rates of Convergence for Gibbs Sampling for Variance Component Models,— Annals of Statistics, 23, 740-761.
46. Rosenthal, J. S. (1996), –Analysis of the Gibbs Sampler for a Model Related to James-Stein Estimators,— Statistics and Computing, to appear.
47. Schervish, M. J., and Carlin, B. P. (1992), –On the Convergence of Successive Substitution Sampling,— Journal of Computational and Graphical Statistics, 1, 111-127.
48. Schruben, L. W, (1982) –Detecting Initialization Bias in Simulation Output,— Operations Research, 30, 569-590.
49. Schruben, L., Singh, H., and Tierney, L. (1983), –Optimal Tests for Initialization Bias in Simulation Output,— Operations Research, 31, 11671-178.
50. Spiegelhalter, D. J., Thomas, A., and Best, N. G. (1996), –Computation on Bayesian Graphical Models,— in Bayesian Statistics 5, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Oxford, U. K.: Oxford University Press, to appear.
51. Spiegelhalter, D. J., Thomas, A., Best, N. G., and Gilks, W R. (1994), –BUGS: Bayesian Inference Using Gibbs Sampling, Version 0. 30,— technical report, University of Cambridge, MRC Biostatistics Unit.
52. Swendsen, R. YH., and Wang, I.-S. (1987), –Nonuniversal Critical Dynamics in Monte Carlo Simulations,— Physics Review Letters, 58, 86-88.
53. Thomas, A., Spiegelhalter, D. J., and Gilks, W R. (1992), –BUGS: A Program to Perform Bayesian Inference Using Gibbs Sampling. — in Bayesian Statistics 4, eds. J. M. Bernardo, I. O. Berger, A. P. Dawid, and A. F. M. Smith, Oxford, U. K.: Clarendon Press, pp. 837-842.
54. Tierney, L. (1994), –Markov Chains for Exploring Posterior Distributions— (with discussion), The Annals of Statistics, 22, 1701-1762.
55. Wei, G. C. G., and Tanner, M. A. (1990), –Posterior Computations for Censored Regression Data,— Journal ofthe American Statistical Association, 85, 829-839.
56. Yu, B. (1994), –Monitoring the Convergence of Markov Samplers Based on Estimated £1 Error,— Technical Report 409, University of California at Berkeley, Dept. of Statistics.
57. Yu, B., and Mykland, P. (1994), –Looking at Markov Samplers Through Cusum Path Plots: A Simple Diagnostic Idea,— Technical Report 413, University of California at Berkeley, Dept. of Statistics.
58. Zellner, A., and Min, C.-K. (1995), –Gibbs Sampler Convergence Criteria,— Journal of the American Statistical Association, 90, 921-927.