Markov chain monte carlo methods for computing bayes factors: A comparative review

Journal of the American Statistical Association

Volumn 96, Issue 455, 2001, Pages 1122-1132

  Han, Cong ^a   Carlin, Bradley P ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Bayesian model choice; Gibbs sampler; Marginal likelihood; Metropolis hastings algorithm; Reversible jump sampler

Indexed keywords

EID: 0442312140     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1198/016214501753208780     Document Type: Article

References (39)

1. Abrams, D. I., Goldman, A. I., Launer, C., Korvick, J. A., Neaton, J. D., Crane, L. R., Grodesky, M., Wakefield, S., Muth, K., Kornegay, S., Cohn, D. L., Harris, A., Luskin-Hawk, R., Markowitz, N., Sampson, J. H., Thompson, M., Deyton, L., and Terry Beirn Community Programs for Clinical Research on AIDS (1994), “Comparative Trial of Didanosine and Zalcitabine in Patients With Human Immunodeficiency Virus Who Are Intolerant of or Have Failed Zidovudine Therapy,” New England Journal of Medicine, 330, 657–662.
2. Albert, J. H., and Chib, S. (1993), “Bayesian Analysis of Binary and Polychotomous Response Data,” Journal of the American Statistical Association, 88, 669–679.
3. Berger, J. O., and Pericchi, L. R. (1996), “The Intrinsic Bayes Factor for Linear Models,” in Bayesian Statistics (Vol. 5) eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Oxford: Oxford University Press, pp. 25–44.
4. J. O. Berger, A. P. Dawid, and A. F. M. Smith, (in press), “Objective Bayesian Methods for Model Selection: Introduction and Comparison,” IMS Lecture Notes Volume on Model Selection, P. Lahiri, ed.
5. Brown, B. W. (1980), “Prediction Analysis for Binary Data,” in Biostatistics Casebook, eds. R. G. Miller, Jr., B. Efron, B. W. Brown, Jr., and L. E. Moses, New York: Wiley, pp. 3–18.
6. Carlin, B. P., and Chib, S. (1995), “Bayesian Model Choice via Markov Chain Monte Carlo Methods,” Journal of the Royal Statistical Society, Ser. B, 57, 473–484.
7. Carlin, B. P., and Louis, T. A. (2000), Bayes and Empirical Bayes Methods for Data Analysis (2nd ed.), Boca Raton, FL: Chapman & Hall/CRC Press.
8. Carlin, B. P., and Polson, N. G. (1992), “Monte Carlo Bayesian Methods for Discrete Regression Models and Categorical Time Series,” in Bayesian Statistics (Vol. 4), eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Oxford: Oxford University Press, pp. 577–586.
9. Chen, M.-H., Shao, Q.-M., and Ibrahim, J. G. (2000), Monte Carlo Methods in Bayesian Computation, New York: Springer-Verlag.
10. Chib, S. (1995), “Marginal Likelihood From the Gibbs Output,” Journal of the American Statistical Association, 90, 1313–1321.
11. Chib, S., and Carlin, B. P. (1999), “On MCMC Sampling in Hierarchical Longitudinal Models,” Statistics and Computing, 9, 17–26.
12. Chib, S., and Greenberg, E. (1998), “Analysis of Multivariate Probit Models,” Biometrika, 85, 347–361.
13. Chib, S., and Jeliazkov, I. (2001), “Marginal Likelihood From the Metropolis–Hastings Output,” Journal of the American Statistical Association, 96, 270–281.
14. Clyde, M., DeSimone, H., and Parmigiani, G. (1996), “Prediction via Orthogonalized Model Mixing,” Journal of the American Statistical Association, 91, 1197–1208.
15. Dellaportas, P., Forster, J. J., and Ntzoufras, I. (in press), “On Bayesian Model and Variable Selection Using MCMC,” Statistics and Computing.
16. Draper, D. (1995), “Assessment and Propagation of Model Uncertainty” (with discussion), Journal of the Royal Statistical Society, Ser. B, 57, 45–97.
17. Gelfand, A. E., Dey, D. K., and Chang, H. (1992), “Model Determination Using Predictive Distributions With implementation via Sampling-Based Methods” (with discussion), in Bayesian Statistics (Vol. 4), eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Oxford: Oxford University Press, pp. 147–167.
18. Gelfand, A. E., and Ghosh, S. K. (1998), “Model Choice: A Minimum Posterior Predictive Loss Approach,” Biometrika, 85, 1–11.
19. Gelfand, A. E., and Smith, A. F. M. (1990), “Sampling-Based Approaches to Calculating Marginal Densities,” Journal of the American Statistical Association, 85, 398–409.
20. Godsill, S. J. (2001), “On the Relationship Between Markov Chain Monte Carlo Methods for Model Uncertainty,” Journal of Computational and Graphical Statistics, 10, 230–248.
21. Goldman, A. I., Carlin, B. P., Crane, L. R., Launer, C., Korvick, J. A., Deyton, L., and Abrams, D. I. (1996), “Response of CD4C and Clinical Consequences to Treatment Using ddI or ddC in Patients with Advanced HIV Infection,” Journal of Acquired Immune Deficiency Syndromes and Human Retrovirology, 11, 161–169.
22. Green, P. J. (1995), “Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination,” Biometrika, 82, 711–732.
23. Green, P. J., and O’Hagan, A. (1998), “Carlin and Chib Do Not Need to Sample From Pseudo-Priors,” Research Report 98-1, Dept. of Statistics, University of Nottingham.
24. Hastings, W. K. (1970), “Monte Carlo Sampling Methods Using Markov Chains and Their Applications,” Biometrika, 57, 97–109.
25. Kass, R. E., and Raftery, A. E. (1995), “Bayes Factors,” Journal of the American Statistical Association, 90, 773–795.
26. Knorr-Held, L., and Rasser, G. (2000), “Bayesian Detection of Clusters and Discontinuities in Disease Maps,” Biometrics, 56, 13–21.
27. Laud, P., and Ibrahim, J. (1995), “Predictive Model selection,” Journal of the Royal Statistical Society, Ser. B, 57, 247–262.
28. Lavine, M., and Schervish, M. J. (1999), “Bayes Factors: What They Are and What They Are Not,” The American Statistician, 53, 119–122.
29. Madigan, D., and York, J. (1995), “Bayesian Graphical Models for Discrete Data,” International Statistical Review, 63, 215–232
30. O’Hagan, A. (1995), “Fractional Bayes Factors for Model Comparison” (with discussion), Journal of the Royal Statistical Society, Ser. B, 57, 99–138.
31. Phillips, D. B., and Smith, A. F. M. (1996), “Bayesian Model Comparison via Jump Diffusions,” in Markov Chain Monte Carlo in Practice, eds. W. R. Gilks, S. Richardson, and D. J. Spiegelhalter, London: Chapman & Hall, pp. 215–239.
32. Raftery, A. E., Madigan, D., and Hoeting, J. A. (1997), “Bayesian Model Averaging for Linear Regression Models,” Journal of the American Statistical Association, 92, 179–191.
33. Richardson, S., and Green, P. J. (1997), “Bayesian Analysis of Mixtures With an Unknown Number of Components,” Journal of the Royal Statistical Society, Ser. B, 59, 731–758.
34. Schwarz, G. (1978), “Estimating the Dimension of a Model,” Annals of Statistics, 6, 461–464.
35. Spiegelhalter, D. J., Best, N., and Carlin, B. P. (1998), “Bayesian Deviance, the Effective Number of Parameters, and the Comparison of Arbitrarily Complex Models,” Research Report 98-009, Division of Biostatistics, University of Minnesota.
36. Stephens, M. (2000), “Bayesian Analysis of Mixture Models With an Unknown Number of Components—an Alternative to Reversible Jump Methods,” Annals of Statistics, 28, 40–74.
37. Troughton, P. T., and Godsill, S. J. (1999), “MCMC Methods for Restoration of Nonlinearly Distorted Autoregressive Signals,” Signal Processing, 81, 83–97.
38. Waller, L. A., Carlin, B. P., Xia, H., and Gelfand, A. E. (1997), “Hierarchical Spatio-Temporal Mapping of Disease Rates,” Journal of the American Statistical Association, 92, 607–617.
39. Williams, E. (1959), Regression Analysis, New York: Wiley.