Marginal likelihood and bayes factors for Dirichlet process mixture models

Journal of the American Statistical Association

Volumn 98, Issue 461, 2003, Pages 224-235

  Basu, Sanjib ^a   Chib, Siddhartha ^b  

^a NORTHERN ILLINOIS UNIVERSITY   (United States)

^b WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

Author keywords

Bayes factor; Bayesian model comparison; Dirichlet process mixture; Marginal likelihood; Semiparametric binary data model; Semiparametric longitudinal data model

Indexed keywords

EID: 0037361675     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/01621450338861947     Document Type: Article

References (42)

1. Albert, J., and Chib, S. (1993), "Bayesian Analysis of Binary and Polychotomous Response Data," Journal of American Statistical Association, 88, 669-679.
2. Basu, S., and Mukhopadhyay, S. (2000), "Binary Response Regression With Normal Scale Mixture Links," in Generalized Linear Models: A Bayesian Perspective, eds. D. K. Dey, S. K. Ghosh, and B. K. Mallick, New York: Marcel Dekker, pp. 231-242.
3. Berger, J. O., and Guglielmi, A. (2001), "Bayesian and Conditional Frequentist Testing of a Parametric Model Versus Nonparametric Alternatives," Journal of American Statistical Association, 96, 174-184.
4. Blackwell, D., and MacQueen, J. B. (1973), "Ferguson Distributions via Polya Urn Schemes," The Annals of Statistics, 1, 353-355.
5. Brown, B. W. (1980), "Prediction Analysis for Binary Data," in Biostatistics Casebook, eds. R. J. Miller, B. Efron, B. W. Brown, and L. E. Moses, New York: Wiley.
6. Bush, C. A., and MacEachern, S. N. (1996), "A Semiparametric Bayesian Model for Randomised Block Designs," Biometrika, 88, 275-285.
7. Carlin, B. P., and Louis, T. A. (2000), Bayes and Empirical Bayes Methods for Data Analysis, (2nd ed.), New York: Chapman Hall/CRC.
8. Carota, C., and Parmigiani, G. (1996), "On Bayes Factor for Nonparametric Alternatives," in Bayesian Statistics 5, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, London: Oxford University Press, pp. 507-511.
9. Chib, S. (1995), "Marginal Likelihood From the Gibbs Output," Journal of the American Statistical Association, 90, 1313-1321.
10. Chib, S., and Carlin, B. (1999), "On MCMC Sampling in Hierarchical Longitudinal Models," Statistics and Computing, 9, 17-26.
11. Chib, S., and Greenberg, E. (1995), "Understanding the Metropolis-Hastings Algorithm," The American Statistician, 49, 327-335.
12. Chib S., and Jeliazkov, I. (2001), "Marginal Likelihood From the Metropolis-Hastings Output," Journal of the American Statistical Association, 96, 270-281.
13. Erkanli, A., Stangl, D., and Müller, P. (1993), "A Bayesian Analysis of Ordinal Data Using Mixtures," in Proceedings of the Section on Bayesian Statistical Science, American Statistical Association, pp. 51-56.
14. Escobar, M. D. (1988), "Estimating the Means of Several Normal Populations by Nonparametric Estimation of the Distribution of the Means," unpublished doctoral dissertation, Yale University.
15. _ (1994), "Estimating Normal Means With a Dirichlet Process Prior," Journal of the American Statistical Association, 89, 268-277.
16. Escobar, M. D., and West, M. (1995), "Bayesian Density Estimation and Inference Using Mixtures," Journal of the American Statistical Association, 90, 577-588.
17. Ferguson, T. S. (1973), "A Bayesian Analysis of Some Nonparametric Problems," The Annals of Statistics, 1, 209-230.
18. _ (1983), "Bayesian Density Estimation By Mixtures of Normal Distributions,'' in Recent Advances in Statistics: Papers in Honor of Herman Chernoff on His Sixtieth Birthday, New York: Academic Press, pp. 287-302.
19. Florens, J. P., Richard, J. F. and Rolin, J. M. (1996), "Bayesian Encompassing Specification Tests of a Parametric Model Against a Nonparametric Alternative," technical report, University of Pittsburgh, Dept. of Economics.
20. Gelfand, A., Hills, S. E., Racine-Poon, A., and Smith, A. F. M. (1990), "Illustration of Bayesian Inference in Normal Data Models Using Gibbs Sampling," Journal of the American Statistical Association, 85, 972-985.
21. Good, I. J. (1985), "Weight of Evidence; A Brief Survey," in Bayesian Statistics 2, eds. J. M. Bernardo et al., New York: Elsevier, pp. 249-269.
22. Han, C., and Carlin, B. P. (2001), "MCMC Methods for Computing Bayes Factors: A Comparative Review," Journal of the American Statistical Association, 96, 1122-1132.
23. Irwin, M., Cox, N., and Kong, A. (1994), "Sequential Imputation for Multilocus Linkage Analysis," Proceedings of the National Academy of Science USA, 91, 11684-11688.
24. Ishwaran, H., and James, L. F. (2001a), "Gibbs Sampling Methods for Stick-Breaking Priors," Journal of the American Statistical Association, 96, 161-173.
25. _ (2001b), "Generalized Weighted Chinese Restaurant Processes for Species Sampling Mixture Models," unpublished manuscript.
26. Ishwaran, H., James, L. F., and Sun, J. (2001), "Bayesian Model Selection in Finite Mixtures by Marginal Density Decomposition," Journal of the American Statistical Association, 96, 1316-1332.
27. Ishwaran, H., and Takahara, G. (2002), "Independent and Identically Distributed Monte Carlo Algorithms for Semiparametric Linear Mixed Models," Journal of the American Statistical Association, 97, 1154-1166.
28. Kleinman, K. P., and Ibrahim, J. G. (1998), "A Semiparametric Bayesian Approach to the Random Effects Model," Biometrics, 54, 921-938.
29. Kong, A., Liu, J. S., and Wong, W. H. (1994), "Sequential Imputations and Bayesian Missing Data Problems," Journal of the American Statistical Association, 89, 278-288.
30. Kuo, L. (1986), "Computations of Mixtures of Dirichlet Processes," SIAM Journal on Scientific and Statistical Computing, 7, 60-71.
31. Liu, J. S. (1996), "Nonparametric Hierarchical Bayes via Sequential Imputations," The Annals of Statistics, 24, 911-930.
32. _ (2001), Monte Carlo Strategies in Scientific Computing, New York: Springer-Verlag.
33. Lo, A. Y. (1984), "On a Class of Bayesian Nonparametric Estimates: I. Density Estimates," The Annals of Statistics, 12, 351-357.
34. Lo, A. Y., Brunner, L. J., and Chan, A. T. (1996), "Weighted Chinese Restaurant Processes and Bayesian Mixture Models," Research Report 1, Hong Kong University of Science and Technology.
35. MacEachern, S. N. (1994), "Estimating Normal Means With a Conjugate Style Dirichlet Process Prior," Communications in Statistics: Simulation and Computation, 23, 727-741.
36. MacEachern, S. N., Clyde, M., and Liu, J. S. (1999), "Sequential Importance Sampling for Nonparametric Bayes Models: The Next Generation," Canadian Journal of Statistics, 27, 251-267.
37. MacEachern, S. N., and Müller, P. (1998), "Estimating Mixtures of Dirichlet Process Models," Journal of Computational and Graphical Statistics, 7, 223-238.
38. Newton, M. A., Czado, C., and Chappell, R. (1996), "Bayesian Inference for Semiparametric Binary Regression," Journal of the American Statistical Association, 91, 142-153.
39. Quintana, F. A. (1998), "Nonparametric Bayesian Analysis for Assessing Homogeneity in k × L Contingency Tables With Fixed Right Margin Totals," Journal of the American Statistical Association, 93, 1140-1149.
40. Quintana, F. A., and Newton, M. (2000), "Computational Aspects of Nonparametric Bayesian Analysis With Applications to the Modeling of Multiple Binary Sequences," Journal of Computational and Graphical Statistics, 9, 711-737.
41. Sethuraman, J. (1994), "A Constructive Definition of Dirichlet Priors," Statistica Sinica, 4, 639-650.
42. Tao, H., Palta, M., Yandell, B. S., and Newton, M. A. (1999), "An Estimation Method for the Semiparametric Mixed Effects Model," Biometrics, 55, 102-110.