A Split-Merge Markov Chain Monte Carlo Procedure for the Dirichlet Process Mixture Model

Journal of Computational and Graphical Statistics

Volumn 13, Issue 1, 2004, Pages 158-182

  Jain, Sonia ^a   Neal, Radford M ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

Gibbs sampler; Latent class analysis; Metropolis Hastings algorithm

Indexed keywords

EID: 1842486852     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/1061860043001     Document Type: Article

References (23)

1. Antoniak, C. E. (1974), "Mixtures of Dirichlet Processes With Applications to Bayesian Nonparametric Problems," The Annals of Statistics, 2, 1152-1174.
2. Blackwell, D., and MacQueen, J. B. (1973), "Ferguson Distributions via Pólya Urn Schemes," The Annals of Statistics, 1, 353-355.
3. Bush, C. A., and MacEachern, S. N. (1996), "A Semiparametric Bayesian Model for Randomised Block Designs," Biometrika, 83, 275-285.
4. Celeux, G., Hurn, M., and Robert, C. P. (2000), "Computational and Inferential Difficulties With Mixture Posterior Distributions," Journal of the American Statistical Association, 95, 957-970.
5. Escobar, M. D. (1994), "Estimating Normal Means With a Dirichlet Process Prior," Journal of the American Statistical Association, 89, 268-277.
6. Escobar, M. D., and West, M. (1995), "Bayesian Density Estimation and Inference Using Mixtures," Journal of the American Statistical Association, 90, 577-588.
7. Everitt, B. S. (1984), An Introduction to Latent Variable Models, London: Chapman and Hall.
8. Everitt, B. S., and Hand, D. J. (1981), Finite Mixture Distributions, London: Chapman and Hall.
9. Ferguson, T. S. (1983), "Bayesian Density Estimation by Mixtures of Normal Distributions," in Recent Advances in Statistics, eds. H. Rizvi and J. Rustagi, New York: Academic Press, pp. 287-303.
10. Gelman, A., and Meng, X.-L. (1998), "Simulating Normalizing Constants: From Importance Sampling to Bridge Sampling to Path Sampling," Statistical Science, 13, 163-185.
11. Gilks, W. R., Richardson, S., and Spiegelhalter, D. J. (eds.) (1996), Markov Chain Monte Carlo in Practice, London: Chapman and Hall.
12. Green, P. J., and Richardson, S. (2001), "Modelling Heterogeneity With and Without the Dirichlet Process," Scandinavian Journal of Statistics, 28, 355-375.
13. Hastings, W. K. (1970), "Monte Carlo Sampling Methods Using Markov Chains and Their Applications," Biometrika, 57, 97-109.
14. Jain, S. (2002), "Split-Merge Techniques for Bayesian Mixture Models," unpublished Ph.D. dissertation, University of Toronto, Department of Statistics.
15. MacEachern, S. N. (1994), "Estimating Normal Means With a Conjugate Style Dirichlet Process Prior," Communications in Statistics: Simulation and Computation, 23, 727-741.
16. _ (1998), "Computational Methods for Mixture of Dirichlet Process Models," in Practical Nonparametric and Semiparametric Bayesian Statistics, eds. D. Dey et al., New York: Springer-Verlag, pp. 23-43.
17. McLachlan, G. J., and Basford, K. E. (1988), Mixture Models: Inference and Applications to Clustering, New York: Marcel Dekker.
18. Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., and Teller, E. (1953), "Equation of State Calculations by Fast Computing Machines," Journal of Chemical Physics, 21, 1087-1092.
19. Neal, R. M. (1992), "Bayesian Mixture Modeling," in Maximum Entropy and Bayesian Methods: Proceedings of the 11th International Workshop on Maximum Entropy and Bayesian Methods of Statistical Analysis, eds. C. R. Smith, G. J. Erickson, and P. O. Neudorfer, Seattle, 1991, Dordrecht: Kluwer Academic Publishers, pp. 197-211.
20. _ (2000), "Markov Chain Sampling Methods for Dirichlet Process Mixture Models," Journal of Computational and Graphical Statistics, 9, 249-265.
21. Ripley, B. D. (1987), Stochastic Simulation, New York: Wiley.
22. Tierney, L. (1994), "Markov Chains for Exploring Posterior Distributions" (with discussion), The Annals of Statistics, 22, 1701-1762.
23. Titterington, D. M., Smith, A. F. M., and Makov, U. E. (1985), Statistical Analysis of Finite Mixture Distributions, Chichester, New York: Wiley.