A simple example of Dirichlet process mixture inconsistency for the number of components

Advances in Neural Information Processing Systems

Volumn , Issue , 2013, Pages

  Miller, Jeffrey W ^a   Harrison, Matthew T ^a  

^a BROWN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DENSITY ESTIMATION; DIRICHLET PROCESS MIXTURE; ELEMENTARY PROOF; NORMAL COMPONENT; NUMBER OF CLUSTERS; NUMBER OF COMPONENTS; POSTERIOR DISTRIBUTIONS; POSTERIOR PROBABILITY;

MIXTURES;

EID: 84898932043     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. S. Ghosal. The Dirichlet process, related priors and posterior asymptotics. In N.L. Hjort, C. Holmes, P. Müller, and S.G.Walker, editors, Bayesian Nonparametrics, pages 36-83. Cambridge University Press, 2010.
2. J.P. Huelsenbeck and P. Andolfatto. Inference of population structure under a Dirichlet process model. Genetics, 175(4):1787-1802, 2007.
3. M. Medvedovic and S. Sivaganesan. Bayesian infinite mixture model based clustering of gene expression profiles. Bioinformatics, 18(9):1194-1206, 2002.
4. E. Otranto and G.M. Gallo. A nonparametric Bayesian approach to detect the number of regimes in Markov switching models. Econometric Reviews, 21(4):477-496, 2002.
5. E.P. Xing, K.A. Sohn, M.I. Jordan, and Y.W. Teh. Bayesian multi-population haplotype inference via a hierarchical Dirichlet process mixture. In Proceedings of the 23rd International Conference on Machine Learning, pages 1049-1056, 2006.
6. P. Fearnhead. Particle filters for mixture models with an unknown number of components. Statistics and Computing, 14(1):11-21, 2004.
7. J.W. Miller and M. T. Harrison. Inconsistency of Pitman-Yor process mixtures for the number of components. arXiv:1309.0024, 2013.
8. M. West, P. Müller, and M.D. Escobar. Hierarchical priors and mixture models, with application in regression and density estimation. Institute of Statistics and Decision Sciences, Duke University, 1994.
9. A. Onogi, M. Nurimoto, and M. Morita. Characterization of a Bayesian genetic clustering algorithm based on a Dirichlet process prior and comparison among Bayesian clustering methods. BMC Bioinformatics, 12(1):263, 2011.
10. A. Nobile. Bayesian Analysis of Finite Mixture Distributions. PhD thesis, Department of Statistics, Carnegie Mellon University, Pittsburgh, PA, 1994.
11. S. Richardson and P.J. Green. On Bayesian analysis of mixtures with an unknown number of components. Journal of the Royal Statistical Society. Series B, 59(4):731-792, 1997.
12. P.J. Green and S. Richardson. Modeling heterogeneity with and without the Dirichlet process. Scandinavian Journal of Statistics, 28(2):355-375, June 2001.
13. A. Nobile and A.T. Fearnside. Bayesian finite mixtures with an unknown number of components: The allocation sampler. Statistics and Computing, 17(2):147-162, 2007.
14. W. Kruijer, J. Rousseau, and A. Van der Vaart. Adaptive Bayesian density estimation with location-scale mixtures. Electronic Journal of Statistics, 4:1225-1257, 2010.
15. P. McCullagh and J. Yang. How many clusters? Bayesian Analysis, 3(1):101-120, 2008.
16. T.S. Ferguson. Bayesian density estimation by mixtures of normal distributions. In M. H. Rizvi, J. Rustagi, and D. Siegmund, editors, Recent Advances in Statistics, pages 287-302. Academic Press, 1983.
17. A. Y. Lo. On a class of Bayesian nonparametric estimates: I. Density estimates. The Annals of Statistics, 12(1):351-357, 1984.
18. M.D. Escobar and M. West. Computing nonparametric hierarchical models. In D. Dey, P.Müller, and D. Sinha, editors, Practical Nonparametric and Semiparametric Bayesian Statistics, pages 1-22. Springer-Verlag, New York, 1998.
19. W. Hoeffding. The strong law of large numbers for U-statistics. Institute of Statistics, Univ. of N. Carolina, Mimeograph Series, 302, 1961.
20. R.L. Graham, D.E. Knuth, and O. Patashnik. Concrete Mathematics. Addison-Wesley, 1989.