Hierarchical Bayesian nonparametric mixture models for clustering with variable relevance determination

Bayesian Analysis

Volumn 6, Issue 2, 2011, Pages 329-352

  Yau, Christopher ^a   Holmes, Chris ^b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Bayesian mixture models; Bayesian nonparametric priors; Unsupervised learning; Variable selection

Indexed keywords

EID: 79958700388     PISSN: 19360975     EISSN: 19316690     Source Type: Journal    
DOI: 10.1214/11-BA612     Document Type: Article

References (37)

1. Andrews, D. and Mallows, C. (1974). "Scale mixtures of normal distributions." Journal of the Royal Statistical Society. Series B (Methodological), 36(1): 99-102.
2. Antoniak, C. (1974). "Mixtures of Dirichlet Processes With Applications to Bayesian Nonparametric Problems." The Annals of Statistics, 2: 1152-1174.
3. Claeskens, G. and Hjort, N. (2008). Model Selection and Model Averaging. Cambridge University Press.
4. Döhner, H., Stilgenbauer, S., Benner, A., Leupolt, E., Kröber, A., Bullinger, L., Dohner, K., Bentz, M., and Lichter, P. (2000). "Genomic aberrations and survival in chronic lymphocytic leukemia." New England Journal of Medicine, 343(26): 1910-1916.
5. Dy, J. and Broadly, C. (2004). "Feature selection for unsupervised learning." Journal of Machine Learning Research, 5: 845-889.
6. Escobar, M. (1994). "Estimating normal means with a Dirichlet process prior." Journal of the American Statistical Association, 89(425): 268-277.
7. Escobar, M. and West, M. (1995). "Bayesian Density Estimation and Inference Using Mixtures." Journal of the American Statistical Association, 90(430): 577-88.
8. Ferguson, T. (1973). "A Bayesian Analysis of Some Nonparametric Problems." The Annals of Statistics, 1(2): 209-230.
9. Fisher, R. (1936). "The use of multiple measurements in taxonomic problems." Annals of Eugenics, 7: 179-188.
10. Fraley, C. and Raftery, A. (2002). "Model-based clustering, discriminant analysis, and density estimation." Journal of the American Statistical Association, 97(458): 611-631.
11. Friedman, J. and Meulman, J. (2004). "Clustering objects on subsets of attributes (with Discussion)." Journal of the Royal Statistical Society, Series B, 66: 815-849.
12. Fruhwirth-Schnatter, S. (2006). Finite Mixture and Markov Switching Models. Springer Series in Statistics. New York: Springer.
13. Green, P. and Richardson, S. (2001). "Modelling Heterogeneity With and Without the Dirichlet Process." Scandinavian Journal of Statistics, 28(2): 355-375.
14. Hastie, T., Tibshirani, R., and Friedman, J. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction (Second Edition). Springer.
15. Hoff, P. (2006). "Model-based subspace clustering." Bayesian Analysis, 1(2): 321-344.
16. Ishwaran, H. and James, L. (2001). "Gibbs sampling methods for stick-breaking priors." Journal of the American Statistical Association, 96: 161-73.
17. Jain, S. and Neal, R. (2000). "A split-merge Markov chain Monte Carlo procedure for the Dirichlet process mixture model." Journal of Computational and Graphical Statistics, 13: 158-82.
18. Jasra, A., Holmes, C., and Stephens, D. (2005). "Markov chain Monte Carlo methods and the label switching problem in Bayesian mixture modeling." Statistical Science, 20(1): 50-67.
19. Kalli, M., Griffin, J., and Walker, S. (2011). "Slice sampling mixture models." Statistics and Computing, 1: 93-105.
20. Kim, S., Tadesse, M., and Vannucci, M. (2006). "Variable selection in clustering via Dirichlet process mixture models." Biometrika, 93(4): 877-893.
21. Knight, S. J. L., Yau, C., Timbs, A., Sadighi-Akha, E., Dreau, H., Burns, A., Oscier, D., Pettitt, A., Holmes, C., Taylor, J., Cazier, J.-B., and Schuh, A. (2011). "A genome-wide array-based sequential analysis quantifies the proportion of sub-clones carrying genomic changes in B-cell chronic lymphocytic leukaemia and reveals the complexity of clonal dynamics." Submitted to Leukemia.
22. Law, M., Figueiredo, M., and Jain, A. (2004). "Simultaneous feature selection and clustering using mixture models." IEEE Transaction on Pattern Analysis and Machine Intelligence, 26(9): 1154-1166.
23. MacEachern, S. (1998). "Estimating mixture of Dirichlet process models." Journal of Computational and Graphical Statistics, 7(2): 223-238.
24. MacKay, D. (1995). "Probable networks and plausible predictions-a review of practical Bayesian methods for supervised neural networks." Network: Computation in Neural Systems, 6(3): 469-505.
25. Maugis, C., Celeux, G., and Martin-Magniette, M. (2009). "Variable Selection for Clustering with Gaussian Mixture Models." Biometrics, 65: 701-709.
26. Neal, R. (2000). "Markov Chain Sampling: Methods for Dirichlet Process Mixture Models." Journal of Computational and Graphical Statistics, 9: 249-265.
27. Neal, R. M. (1996). Bayesian Learning for Neural Networks. Springer-Verlag.
28. Pan, W. and Shen, X. (2007). "Penalized model-based Clustering with Application to Variable Selection." Journal of Machine Learning Research, 8: 1145-1164.
29. Papaspiliopoulos, O. and Roberts, G. O. (2008). "Retrospective Markov chain Monte Carlo for Dirichlet process hierarchical models." Biometrika, 95: 169-186.
30. Raftery, A. and Dean, N. (2006). "Variable selection for model-based clustering." Journal of the American Statistical Association, 101(473): 168-178.
31. Richardson, S. and Green, P. (1997). "On Bayesian analysis of mixtures with an unknown number of components." Journal of the Royal Statistical Society. Series B (Methodological), 59(4): 731-792.
32. Sethuraman, J. (1994). "A Constructive Definition of Dirichlet Priors." Statistica Sinica, 4: 639-50.
33. Stephens, M. (2000). "Bayesian analysis of mixture models with an unknown number of components-an alternative to reversible jump methods." The Annals of Statistics, 28(1): 40-74.
34. Tadesse, M., Sha, N., and Vannucci, M. (2005). "Bayesian Variable Selection in Clustering High-Dimensional Data." Journal of the American Statistical Association, 100(470): 602-618.
35. Tipping, M. (2001). "Sparse Bayesian Learning and the Relevance Vector Machine." Journal of Machine Learning Research, 1: 211-244.
36. Titterington, D., Smith, A., and Makov, U. (1985). Statistical Analysis of Finite Mixture Distributions. New York, Wiley.
37. Walker, S. (2007). "Sampling the Dirichlet mixture model with slices." Communications in Statistics-Simulation and Computation, 36(1-3): 45-54.