Variable selection for model-based clustering

Journal of the American Statistical Association

Volumn 101, Issue 473, 2006, Pages 168-178

  Raftery, Adrian E ^a   Dean, Nema ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Bayes factor; BIC; Feature selection; Model based clustering; Unsupervised learning; Variable selection

Indexed keywords

EID: 33645505223     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/016214506000000113     Document Type: Article

References (41)

1. Andersen, E. (1935), "The Irises of the Gaspé Peninsula," Bulletin of the American Iris Society, 59, 2-5.
2. _ (1936), "The Species Problem in Iris," Annals of the Missouri Botanical Garden, 23, 457-509.
3. Badsberg. J. H. (1992), "Model Search in Contingency Tables by CoCo," in Computational Statistics, Vol. 1, eds. Y. Dodge and J. Whittaker, Heidelberg: Physica-Verlag, pp. 251-256.
4. Banfield, J. D., and Raftery, A. E. (1993), "Model-Based Gaussian and Non-Gaussian Clustering," Biometrics, 48, 803-821.
5. Becker, M. P., and Yang, I. (1998), "Latent Class Marginal Models for Cross-Classifications of Counts," Sociological Methodology, 28, 293-326.
6. Brodatz, P. (1966), Textures: A Photographic Album for Artists and Designers, New York: Dover.
7. Brusco, M. J., and Cradit, J. D. (2001), "A Variable Selection Heuristic for k-Means Clustering," Psychometrika, 66, 249-270.
8. Campbell, N. A., and Mahon, R. J. (1974), "A Multivariate Study of Variation in Two Species of Rock Crab of Genus Leplograpsus," Australian Journal of Zoology, 22, 417-425.
9. Celeux, G., and Govaert, G. (1995), "Gaussian Parsimonious Clustering Models," Pattern Recognition, 28, 781-793.
10. Chakrabarti, K., and Mehrotra, S. (2000), "Local Dimensionality Reduction: A New Approach to Indexing High-Dimensional Spaces," The VLDB Journal, 89-100.
11. Chang, W. C. (1983), "On Using Principal Components Before Separating a Mixture of Two Multivariate Normal Distributions," Applied Statistics, 32, 267-275.
12. Chickering, D. M., and Heckerman, D. (1997), "Efficient Approximations for the Marginal Likelihood of Bayesian Networks With Hidden Variables," Machine Learning, 29, 181-212.
13. Clogg, C. C., and Goodman, L. A. (1984), Latent Structure Analysis of a Set of Multidimensional Contingency Tables," Journal of the American Statistical Association, 79, 762-771.
14. Desarbo, W. S., Carroll, J. D., Clarck, L. A., and Green, P. E. (1984), "Synthesized Clustering: A Method for Amalgamating Clustering Bases With Differential Weighting of Variables," Psychometrika, 49, 57-78.
15. Devaney, M., and Ram, A. (1997), "Efficient Feature Selection in Conceptual Clustering," in Machine Learning: Proceedings of the Fourteenth International Conference, Nashville, TN, pp. 92-97.
16. Ding, C., He, X., Zha, H., and Simon, H. D. (2002), "Adaptive Dimension Reduction for Clustering High-Dimensional Data," in Proceedings of the IEEE International Conference on Data Mining, Maebashi, Japan, pp. 147-154.
17. Dy, J. G., and Brodley, C. E. (2000), "Feature Subset Selection and Order Identification for Unsupervised Learning," in Proceedings of the Seventeenth International Conference on Machine Learning, San Francisco, CA, pp. 247-254.
18. Fisher, R. A. (1936), "The Use of Multiple Measurements in Taxonomic Problems," Annals of Eugenics, 1, 179-188.
19. Fraley, C., and Raftery, A. E. (2002), "Model-Based Clustering, Discriminant Analysis, and Density Estimation," Journal of the American Statistical Association, 97, 611-631.
20. _ (2003), "Enhanced Software for Model-Based Clustering," Journal of Classification, 20, 263-286.
21. Friedman, J. H., and Meulman, J. J. (2004), "Clustering Objects on Subsets of Attributes" (with discussion), Journal of the Royal Statistical Society, Ser. B, 66, 1-25.
22. Getz, G., Levine, E., and Domany, E. (2000), "Coupled Two-Way Clustering Analysis of Gene Microarray Data," Proceedings of the National Academy of Sciences USA, 97, 12079-12084.
23. Gnanadesikan, R., Kettenring, J. R., and Tsao, S. L. (1995), "Weighting and Selection of Variables for Cluster Analysis," Journal of Classification, 12, 113-136.
24. Green, P. E., and Krieger, A. M. (1995), "Alternative Approaches to Cluster-Based Market Segmentation," Journal of the Market Research Society, 37, 221-239.
25. Guérin-Dugué, A., and Avilez-Cruz, C. (1993), "High-Order Statistics From Natural Textured Images," in ATHOS Workshop on System Identification and High-Order Statistics, Sophia-Antipolis, France.
26. Kass, R. E., and Raftery, A. E. (1995), "Bayes Factors," Journal of the American Statistical Association, 90, 773-795.
27. Keribin, C. (1998), "Consistent Estimate of the Order of Mixture Models," Comptes Rendues de l'Academie des Sciences, Série 1-Mathématiques, 326, 243-248.
28. Law, M. H., Jain, A. K., and Figueiredo, M. A. T. (2002), "Feature Selection in Mixture-Based Clustering," in Proceedings of Conference of Neural Information Processing Systems, Vancouver.
29. Lazzeroni, L., and Owen, A. (2002), "Plaid Models for Gene Expression Data," Statistica Sinica, 12, 61-86.
30. Liu, J. S., Zhang, J. L., Palumbo, M. J., and Lawrence, C. E. (2003), "Bayesian clustering With Variable and Transformation Selections," in Bayesian Statistics, Vol. 7, eds. J. M. Bernardo, M. J. Bayarri, A. P. Dawid, J. O. Berger, D. Heckerman, A. F. M. Smith, and M. West, Oxford, U.K.: Oxford University Press, pp. 249-275.
31. McCallum, A., Nigam, K., and Ungar, L. (2000), "Efficient Clustering of High-Dimensional Data Sets With Application to Reference Matching," in Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 169-178.
32. McLachlan, G. J., Bean, R., and Peel, D. (2002), "A Mixture Model-Based Approach to the Clustering of Microarray Expression Data," Bioinformatics, 18, 413-422.
33. McLachlan, G. J., and Peel, D. (1998), "Robust Cluster Analysis via Mixtures of Multivariate t-Distributions," in Lecture Notes in Computer Science, Vol. 1451, eds. P. P. A. Amin, D. Don, and H. Freeman, Berlin: Springer-Verlag, pp. 658-666.
34. _ (2000), Finite Mixture Models, New York: Wiley.
35. Miller, A. J. (1990), Subset Selection in Regression, London: Chapman & Hall.
36. Mitra, P., Murthy, C. A., and Pal, S. K. (2002), "Unsupervised Feature Selection Using Feature Similarity," IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 301-312.
37. Ripley, B. D. (1996), Pattern Recognition and Neural Networks, Cambridge, U.K.: Cambridge University Press.
38. Talavera, L. (2000), "Dependency-Based Feature Selection for Clustering Symbolic Data," Intelligent Data Analysis, 4, 19-28.
39. Vaithyanathan, S., and Dom, B. (1999), "Generalized Model Selection for Unsupervised Learning in High Dimensions," in Proceedings of Neural Information Processing Systems, eds. S. A. Solla, T. K. Leen, and K. R. Muller, Cambridge, MA: MIT Press, pp. 970-976.
40. Wolfe, J. H. (1963), "Object Cluster Analysis of Social Areas," master's thesis, University of California, Berkeley.
41. Yeung, K. Y., and Ruzzo, W. L. (2001), "Principal Component Analysis for Clustering Gene Expression Data," Bioinformatics, 17, 763-774.