A framework for feature selection in clustering

Journal of the American Statistical Association

Volumn 105, Issue 490, 2010, Pages 713-726

  Witten, Daniela M ^a   Tibshirani, Robert ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

means clustering; Hierarchical clustering; High dimensional; Lasso; Model selection; Sparsity; Unsupervised learning

Indexed keywords

EID: 77954603019     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/jasa.2010.tm09415     Document Type: Article

References (36)

1. Boyd, S., and Vandenberghe, L. (2004), Convex Optimization, Cambridge, U.K.: Cambridge University Press. [715]
2. Chang, W.-C. (1983), "On Using Principal Components Before Separating a Mixture of Two Multivariate Normal Distributions," Journal of the Royal Statistical Society, Ser. C, 32, 267-275. [713]
3. Chipman, H., and Tibshirani, R. (2005), "Hybrid Hierarchical Clustering With Applications to Microarray Data," Biostatistics, 7, 286-301. [716]
4. Dempster, A., Laird, N., and Rubin, D. (1977), "Maximum Likelihood From Incomplete Data via the EM Algorithm" (with discussion), Journal of the Royal Statistical Society, Ser. B, 39, 1-38. [714]
5. Eisen, M., Spellman, P., Brown, P., and Botstein, D. (1998), "Cluster Analysis and Display of Genome-Wide Expression Patterns," Proceedings of the National Academy of Sciences of the USA, 95, 14863-14868. [722]
6. Fan, J., and Li, R. (2001), "Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties," Journal of the American Statistical Association, 96, 1348-1360. [715]
7. Fraley, C., and Raftery, A. (2002), "Model-Based Clustering, Discriminant Analysis, and Density Estimation," Journal of the American Statistical Association, 97, 611-631. [714]
8. Friedman, J., and Meulman, J. (2004), "Clustering Objects on Subsets of Attributes," Journal of the Royal Statistical Society, Ser. B, 66, 815-849. [714,717,725]
9. Ghosh, D., and Chinnaiyan, A.M. (2002), "MixtureModelling of Gene Expression Data From Microarray Experiments," Bioinformatics, 18, 275-286. [713,717]
10. International HapMap Consortium (2005), "A Haplotype Map of the Human Genome," Nature, 437, 1299-1320. [723]
11. -(2007), "A Second Generation Human Haplotype Map of Over 3.1 Million SNPs," Nature, 449, 851-861. [723]
12. Kaufman, L., and Rousseeuw, P. (1990), Finding Groups in Data: An Introduction to Cluster Analysis, New York: Wiley. [716,717]
13. Lee, D. D., and Seung, H. S. (1999), "Learning the Parts of Objects by Non- Negative Matrix Factorization," Nature, 401, 788. [713]
14. -(2001), "Algorithms for Non-Negative Matrix Factorization," in Advances in Neural Information Processing Systems (NIPS 2001), Vancouver, BC, Canada. [713]
15. Liu, J. S., Zhang, J. L., Palumbo, M. J., and Lawrence, C. E. (2003), "Bayesian Clustering With Variable and Transformation Selections," in Bayesian Statistics 7, eds. J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith, and M. West, Oxford: Clarendon Press, pp. 249-275. [713,717]
16. Lv, J., and Fan, Y. (2009), "A Unified Approach to Model Selection and Sparse Recovery Using Regularized Least Squares," The Annals of Statistics, 37, 3498-3528. [715]
17. MacQueen, J. (1967), "Some Methods for Classification and Analysis of Multivariate Observations," in Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, eds. L. M. LeCamand J. Neyman, Berkeley, CA: University of California Press, pp. 281-297. [716]
18. Maugis, C., Celeux, G., and Martin-Magniette, M.-L. (2009), "Variable Selection for Clustering With Gaussian Mixture Models," Biometrics, 65, 701- 709. [714]
19. McLachlan, G. J., and Peel, D. (2000), Finite Mixture Models, New York: Wiley. [714]
20. McLachlan, G. J., Bean, R. W., and Peel, D. (2002), "A Mixture Model-Based Approach to the Clustering of Microarray Expression Data," Bioinformatics, 18, 413-422. [714]
21. McLachlan, G. J., Peel, D., and Bean, R. W. (2003), "Modelling High- Dimensional Data by Mixtures of Factor Analyzers," Computational Statistics and Data Analysis, 41, 379-388. [714]
22. Milligan, G. W., and Cooper, M. C. (1985), "An Examination of Procedures for Determining the Number of Clusters in a Data Set," Psychometrika, 50, 159-179. [716]
23. Nowak, G., and Tibshirani, R. (2008), "Complementary Hierarchical Clustering," Biostatistics, 9 (3), 467-483. [720]
24. Pan, W., and Shen, X. (2007), "Penalized Model-Based Clustering With Application to Variable Selection," Journal of Machine Learning Research, 8, 1145-1164. [714,717,718]
25. Perou, C. M., Sorlie, T., Eisen, M. B., Rijn, M. V. D., Jeffrey, S. S., Rees, C. A., Pollack, J. R., Ross, D. T., Johnsen, H., Akslen, L. A., Fluge, O., Pergamenschikov, A., Williams, C., Zhu, S. X., Lonning, P. E., Borresendale, A., Brown, P. O., and Botstein, D. (2000), "Molecular Portraits of Human Breast Tumours," Nature, 406, 747-752. [721,722]
26. Price, A. L., Patterson, N. J., Weinblatt, M. E., Shadick, N. A., and Reich, D. (2006), "Principal Components Analysis Corrects for Stratification in Genome-Wide Association Studies," Nature Genetics, 38, 904-909. [725]
27. Raftery, A., and Dean, N. (2006), "Variable Selection for Model-Based Clustering," Journal of the American Statistical Association, 101, 168-178. [714,717,718]
28. Rand,W. M. (1971), "Objective Criteria for the Evaluation of Clustering Methods," Journal of the American Statistical Association, 66, 846-850. [717]
29. Sugar, C. A., and James, G. M. (2003), "Finding the Number of Clusters in a Dataset: An Information-Theoretic Approach," Journal of the American Statistical Association, 98, 750-763. [716]
30. Tamayo, P., Scanfeld, D., Ebert, B. L., Gillette, M. A., Roberts, C. W. M., and Mesirov, J. P. (2007), "Metagene Projection for Cross-Platform, Cross- Species Characterization of Global Transcriptional States," PNAS, 104, 5959-5964. [713,717]
31. Tibshirani, R., and Walther, G. (2005), "Cluster Validation by Prediction Strength," Journal of Computational and Graphical Statistics, 14 (3), 511- 528. [716]
32. Tibshirani, R., Walther, G., and Hastie, T. (2001), "Estimating the Number of Clusters in a Dataset via the Gap Statistic," Journal of the Royal Statistical Society, Ser. B., 32 (2), 411-423. [716]
33. Troyanskaya, O., Cantor,M., Sherlock, G., Brown, P., Hastie, T., Tibshirani, R., Botstein, D., and Altman, R. (2001), "Missing Value Estimation Methods for DNA Microarrays," Bioinformatics, 16, 520-525. [724]
34. Wang, S., and Zhu, J. (2008), "Variable Selection for Model-Based High- Dimensional Clustering and Its Application to Microarray Data," Biometrics, 64, 440-448. [714]
35. Witten, D., Tibshirani, R., and Hastie, T. (2009), "A Penalized Matrix Decomposition, With Applications to Sparse Principal Components and Canonical Correlation Analysis," Biostatistics, 10 (3), 515-534. [715,719,721]
36. Xie, B., Pan,W., and Shen, X. (2008), "Penalized Model-Based ClusteringWith Cluster-Specific Diagonal Covariance Matrices and Grouped Variables," Electronic Journal of Statistics, 2, 168-212. [714]