Variable selection in penalized model-based clustering via regularization on grouped parameters

Biometrics

Volumn 64, Issue 3, 2008, Pages 921-930

  Xie, Benhuai ^a   Pan, Wei ^a   Shen, Xiaotong ^b  

^a UNIVERSITY OF MINNESOTA   (United States)

^b UNIVERSITY OF MINNESOTA   (United States)

Author keywords

BIC; Diagonal covariance; EM algorithm; High dimension but low sample size; Microarray gene expression; Mixture model; Penalized likelihood

Indexed keywords

BIC; DIAGONAL COVARIANCE; EM ALGORITHMS; HIGH-DIMENSION BUT LOW-SAMPLE SIZE; HIGHER DIMENSIONS; MICROARRAY GENE EXPRESSION; MIXTURE MODELING; PENALIZED LIKELIHOOD; PENALIZED-LIKELIHOOD; SAMPLE SIZES;

GENE EXPRESSION;

ALGORITHM; CANCER; COVARIANCE ANALYSIS; GENE EXPRESSION; GENOMICS; MODEL; PANEL DATA;

ARTICLE; CLUSTER ANALYSIS; GENE EXPRESSION; MICROARRAY ANALYSIS; PARAMETER; PENALIZED MODEL BASED CLUSTERING; SIMULATION;

EID: 49749148013     PISSN: 0006341X     EISSN: 15410420     Source Type: Journal    
DOI: 10.1111/j.1541-0420.2007.00955.x     Document Type: Article

References (34)

1. Choi, N. H. and Zhu, J. (2006). Variable selection with strong hierarchy constraints and its application to identification of gene-gene and gene-environment interactions. Technical Report 453, Department of Statistics, University of Michigan, Ann Arbor, Michigan.
2. Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm (with discussion). Journal of the Royal Statistical Society, Series B 39, 1 38.
3. Dudoit, S., Fridlyand, J., and Speed, T. (2002). Comparison of discrimination methods for the classification of tumors using gene expression data. Journal of the American Statistical Association 97, 77 87.
4. Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004). Least angle regression. Annals of Statistics 32, 407 499.
5. Eisen, M., Spellman, P., Brown, P., and Botstein, D. (1998). Cluster analysis and display of genome-wide expression patterns. PNAS 95, 14863 14868.
6. Friedman, J. H. and Meulman, J. J. (2004). Clustering objects on subsets of attributes (with discussion), Journal of the Royal Statistical Society, Series B 66, 1 25.
7. Ghosh, D. and Chinnaiyan, A. M. (2002). Mixture modeling of gene expression data from microarray experiments. Bioinformatics 18, 275 286.
8. Golub T. R., Slonim, D. K., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J. P., Coller, H., Loh, M. L., Downing, J. R., Caligiuri, M. A., Bloomfield, C. D., Lander, E. S., et al 1999). Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring. Science 286, 531 537.
9. Hastie, T., Tibshirani, R., and Friedman, J. (2001). The Elements of Statistical Learning. Data Mining, Inference, and Prediction. New York : Springer.
10. Hoff, P. D. (2005). Subset clustering of binary sequences, with an application to genomic abnormality data. Biometrics 61, 1027 1036.
11. Hoff, P. D. (2006). Model-based subspace clustering. Bayesian Analysis 1, 321 344.
12. Kanehisa, M. and Goto, S. (2000). KEGG: Kyoto Encyclopedia of Genes and Genomes. Nucleic Acids Research 28, 27 30.
13. Kim, S., Tadesse, M. G., and Vannucci, M. (2006). Variable selection in clustering via Dirichlet process mixture models. Biometrika 93, 877 893.
14. Li H. and Hong F. (2001). Cluster-Rasch models for microarray gene expression data. Genome Biology 2, research0031.1-0031.13.
15. Liu, J. S., Zhang, J. L., Palumbo, M. J., and Lawrence, C. E. (2003). Bayesian clustering with variable and transformation selection (with discussion). Bayesian Statistics 7, 249 275.
16. Mangasarian, O. L. and Wild, E. W. (2004). Feature selection in k-median clustering. Proceedings of SIAM International Conference on Data Mining, Workshop on Clustering High Dimensional Data and its Applications, April 24, 2004, La Buena Vista, Florida, pp. 23 28.
17. McLachlan, G. J., Bean, R. W., and Peel, D. (2002). A mixture model-based approach to the clustering of microarray expression data. Bioinformatics 18, 413 422.
18. Pan, W. and Shen, X. (2007). Penalized model-based clustering with application to variable selection. Journal of Machine Learning Research 8, 1145 1164.
19. Pan, W., Shen, X., Jiang, A., and Hebbel, R. P. (2006). Semi-supervised learning via penalized mixture model with application to microarray sample classification Bioinformatics 22, 2388 2395.
20. Park, M. and Hastie, T. (2007). An L1 regularization-path algorithm for generalized linear models. Journal of the Royal Statistical Society, Series B 69, 659 677.
21. Raftery, A. E. and Dean, N. (2006). Variable selection for model-based clustering. Journal of the American Statistical Association 101, 168 178.
22. Rand, W. M. (1971). Objective criteria for the evaluation of clustering methods. Journal of the American Statistical Association 66, 846 850.
23. Shipp, M. A., Ross, K. N., Tamayo, P, et al 2002). Diffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning. Nature Medicine 8, 68 74.
24. Tadesse, M. G., Sha, N., and Vannucci, M. (2005). Bayesian variable selection in clustering high-dimensional data. Journal of the American Statistical Association 100, 602 617.
25. Tibshirani, R. (1996). Regression shrinkage and selection via the Lasso. Journal of the Royal Statistical Society, Series B 58, 267 288.
26. Wang, S. and Zhu, J. (2006). Variable selection for model-based high-dimensional clustering and its application to microarray data. Technical Report 449, Department of Statistics, University of Michigan, Ann Arbor, Michigan.
27. Wang, S. and Zhu, J. (2007). Improved centroids estimation for the nearest shrunken centroid classifier. Bioinformatics 23, 972 979.
28. Wu, C. F. J. (1983). On the convergence properties of the EM algorithm. Annals of Statistics 11, 95 103.
29. Xie, B., Pan, W., and Shen, X. (2007). Penalized model-based clustering with cluster-specific diagonal covariances and grouped variables. Available at http://www.biostat.umn.edu./rrs.php as Research Report 2007-017, Division of Biostatistics, University of Minnesota, Minneapolis, Minnesota.
30. Yeung, K. Y., Fraley C., Murua A., Raftery A. E., and Ruzzo, W. L. (2001). Model-based clustering and data transformations for gene expression data. Bioinformatics 17, 977 987.
31. Yuan, M. and Lin, Y. (2006). Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society, Series B 68, 49 67.
32. Zhao, P., Rocha, G., and Yu, B. (2006). Grouped and hierarchical model selection through composite absolute penalties. Technical Report, Department of Statistics, University of California, Berkeley.
33. Zhou, N. and Zhu, J. (2007). Group variable selection via a hierarchical Lasso and its Oracle property. Technical Report 464, Department of Statistics, University of Michigan, Ann Arbor, Michigan.
34. Zou H., Hastie T, Tibshirani R. (2007). On the "degrees of freedom" of the lasso. Annals of Statistics 35, 2173 2192.