Consensus group stable feature selection

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2009, Pages 567-575

  Loscalzo, Steven ^a   Yu, Lei ^a   Ding, Chris ^b  

^a State University of New York at Binghamton   (United States)

^b The University of Texas at Arlington   (United States)

Author keywords

Ensemble; Feature selection; High dimensional data; Small sample; Stability

Indexed keywords

ENSEMBLE; FEATURE GROUPS; FEATURE SELECTION; FEATURE SELECTION ALGORITHM; GENERALIZATION PERFORMANCE; HIGH-DIMENSIONAL; HIGH-DIMENSIONAL DATA; REAL WORLD DATA; SAMPLE SIZES; SMALL SAMPLE; SMALL SAMPLE SIZE; SMALL SAMPLES; SOURCE CODES; SYNTHETIC DATASETS; TRAINING SAMPLE;

SET THEORY; STABILITY;

FEATURE EXTRACTION;

EID: 70350686854     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1557019.1557084     Document Type: Conference Paper

References (27)

1. A. Appice, M. Ceci, S. Rawles, and P. Flach. Redundant feature elimination for multi-class problems. In Proceedings of the 21st International Conference on Machine learning, pages 33{40, 2004.
2. E. Bauer and R. Kohavi. An empirical comparison of voting classification algorithms: Bagging, boosting, and variants. Machine Learning, 36:105-142, 1999.
3. X. Chen and J. C. Joeng. Minimum reference set based feature selection for small sample classifications. In Proceedings of the 24th international conference on Machine learning, pages 153-160, 2007.
4. Y. Cheng. Mean shift, mode seeking, and clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17:790-799, 1995.
5. C. Ding and H. Peng. Minimum redundancy feature selection from microarray gene expression data. In Proceedings of the Computational Systems Bioinformatics conference (CSB'03), pages 523-529, 2003.
6. X. Z. Fern and C. Brodley. Random projection for high-dimensional data clustering: a cluster ensemble approach. In Proceedings of the twentieth International Conference on Machine Learning, pages 186-193, 2003.
7. G. Forman. An extensive empirical study of feature selection metrics for text classification. Journal of Machine Learning Research, 3:1289-1305, 2003.
8. T. R. Golub, D. K. Slonim, P. Tamayo, et al. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science, 286:531-537, 1999.
9. I. Guyon, J. Weston, S. Barnhill, and V. Vapnik. Gene selection for cancer classification using support vector machines. Machine Learning, 46:389-422, 2002.
10. K. Jong, J. Mary, A. Cornuejols, E. Marchiori, and M. Sebag. Ensemble feature ranking. In Proceedings of the 8th European Conference on Principles and Practice of Knowledge Discovery in Databases, pages 267-278, 2004.
11. A. Kalousis, J. Prados, and M. Hilario. Stability of feature selection algorithms: a study on high-dimensional spaces. Knowledge and Information Systems, 12:95-116, 2007.
12. M. J. Kearns and U. V. Vazirani. An Introduction to Computational Learning Theory. The MIT Press, 1994.
13. R. Kohavi and G. H. John. Wrappers for feature subset selection. Artificial Intelligence, 97(1-2):273-324, 1997.
14. T. Li, C. Zhang, and M. Ogihara. A comparative study of feature selection and multiclass classification methods for tissue classification based on gene expression. Bioinformatics, 20:2429-2437, 2004.
15. H. Liu, J. Li, and L. Wong. A comparative study on feature selection and classification methods using gene expression profiles and proteomic patterns. Genome Informatics, 13:51-60, 2002.
16. H. Liu and L. Yu. Toward integrating feature selection algorithms for classification and clustering. IEEE Transactions on Knowledge and Data Engineering, 17(4):491-502, 2005.
17. T. M. Mitchell. Machine Learning. McGraw-Hill, 1997.
18. A. Y. Ng. On feature selection: learning with exponentially many irrelevant features as training examples. In Proceedings of the Fifteenth International Conference on Machine Learning, pages 404-412, 1998.
19. M. S. Pepe, R. Etzioni, Z. Feng, et al. Phases of biomarker development for early detection of cancer. J Natl Cancer Inst, 93:1054-1060, 2001.
20. E. F. Petricoin, A. M. Ardekani, B. A. Hitt, et al. Use of proteomic patterns in serum to identify ovarian cancer. Lancet, 359:572-577, 2002.
21. Y. Saeys, T. Abeel, and Y. V. Peer. Robust feature selection using ensemble feature selection techniques. In Proceedings of the ECML Confernce, pages 313-325, 2008.
22. L. Song, A. Smola, A. Gretton, K. M. Borgwardt, and J. Bedo. Supervised feature selection via dependence estimation. In Proceedings of the 24th International Conference on Machine Learning, pages 823-830, 2007.
23. A. Strehl and J. Ghosh. Cluster ensembles - a knowledge reuse framework for combining multiple partitions. Journal of Machine Learning Research, 3:583-617, 2002.
24. M. P. Wand and M. C. Jones. Kernel Smoothing. Chapman and Hall, 1995.
25. I. H. Witten and E. Frank. Data Mining - Pracitcal Machine Learning Tools and Techniques. Morgan Kaufmann Publishers, 2005.
26. L. Yu, C. Ding, and S. Loscalzo. Stable feature selection via dense feature groups. In Proceedings of the 14th ACM International Conference on Knowledge Discovery and Data Mining (KDD-08), pages 803-811, 2008.
27. L. Yu and H. Liu. Efficient feature selection via analysis of relevance and redundancy. Journal of Machine Learning Research, 5:1205-1224, 2004.