Feature selection using hierarchical feature clustering

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2011, Pages 979-984

  Liu, Huawen ^a   Wu, Xindong ^b   Zhang, Shichao ^c  

^a ZHEJIANG NORMAL UNIVERSITY   (China)

^b UNIVERSITY OF VERMONT   (United States)

^c UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

classification; feature clustering; feature selection; learning; mutual information

Indexed keywords

CLASS LABELS; CLASSIFICATION PERFORMANCE; DATA SETS; DISCRIMINATIVE FEATURES; FEATURE CLUSTERING; FEATURE SELECTION ALGORITHM; HIERARCHICAL FEATURES; INFORMATION MEASUREMENT; LEARNING; MAIN CHARACTERISTICS; MINIMAL REDUNDANCY; MUTUAL INFORMATIONS; SELECTION METHODS; SELECTION PROCEDURES; SIMULATION EXPERIMENTS; TEXT CATEGORIZATION; TRADITIONAL LEARNING;

CLASSIFICATION (OF INFORMATION); DATA MINING; KNOWLEDGE MANAGEMENT; LEARNING ALGORITHMS; TEXT PROCESSING;

FEATURE EXTRACTION;

EID: 83055191253     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2063576.2063716     Document Type: Conference Paper

References (29)

1. A Arauzo-Azofra, JM Benitez, JL Castro, Consistency measures for feature selection. Journal of Intelligence Information System 30: 273-292, 2008. (Pubitemid 351667132)
2. A Asuncion, DJ Newman, UCI Machine Learning Repository. Available from http://wwwicsuciedu/~mlearn/MLRepositoryhtml, Department of Information and Computer Science, University of California Irvine, 2007.
3. M Bacauskiene, A Verikas, A Gelzinis, D Valincius, A feature selection technique for generation of classification committees and its application to categorization of laryngeal images. Pattern Recognition 42(5): 645-654, 2009.
4. R Battiti, Using Mutual Information for Selecting Features in Supervised Neural Net Learning. IEEE Transactions on Neural Networks 5(4): 537-550, 1994.
5. DA Bell, H Wang, A Formalism for Relevance and Its Application in Feature Subset Selection. Machine Learning 41: 175-195, 2000.
6. B Bonev, F Escolano, M Cazorla, Feature selection mutual information and the classification of high-dimensional patterns. Pattern Analysis and Application 11: 309-319, 2008.
7. TM Cover, JA Thomas, Elements of Information Theory. New York Wiley, 1991.
8. RO Duda, PE Hart, DG Stork, Pattern Classification. New York:John Wiley Sons Inc, 2001.
9. PA Estévez, M Tesmer, CA Perez, JM Zurada, Normalized Mutual Information Feature Selection, IEEE Transactions on Neural Networks 20(2): 189-201, 2009.
10. F Fleuret, Fast Binary Feature Selection with Conditional Mutual Information. Journal of Machine Learning Research 5: 1531-1555, 2004.
11. I Guyon, A Elisseeff, An Introduction to Variable and Feature Selection. Journal of Machine Learning Research 3: 1157-1182, 2003.
12. MA Hall, Correlation-based Feature Subset Selection for Machine Learning. PhD Thesis, Department of Computer Science University of Waikato, Hamilton, NewZealand, 1999.
13. KE Hild, D Erdogmus, K Torkkola, JC Principe, Feature extraction using information theoretic learning, IEEE Trans. Pattern Anal. Mach. Intell. 28(9): 1385-1392, 2006. (Pubitemid 44132646)
14. HH Hsu, CW Hsieh, Feature Selection via Correlation Coefficient Clustering, Journal of Software 5(12): 1371-1377, 2010.
15. AK Jain, RPW Duin, J Mao, Statistical Pattern Recognition: A Review. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(1): 4-37, 2000. (Pubitemid 32132953)
16. CS Jung, H Seo, HG Kang, Estimating redundancy information of selected features in multi-dimensional pattern. Pattern Recognition Letters 32: 590-596, 2011.
17. K Kira, L Rendell, A practical approach to feature selection. In: Proceedings of the 9th International Conference on Machine Learning, Morgan Kaufmann, pp 249-256, 1992.
18. N Kwak, CH Choi, Input feature selection by mutual information based on Parzen window. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(12): 1667-1671, 2002.
19. D Levi, S Ullman, Learning to classify by ongoing feature selection. Image and Vision Computing 28(4): 715-723, 2010.
20. H Liu, L Liu, H Zhang, Ensemble gene selection for cancer classification. Pattern Recognition 43(8): 2763-2772, 2010.
21. H Liu, J Sun, L Liu, H Zhang, Feature selection with dynamic mutual information. Pattern Recognition 42: 1330-1339, 2009.
22. H Liu, L Yu, Toward Integrating Feature Selection Algorithms for Classification and Clustering. IEEE Transactions on Knowledge and Data Engineering 17(4): 491-502, 2005. (Pubitemid 40495592)
23. J Novovičová, P Somol, M Haindl, P Pudil, Conditional Mutual Information Based Feature Selection for Classification Task. In: Proceedings of the 12th Iberoamericann Congress on Pattern Recognition Valparaiso, Chile, pp 417-426, 2007.
24. H Peng, F Long, C Ding, Feature Selection Based on Mutual Information: Criteria of Max-Dependency Max-Relevanceand Min-Redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(8): 1226-1238, 2005. (Pubitemid 41245053)
25. Y Saeys, T Abeel, YV de Peer, Robust Feature Selection Using Ensemble Feature Selection Techniques. In: Proceedings of ECML/PKDD 2008, LNAI 5212, Springer, pp 313-325, 2008.
26. Y Saeys, I Inza, L Larrañaga, A review of feature selection techniques in bioinformatics. Bioinformatics 23(19): 2507-2517, 2007. (Pubitemid 350048351)
27. JM Sotoca, F Pla, Supervised feature selection by clustering using conditional mutual information-based distances, Pattern Recognition 43: 2068-2081, 2010.
28. IH Witten, E Frank, Data Mining - Pracitcal Machine Learning Tools and Techniques with JAVA Implementations, 2nd eds, Morgan Kaufmann Publishers, 2005.
29. L Yu, H Liu, Efficient Feature Selection via Analysis of Relevance and Redundancy. Journal of Machine Learning Research 5: 1205-1224, 2004.