Conditional mutual information based feature selection for classification task

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4756 LNCS, Issue , 2007, Pages 417-426

  Novovičová, Jana ^a,b   Somol, Petr ^a,b   Haindl, Michal ^a,b   Pudil, Pavel ^a,b  

^a INSTITUTE OF MATHEMATICS   (Czech Republic)

^b UNIVERSITY OF ECONOMICS   (Czech Republic)

Author keywords

Conditional mutual information; Feature selection; Pattern classification; Text categorization

Indexed keywords

CLASSIFICATION (OF INFORMATION); PARAMETER ESTIMATION; SET THEORY; TEXT PROCESSING;

CONDITIONAL MUTUAL INFORMATION; TEXT CATEGORIZATION;

FEATURE EXTRACTION;

EID: 38449109775     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-76725-1_44     Document Type: Conference Paper

References (18)

1. Yu, L., Liu, H.: Feature selection for high-dimensional data: A fast correlation-based filter solution. In: Proceedings of the 20th International Conference on Machine Learning, pp. 56-63 (2003)
2. Dash, M., Choi, K., Scheuermann, P., Liu, H.: Feature selection for clustering - a filter solution. In: Proceedings of the Second International Conference on Data Mining, pp. 115-122 (2002)
3. Kohavi, R., John, G.: Wrappers for feature subset selection. Artificial Intelligence 97, 273-324 (1997)
4. Liu, H., Yu, L.: Toward integrating feature selection algorithms for classification and clustering. IEEE Transactions on Knowledge and Data Engineering 17(3), 491-502 (2005)
5. Dash, M., Liu, H.: Consistency-based search in feature selection. Artificial Intelligence 151(1-2), 155-176 (2003)
6. Jain, A.K., Duin, R.P.W., Mao, J.: Statistical pattern recognition: A review. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 4-37 (2000)
7. Battiti, R.: Using mutual information for selecting features in supervised neural net learning. IEEE Transactions on Neural Networks 5, 537-550 (1994)
8. Kwak, N., Choi, C.H.: Input feature selection for classification problems. IEEE Transactions on Neural Networks 13(1), 143-159 (2002)
9. Cover, T., Thomas, J.: Elements of Information Theory, 1st edn. John Wiley & Sons, Chichester (1991)
10. Fleuret, F.: Fast binary feature selection with conditional mutual information. Journal of Machine Learning Research 5, 1531-1555 (2004)
11. Peng, H., Long, F., Ding, C.: Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(8), 1226-1238 (2005)
12. Fano, R.: Transmission of Information: A Sattistical Theory of Communications. John Wiley and M.I.T.& Sons (1991)
13. Kwak, N., Choi, C.: Improved mutual information feature selector for neural networks in supervised learning. In: Proceedings of the IJCNN 1999, 10th International Joint Conference on Neural Networks pp. 1313-1318 (1999)
14. Forman, G.: An experimental study of feature selection metrics for text categorization. Journal of Machine Learning Research 3, 1289-1305 (2003)
15. McCallum, A., Nigam, K.: A comparison of event models for naive Bayes text classification. In: Proceedings of the AAAI-1998 Workshop on Learning for Text Categorization (1998)
16. Joachims, T.: Text categorization with support vector machines: Learning with many relevant features. In: Nédellec, C., Rouveirol, C. (eds.) ECML 1998. LNCS, vol. 1398, pp. 137-142. Springer, Heidelberg (1998)
17. Sebastiani, F.: Machine learning in automated text categorization. ACM Computing Surveys 34(1), 1-47 (2002)
18. Yang, Y.: A study on thresholding strategies for text categorization. In: Proceedings of ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2001), New Orleans, Louisiana USA (September 9-12, 2001)