Boosting feature selection using information metric for classification

Neurocomputing

Volumn 73, Issue 1-3, 2009, Pages 295-303

  Liu, Huawen ^a   Liu, Lei ^a   Zhang, Huijie ^b  

^a JILIN UNIVERSITY   (China)

^b NORTHEAST NORMAL UNIVERSITY   (China)

Author keywords

Boosting; Classification; Feature selection; Filter model; Information metric

Indexed keywords

BOOSTING; CLASSIFICATION; FEATURE SELECTION; FILTER MODEL; INFORMATION METRIC;

FEATURE EXTRACTION; INFORMATION USE; LABELS; LEARNING SYSTEMS; METRIC SYSTEM; SIMULATORS;

LEARNING ALGORITHMS;

ARTICLE; CLASSIFICATION; CLASSIFIER; CONTROLLED STUDY; ERROR; LEARNING ALGORITHM; PRIORITY JOURNAL; SIMULATION; STATISTICAL ANALYSIS;

EID: 70350733470     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2009.08.012     Document Type: Article

References (39)

1. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification. second ed. (2001), Wiley, New York
2. Kohavi R., and John G.H. Wrappers for feature subset selection. Artificial Intelligence 97 1-2 (1997) 273-324
3. Liu H., and Yu L. Toward integrating feature selection algorithms for classification and clustering. IEEE Transactions on Knowledge and Data Engineering 17 4 (2005) 491-502
4. Guyon I., and Elisseeff A. An introduction to variable and feature selection. Journal of Machine Learning Research 3 (2003) 1157-1182
5. Saeys Y., Inza I., and Larrañaga L. A review of feature selection techniques in bioinformatics. Bioinformatics 23 19 (2007) 2507-2517
6. Blum A.L., and Langley P. Selection of relevant features and examples in machine learning. Artificial Intelligence 97 (1997) 245-271
7. M.A. Hall, Correlation-based Feature Subset Selection for Machine Learning, Department of Computer Science, University of Waikato, Hamilton, New Zealand, 1999.
8. Sebban M., and Nock R. A hybrid filter/wrapper approach of feature selection using information theory. Pattern Recognition 35 4 (2002) 835-846
9. Uncu Ö., and Türkse ̧n I.B. A novel feature selection approach: combining feature wrappers and filters. Information Sciences 177 (2007) 449-466
10. Wei H.-L., and Billings S.A. Feature subset selection and ranking for data dimensionality reduction. IEEE Transactions on Pattern Analysis and Machine Intelligence 29 1 (2007) 162-166
11. K. Kira, L. Rendell. A practical approach to feature selection, in: Proceedings of the Ninth International Conference on Machine Learning, Morgan Kaufmann, Los Altos, CA, 1992, pp. 249-256.
12. Cover T.M., and Thomas J.A. Elements of Information Theory (1991), Wiley, New York
13. Y. Yang, J.O. Pedersen, A comparative study on feature selection in text categorization in: Proceedings of the 14th International Conference on Machine Learning, Nashville, US, Morgan Kaufmann Publishers, Los Altos, CA, 1997, pp. 412-420.
14. Forman G. An extensive empirical study of feature selection metrics for text classification. Journal of Machine Learning Research 3 (2003) 1289-1305
15. S. Das, Filters, wrappers and a boosting-based hybrid for feature selection, in: Proceedings of the 18th International Conference on Machine Learning, San Francisco, CA, USA, 2001, pp. 74-81.
16. Li G.-Z., and Yang J.Y. Feature selection for ensemble learning and its application. In: Zhang Y.-Q., and Rajapakse J.C. (Eds). Machine Learning in Bioinformatics (2008), Wiley, New York
17. Liu H., Sun J., Liu L., and Zhang H. Feature selection with dynamic mutual information. Pattern Recognition 42 (2009) 1330-1339
18. Somol P., Novovičová J., and Pudil P. Notes on the evolution of feature selection methodology. Kybernetika 43 5 (2007) 713-730
19. Jain A.K., Duin R.P.W., and Mao J. Statistical pattern recognition: a review. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 1 (2000) 4-37
20. Peng H., Long F., and Ding C. Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 8 (2005) 1226-1238
21. J. Novovičová, P. Somol, M. Haindl, P. Pudil, Conditional mutual information based feature selection for classification task, in: the 12th Iberoamerican Congress on Pattern Recognition, Valparaiso, Chile, 2007, pp. 417-426.
22. R. Cai, Z. Hao, X. Yang, W. Wen, An efficient gene selection algorithm based on mutual information, Neurocomputing (2008), doi: 10.1016/j.neucom.2008.04.005.
23. Tieu K., and Viola P. Boosting image retrieval. International Journal of Computer Vision 56 1/2 (2004) 17-36
24. Yin X.-C., Liu C.-P., and Han Z. Feature combination using boosting. Pattern Recognition Letters 26 (2005) 2195-2205
25. D.B. Redpath, K. Lebart, Boosting feature selection, in: The Third International Conference on Advances in Pattern Recognition, Bath, UK, Springer, Berlin, 2005, pp. 305-314.
26. X. Xu, A. Zhang, Boost feature subset selection: a new gene selection algorithm for microarray data set, in: International Conference on Computational Science, vol. 2, UK, 2006, pp. 670-677.
27. Hung W.-L., Yang M.-S., and Chen D.-H. Bootstrapping approach to feature-weight selection in fuzzy c-means algorithms with an application in color image segmentation. Pattern Recognition Letters 29 9 (2008) 1317-1325
28. Bryll R., Gutierrez-Osuna R., and Quek F. Attribute bagging: improving accuracy of classifier ensembles by using random feature subsets. Pattern Recognition 36 (2003) 1291-1302
29. Tsymbal A., Puuronen S., and Patterson D.W. Ensemble feature selection with the simple Bayesian classification. Information Fusion 4 (2003) 87-100
30. Hong Y., Kwong S., Chang Y., and Ren Q. Consensus unsupervised feature ranking from multiple views. Pattern Recognition Letters 29 (2008) 595-602
31. Oliveira L.S., Morita M., and Sabourin R. Feature selection for ensembles applied to handwriting recognition. International Journal of Document Analysis 8 4 (2006) 262-279
32. M. Skurichina, R.P.W. Duin, Combining feature subsets in feature selection, in: The Sixth International Workshop on Multiple Classifier System, Springer, Seaside, USA, 2005, pp. 165-175.
33. Tumer K., and Oza N.C. Input decimated ensembles. Pattern Analysis and Applications 6 1 (2003) 65-77
34. Y. Freund, R.E. Schapire, Experiments with a new boosting algorithm, in: The 13th International Conference on Machine Learning, Morgan Kaufmann Publishers, San Francisco, CA, 1996, pp. 148-156.
35. Schapire R.E. The boosting approach to machine learning: an overview. In: Denison D.D., Hansen M.H., Holmes C., Mallick B., and Yu B. (Eds). Nonlinear Estimation and Classification (2003), Springer, Berlin
36. Dash M., and Liu H. Consistency-based search in feature selection. Artificial Intelligence 151 (2003) 155-176
37. A. Asuncion, D.J. Newman, UCI Repository of Machine Learning Databases, Available 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉, Department of Information and Computer Science, University of California, Irvine, 2007.
38. Huang D., and Chow T.W.S. Effective feature selection scheme using mutual information. Neurocomputing 63 (2005) 325-343
39. Witten I.H., and Frank E. Data Mining-Practical Machine Learning Tools and Techniques with JAVA Implementations. second ed. (2005), Morgan Kaufmann Publishers, Los Altos, CA