A novel feature selection method based on normalized mutual information

Applied Intelligence

Volumn 37, Issue 1, 2012, Pages 100-120

  Vinh, La The ^a   Lee, Sungyoung ^a   Park, Young Tack ^b   D'Auriol, Brian J ^a  

^a Kyung Hee University   (South Korea)

^b Soongsil University   (South Korea)

Author keywords

Feature selection; Maximal relevance; Minimal redundancy; Mutual information

Indexed keywords

CLASSIFICATION ACCURACY; DATA SETS; FEATURE SELECTION METHODS; K-NEAREST NEIGHBORS; LINEAR DISCRIMINANT ANALYSIS; MAXIMAL RELEVANCE; MINIMAL REDUNDANCY; MUTUAL INFORMATIONS; NORMALIZED MUTUAL INFORMATION; RECOGNITION MODELS; UCI MACHINE LEARNING REPOSITORY;

ALGORITHMS; CLASSIFICATION (OF INFORMATION); FEATURE EXTRACTION; IMAGE RETRIEVAL; REDUNDANCY;

SUPPORT VECTOR MACHINES;

EID: 84862536593     PISSN: 0924669X     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10489-011-0315-y     Document Type: Review

References (34)

1. Asuncion A, Newman DJ (2007) Uci machine learning repository. University of California, Irvine, School of Information and Computer Sciences. http://www.ics.uci.edu/~mlearn/MLRepository.html
2. R Battiti 1994 Using mutual information for selecting features in supervised neural net learning IEEE Trans Neural Netw 5 4 537 550 10.1109/72.298224
3. B Bhanu Y Lin 2003 Genetic algorithm based feature selection for target detection in sar images Image Vis Comput 1 7 591 608 10.1016/S0262-8856(03) 00057-X
4. GC Cawley NLC Talbot M Girolami 2007 Sparse multinomial logistic regression via Bayesian l1 regularisation Adv Neural Inf Process Syst 19 209 216
5. Chang T-W, Huang Y-P, Sandnes FE (2009) Efficient entropy-based features selection for image retrieval. In: Proceedings of the 2009 IEEE international conference on systems, man and cybernetics, pp 2941-2946
6. Dasgupta A, Drineas P, Harb B, Josifovski V, Mahoney MW (2007) Feature selection methods for text classification. In: Proceedings of the 13th ACM SIGKDD international conference on knowledge discovery and data mining, pp 230-239 (Pubitemid 350229210)
7. M Dash H Liu 1997 Feature selection for classification Intell Data Anal 1 131 156 10.1016/S1088-467X(97)00008-5
8. N Dimililer E Varoglu H Altinçay 2009 Classifier subset selection for biomedical named entity recognition Appl Intell 31 267 282 10.1007/s10489-008-0124-0
9. JG Dy CE Brodley A Kak LS Broderick AM Aisen 2003 Unsupervised feature selection applied to content-based retrieval of lung images IEEE Trans Pattern Anal Mach Intell 25 3 373 378 10.1109/TPAMI.2003.1182100
10. PA Estévez M Tesmer CA Perez JM Zurada 2009 Normalized mutual information feature selection IEEE Trans Neural Netw 20 2 189 201 10.1109/TNN.2008.2005601
11. Fodor IK (2002) A survey of dimension reduction techniques. Technical report, Center for Applied Scientific Computing, Lawrence Livermore National Laboratory
12. G Forman P Alto 2003 An extensive empirical study of feature selection metrics for text classification J Mach Learn Res 3 1289 1305
13. Goulden CH (1956) Methods of statistical analysis, 2nd edn. Wiley, New York
14. I Guyon A Elisseeff 2003 An introduction to variable and feature selection J Mach Learn Res 3 1157 1182
15. Hall MA (1999) Correlation-based feature selection for machine learning. PhD thesis, The University of Waikato
16. M Hall E Frank G Holmes B Pfahringer P Reutemann IH Witten 2009 The weka data mining software: An update SIGKDD Explor 11 1 10 18 10.1145/1656274.1656278
17. R Kamimura 2011 Structural enhanced information and its application to improved visualization of self-organizing maps Appl Intell 34 102 115 10.1007/s10489-009-0183-x
18. Khor K-C, Ting C-Y, Amnuaisuk S-P (2009) A feature selection approach for network intrusion detection. In: Proceedings of the 2009 international conference on information management and engineering, pp 133-137
19. N Kwak C-H Choi 2002 Input feature selection for classification problems IEEE Trans Neural Netw 13 1 143 159 10.1109/72.977291 (Pubitemid 34236844)
20. Y Li X Zeng 2010 Sequential multi-criteria feature selection algorithm based on agent genetic algorithm Appl Intell 33 117 131 10.1007/s10489-008-0153- 8
21. PM Narendra K Fukunaga 1977 A branch and bound algorithm for feature subset selection IEEE Trans Comput 26 9 917 922 10.1109/TC.1977.1674939 (Pubitemid 8550870)
22. I-S Oh J-S Lee B-R Moon 2004 Hybrid genetic algorithms for feature selection IEEE Trans Pattern Anal Mach Intell 26 11 1424 1437 10.1109/TPAMI.2004.105 (Pubitemid 40168020)
23. H Peng F Long C Ding 2005 Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy IEEE Trans Pattern Anal Mach Intell 27 8 1226 1238 10.1109/TPAMI.2005.159 (Pubitemid 41245053)
24. Y Saeys I Inza P Larrañaga 2007 A review of feature selection techniques in bioinformatics Bioinformatics 23 19 1367 4803 10.1093/ bioinformatics/btm344 (Pubitemid 350048351)
25. Shen K-Q, Ong C-J, Li X-P (2008) Novel multi-class feature selection methods using sensitivity analysis of posterior probabilities. In: Proceedings of the IEEE international conference on systems, man and cybernetics, pp 1116-1121
26. J-D Shie S-M Chen 2008 Feature subset selection based on fuzzy entropy measures for handling classification problems Appl Intell 28 69 82 10.1007/s10489-007-0042-6
27. C-H Tsang S Kwong H Wang 2007 Genetic-fuzzy rule mining approach and evaluation of feature selection techniques for anomaly intrusion detection Pattern Recognit 40 9 2373 2391 10.1016/j.patcog.2006.12.009 (Pubitemid 46669583)
28. Vinh LT, Thang ND, Lee Y-K (2010) An improved maximum relevance and minimum redundancy feature selection algorithm based on normalized mutual information. In: Proceedings of the 10th IEEE/IPSJ international symposium on applications and the Internet, pp 395-398
29. H Xia BQ Hu 2006 Feature selection using fuzzy support vector machines Fuzzy Optim Decis Mak 5 2 187 192 10.1007/s10700-006-7336-8 (Pubitemid 44124486)
30. Yan R (2006) MatlabArsenal toolbox for classification algorithms. Informedia School of Computer Science, Carnegie Mellon University
31. Yang HH, Moody J (1999) Data visualization and feature selection: New algorithms for nongaussian data. In: Advances in neural information processing systems. MIT Press, Cambridge, pp 687-693
32. Yu L, Liu H (2004) Redundancy based feature selection for microarray data. In: Proceedings of the 10th ACM SIGKDD international conference on knowledge discovery and data mining, pp 737-742 (Pubitemid 40115000)
33. G-X Yuan K-W Chang C-J Hsieh C-J Lin 2010 A comparison of optimization methods and software for large-scale l1-regularized linear classification J Mach Learn Res 11 3183 234 2746550
34. Zhao Z, Morstatter F, Sharma S, Alelyani S, Anand A, Liu H (2010) Advancing feature selection research-asu feature selection repository. Technical report, School of Computing, Informatics, and Decision Systems Engineering, Arizona State University