MIFS-ND: A mutual information-based feature selection method

Expert Systems with Applications

Volumn 41, Issue 14, 2014, Pages 6371-6385

  Hoque, N ^a   Bhattacharyya, D K ^a   Kalita, J K ^b  

^a TEZPUR UNIVERSITY   (India)

^b University of Colorado Colorado Springs   (United States)

Author keywords

Classification; Features; Mutual information; Relevance

Indexed keywords

SET THEORY;

CLASSIFICATION ACCURACY; CLASSIFICATION OF DATA; FEATURE SELECTION METHODS; FEATURES; HIGH DIMENSIONAL DATA; MUTUAL INFORMATIONS; RELEVANCE; SELECTION TECHNIQUES;

CLASSIFICATION (OF INFORMATION);

EID: 84901445861     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2014.04.019     Document Type: Article

References (41)

1. A. Arauzo-Azofra, J.L. Aznarte, and J.M. Benítez Empirical study of feature selection methods based on individual feature evaluation for classification problems Expert Systems with Applications 38 7 2011 8170 8177
2. R. Battiti Using mutual information for selecting features in supervised neural net learning IEEE Transactions on Neural Networks 5 4 1994 537 550
3. D.K. Bhattacharyya, and J.K. Kalita Network anomaly detection: A machine learning perspective 2013 CRC Press
4. R.B. Bhatt, and M. Gopal On fuzzy-rough sets approach to feature selection Pattern Recognition Letters 26 7 2005 965 975 (Pubitemid 40538756)
5. A.L. Blum, and P. Langley Selection of relevant features and examples in machine learning Artificial Intelligence 97 1 1997 245 271 (Pubitemid 127401106)
6. Brown, G. (2009). A new perspective for information theoretic feature selection. In International conference on artificial intelligence and statistics (pp. 49-56).
7. J.M. Cadenas, M.C. Garrido, and R. MartíNez Feature subset selection filter-wrapper based on low quality data Expert Systems with Applications 40 16 2013 6241 6252
8. Caruana, R.; Freitag, D. (1994). Greedy attribute selection. In ICML citeseer (pp. 28-36).
9. M. Dash, and H. Liu Feature selection for classification Intelligent Data Analysis 1 3 1997 131 156
10. K. Deb, S. Agrawal, A. Pratap, and T. Meyarivan A fast elitist non-dominated sorting genetic algorithm for multi-objective optimization: Nsga-II Lecture Notes in Computer Science 1917 2000 849 858
11. T.G. Dietterich Approximate statistical tests for comparing supervised classification learning algorithms Neural Computation 10 7 1998 1895 1923 (Pubitemid 128463689)
12. P.A. Estévez, M. Tesmer, C.A. Perez, and J.M. Zurada Normalized mutual information feature selection IEEE Transactions on Neural Networks 20 2 2009 189 201
13. B. Frénay, G. Doquire, and M. Verleysen Theoretical and empirical study on the potential inadequacy of mutual information for feature selection in classification Neurocomputing 112 2013 64 78
14. H. Frohlich, O. Chapelle, and B. Scholkopf Feature selection for support vector machines by means of genetic algorithm 15th IEEE international conference on tools with artificial intelligence, 2003. Proceedings. 2003 IEEE 142 148
15. I. Guyon, and A. Elisseeff An introduction to variable and feature selection The Journal of Machine Learning Research 3 2003 1157 1182
16. Hall, M. A.; Smith, L. A. (1999). Feature selection for machine learning: Comparing a correlation-based filter approach to the wrapper. In FLAIRS conference (pp. 235-239).
17. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I.H. Witten The weka data mining software: An update ACM SIGKDD Explorations Newsletter 11 1 2009 10 18
18. J.-T. Horng, L.-C. Wu, B.-J. Liu, J.-L. Kuo, W.-H. Kuo, and J.-J. Zhang An expert system to classify microarray gene expression data using gene selection by decision tree Expert Systems with Applications 36 5 2009 9072 9081
19. H.-H. Hsu, C.-W. Hsieh, and M.-D. Lu Hybrid feature selection by combining filters and wrappers Expert Systems with Applications 38 7 2011 8144 8150
20. G. Hughes On the mean accuracy of statistical pattern recognizers IEEE Transactions on Information Theory 14 1 1968 55 63
21. Y. Ke, and R. Sukthankar Pca-sift: A more distinctive representation for local image descriptors Proceedings of the 2004 IEEE computer society conference on computer vision and pattern recognition, 2004. CVPR 2004 Vol. 2 2004 IEEE II-506
22. K.-C. Khor, C.-Y. Ting, and S.-P. Amnuaisuk A feature selection approach for network intrusion detection International Conference on Information Management and Engineering, 2009. ICIME'09. 2009 IEEE 133 137
23. K. Kira, and L.A. Rendell A practical approach to feature selection Proceedings of the ninth international workshop on machine learning 1992 Morgan Kaufman Publishers Inc. 249 256
24. Kraskov, A.;Stögbauer, H.; Grassberger, P. (2004). Estimating mutual information. Physics Review E, American Physical Society, 69.
25. N. Kwak, and C.-H. Choi Input feature selection for classification problems IEEE Transactions on Neural Networks 13 1 2002 143 159 (Pubitemid 34236844)
26. D.D. Lewis Feature selection and feature extraction for text categorization Proceedings of the workshop on speech and natural language 1992 Association for Computational Linguistics 212 217
27. S.-W. Lin, K.-C. Ying, C.-Y. Lee, and Z.-J. Lee An intelligent algorithm with feature selection and decision rules applied to anomaly intrusion detection Applied Soft Computing 12 10 2012 3285 3290
28. H. Liu, and R. Setiono Chi2: Feature selection and discretization of numeric attributes Seventh international conference on tools with artificial intelligence, 1995. Proceedings 1995 IEEE 388 391
29. H. Liu, and L. Yu Toward integrating feature selection algorithms for classification and clustering IEEE Transactions on Knowledge and Data Engineering 17 4 2005 491 502 (Pubitemid 40495592)
30. P.E. Lutu, and A.P. Engelbrecht A decision rule-based method for feature selection in predictive data mining Expert Systems with Applications 37 1 2010 602 609
31. P. Mitra, C. Murthy, and S.K. Pal Unsupervised feature selection using feature similarity IEEE Transactions on Pattern Analysis and Machine Intelligence 24 3 2002 301 312 (Pubitemid 35289348)
32. S. Nemati, M.E. Basiri, N. Ghasem-Aghaee, and M.H. Aghdam A novel aco-ga hybrid algorithm for feature selection in protein function prediction Expert Systems with Applications 36 10 2009 12086 12094
33. H. Peng, F. Long, and C. Ding Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy IEEE Transactions on Pattern Analysis and Machine Intelligence 27 8 2005 1226 1238 (Pubitemid 41245053)
34. K. Polat, and S. Güneş A new feature selection method on classification of medical datasets: Kernel f-score feature selection Expert Systems with Applications 36 7 2009 10367 10373
35. Y. Saeys, I. Inza, and P. Larrañaga A review of feature selection techniques in bioinformatics Bioinformatics 23 19 2007 2507 2517 (Pubitemid 350048351)
36. Q. Song, J. Ni, and G. Wang A fast clustering-based feature subset selection algorithm for high dimensional data IEEE Transactions on Knowledge and Data Engineering 25 1 2013 1 14
37. B. Swingle Rényi entropy, mutual information, and fluctuation properties of fermi liquids Physical Review B 86 4 2012 045109
38. mr 2pso: A maximum relevance minimum redundancy feature selection method based on swarm intelligence for support vector machine classification Information Sciences 181 20 2011 4625 4641
39. L.D. Vignolo, D.H. Milone, and J. Scharcanski Feature selection for face recognition based on multi-objective evolutionary wrappers Expert Systems with Applications 40 13 2013 12086 12094
40. Yang, Y.; Pedersen, J. O. (1997). A comparative study on feature selection in text categorization. In ICML (Vol. 97, pp. 412-420).
41. L. Yu, and H. Liu Redundancy based feature selection for microarray data Proceedings of the 10th ACM SIGKDD international conference on Knowledge discovery and data mining 2004 ACM 737 742 (Pubitemid 40115000)