Feature selection using Joint Mutual Information Maximisation

Expert Systems with Applications

Volumn 42, Issue 22, 2015, Pages 8520-8532

  Bennasar, Mohamed ^a   Hicks, Yulia ^a   Setchi, Rossitza ^a  

^a CARDIFF UNIVERSITY   (United Kingdom)

Author keywords

Classification; Conditional mutual information; Dimensionality reduction; Feature selection; Feature selection stability; Joint mutual information; Mutual information; Subset feature selection

Indexed keywords

ARTIFICIAL INTELLIGENCE; BIOINFORMATICS; COMPUTATION THEORY; COMPUTATIONAL EFFICIENCY; DATA MINING; ECONOMIC AND SOCIAL EFFECTS; FEATURE EXTRACTION; IMAGE PROCESSING; INFORMATION THEORY; INFORMATION USE; INTELLIGENT SYSTEMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS;

CONDITIONAL MUTUAL INFORMATION; DIMENSIONALITY REDUCTION; FEATURE SELECTION STABILITIES; JOINT MUTUAL INFORMATIONS; MUTUAL INFORMATIONS;

CLASSIFICATION (OF INFORMATION);

EID: 84940462014     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2015.07.007     Document Type: Article

References (48)

1. Bache, K., & Lichman, M. (2013). UCI machine learning repository. Irvine, CA: University of California, School of Information and Computer Science. (http://archive.ics.uci.edu/ml).
2. Bajwa I., Naweed M., Asif M., Hyder S. Feature based image classification by using principal component analysis ICGST International Journal on Graphics Vision and Image Processing 9 2009 11 17
3. Battiti R. Using mutual information for selecting features in supervised neural net learning IEEE Transactions on Neural Networks 5 1994 537 550
4. Bolón-Canedo V., Sánchez-Maroño N., Alonso-Betanzos A. A review of feature selection methods on synthetic data Knowledge and Information Systems 34 2013 483 519
5. Brown G., Pocock A., Zhao M., Lujan M. Conditional likelihood maximisation: a unifying framework for information theoretic feature selection Journal of Machine Learning Research 13 2012 27 66
6. Chandrashekar G., Sahin F. A survey on feature selection methods Computers and Electrical Engineering 40 2014 16 28
7. Cheng H., Qin Z., Feng C., Wang Y., Li F. Conditional mutual information-based feature selection analysing for synergy and redundancy Electronics and Telecommunications Research Institute 33 2011 210 218
8. Cover T., Thomas J. Elements of information theory 2006 John Wiley & Sons New York
9. Ding C., Peng H. Minimum redundancy feature selection from microarray gene expression data Proceedings of the computational systems bioinformatics: IEEE Computer Society 2003 523 528
10. Dougherty J., Kohavi R., Sahami M. Supervised and unsupervised discretization of continuous features Proceedings of the twelfth international conference on machine learning 1995 194 202
11. Duda R., Hart P., Stork D. Pattern classification 2001 John Wiley and Sons New York
12. El Akadi A., El Ouardighi A., Aboutajdine D. A powerful feature selection approach based on mutual information International Journal of Computer Science and Network Security 8 2008 116 121
13. Estévez P.A., Tesmer M., Perez A., Zurada J.M. Normalized mutual information feature selection IEEE Transactions on Neural Networks 20 2009 189 201
14. Fleuret F. Fast binary feature selection with conditional mutual information Journal of Machine Learning Research 5 2004 1531 1555
15. Freeman C., Kulić D., Basir O. An evaluation of classifier-specific filter measure performance for feature selection Pattern Recognition 48 2015 1812 1826
16. Guyon I., Elisseeff A. An introduction to variable and feature selection Journal of Machine Learning Research 3 2003 1157 1182
17. Guyon I., Gunn S., Nikravesh M., Zadeh L.A. Feature extraction foundations and applications 2006 Springer New York/Berlin, Heidelberg Studies in fuzziness and soft computing
18. Hoque N., Bhattacharyya D.K., Kalita J.K. MIFS-ND: a mutual information-based feature selection method Expert Systems with Applications 41 14 2014 6371 6385
19. Jain A.K., Duin R.P.W., Mao J. Statistical Pattern Recognition: A Review IEEE Transactions on Pattern Analysis and Machine Intelligence 22 2000 4 37
20. Jakulin, A. (2003). Attribute interactions in machine learning. (M.S.c thesis), Computer and Information Science, University of Ljubljana.
21. Jakulin, A. (2005). Machine learning based on attribute interactions (Ph.D. thesis), Computer and Information Science, University of Ljubljana.
22. Janecek A., Gansterer W., Demel M., Ecker G. On the relationship between feature selection and classification accuracy Journal of Machine Learning Research: Workshop and Conference Proceedings 4 2008 90 105
23. Karegowda A.G., Jayaram M.A., Manjunath A.S. Feature subset selection problem using wrapper approach in supervised learning International Journal of Computer Applications 1 2010 13 17
24. Kira K., Rendell L. A practical approach to feature selection Proceedings of the 10th International Workshop on Machine Learning (ML92) 1992 249 256
25. Kuhn H. The Hungarian method for the assignment problem Naval Research Logistic Quarterly 2 1955 83 97
26. Kuncheva L. A stability index for feature selection Proceedings of the 25th IASTED International Multi-Conference on Artificial Intelligence and Applications 2007 390 395
27. Kwok N., Choi C. Input feature selection for classification problems IEEE Transactions on Neural Networks 13 2002 143 159
28. Lee J., Kim D. Fast multi-label feature selection based on information-theoretic feature ranking Pattern Recognition 48 2015 2761 2771
29. Liang J., Wang F., Dang C., Qian Y. A group incremental approach to feature selection applying rough set technique IEEE Transactions on Knowledge and Data Engineering 26 2 2014 294 308
30. Lin T., Li H., Tsai K. Implementing the fisher's discriminant ratio in a k-means clustering algorithm for feature selection and dataset trimming Journal of Chemical Information and Computer Sciences 44 2004 76 87
31. Liu H., Motoda H. Computational methods of feature selection 2008 Chapman & Hall/CRC Taylor & Francis Group New York
32. Liu H., Yu L. Toward integrating feature selection algorithms for classification and clustering IEEE Transactions on Knowledge and Data Engineering 17 2005 491 502
33. Meyer P.E., Bontempi G. On the use of variable complementarity for feature selection in cancer classification Proceedings of European workshop on applications of evolutionary computing: Evo Workshops 2006 91 102
34. Meyer P.E., Schretter C., Bontempi G. Information-theoretic feature selection in microarray data using variable complementarity IEEE Journal of Selected Topics in Signal Processing 2 2008 261 274
35. Peng H., Long F., Ding C. Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy IEEE Transactions on Pattern Analysis and Machine Intelligence 27 2005 1226 1238
36. Rodgers J., Nicewander W.A. Thirteen ways to look at the correlation coefficient The American Statistician 42 1988 59 66
37. Qian Y., Wang Q., Cheng H., Liang J., Dang C. Fuzzy-rough feature selection accelerator Fuzzy Sets and Systems 258 2015 61 78
38. Saeys Y., Inza I., Larranaga P. A review of feature selection techniques in bioinformatics Bioinformatics 23 2007 2507 2517
39. Tang E.K., Suganthana P.N., Yao X., Qina A.K. Linear dimensionality reduction using relevance weighted LDA Pattern Recognition 38 2005 485 493
40. Turk M., Pentland A. Eigenfaces for recognition Journal of Cognitive Neuroscience 3 1991 72 86
41. Vergara J., Estévez P. A review of feature selection methods based on mutual information Neural Computing and Applications 24 2014 175 186
42. Vidal-Naquet M., Ullman S. Object recognition with informative features and linear classification Proceedings of the 10th IEEE international conference on computer vision 2003 281 289
43. Yang H., Moody J. Feature selection based on joint mutual information Proceedings of international ICSC symposium on advances in intelligent data analysis 1999 22 25
44. Yu H., Yang J. A direct LDA algorithm for high-dimensional data with application to face recognition Pattern Recognition 34 2001 2067 2070
45. Yu L., Liu H. Efficient feature selection via analysis of relevance and redundancy Journal of Machine Learning Research 5 2004 1205 1224
46. Yu L., Ding C., Loscalzo S. Stable feature selection via dense feature groups Proceedings of the 14th ACM SIGKDD international conference on knowledge discovery and data mining 2008 803 811
47. Zhang Y., Yang A., Xiong C., Wang T., Zhang Z. Feature selection using data envelopment analysis Knowledge-Based Systems 64 2014 70 80
48. Zhang Y., Yang C., Yang A., Xiong C.Y., Zhou X., Zhang Z. Feature selection for classification with class-separability strategy and data envelopment analysis Neurocomputing 166 2015 172 184