A novel feature selection method considering feature interaction

Pattern Recognition

Volumn 48, Issue 8, 2015, Pages 2656-2666

  Zeng, Zilin ^a,b   Zhang, Hongjun ^a   Zhang, Rui ^a   Yin, Chengxiang ^a  

^a PLA UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b Nanchang Military Academy   (China)

Author keywords

Feature interaction; Feature selection; Filter method; Interaction weight factor

Indexed keywords

CLASSIFICATION (OF INFORMATION); INFORMATION THEORY;

CLASSIFICATION ACCURACY; CLASSIFICATION ALGORITHM; FEATURE INTERACTIONS; FEATURE SELECTION ALGORITHM; FEATURE SELECTION METHODS; FILTER METHOD; REAL-WORLD DATASETS; WEIGHT FACTOR;

FEATURE EXTRACTION;

EID: 84928275828     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2015.02.025     Document Type: Article

References (43)

1. I. Guyon, and A. Elisseeff An introduction to variable and feature selection J. Mach. Learn. Res. 3 2003 1157 1182
2. M. Dash, and H. Liu Feature selection for classification Intell. Data Anal. 1 3 1997 131 156
3. L.E.A.S. Santana, and A.M.P. Canuto Filter-based optimization techniques for selection of feature subsets in ensemble systems Expert Syst. Appl. 41 4 2014 1622 1631
4. N. Abe, and M. Kudo Non-parametric classifier-independent feature selection Pattern Recognit. 39 5 2006 737 746
5. H.L. Wei, and S.A. Billings Feature subset selection and ranking for data dimensionality reduction IEEE Trans. Pattern Anal. Mach. Intell. 29 1 2007 162 166
6. S. Maldonado, and R. Weber A wrapper method for feature selection using support vector machines Inf. Sci. 179 13 2009 2208 2217
7. I. Guyon, J. Weston, S. Barnhill, and V. Vapnik Gene selection for cancer classification using support vector machines Mach. Learn. 46 1-3 2002 389 422
8. Z. Zhu, Y.S. Ong, and M. Dash Markov blanket-embedded genetic algorithm for gene selection Pattern Recognit. 40 11 2007 3236 3248
9. P. Maji, and S. Paul Rough set based maximum relevance-maximum significance criterion and gene selection from microarray data Int. J. Approx. Reasoning 52 3 2011 408 426
10. A. Jakulin, and I. Bratko Analyzing attribute dependencies in: Proceedings of Seventh European Conference on Principles and Practice of Knowledge Discovery in Databases 2003 Springer 229 240
11. C.E. Shannon A mathematical theory of communication ACM SIGMOBILE Mobile Comput. Commun. Rev. 5 1 2001 3 55
12. T.M. Cover, and J.A. Thomas Elements of Information Theory 1991 Wiley & Sons New York
13. A. Jakulin, I. Bratko, Testing the significance of attribute interactions, in: Proceedings of the Twenty-first International Conference on Machine Learning, ACM, 2004, pp. 409-416.
14. A. Jakulin Attribute interactions in machine learning (Master thesis) 2003 Computer and Information Science, University of Ljubljana
15. K. Kira, L.A. Rendell, The feature selection problem: traditional methods and a new algorithm, in: Proceedings of Ninth National Conference on Artificial Intelligence, 1992, pp. 129-134.
16. M. Robnik-Šikonja, and I. Kononenko Theoretical and empirical analysis of ReliefF and RReliefF Mach. Learn. 53 1-2 2003 23 69
17. I. Kononenko Estimating attributes: analysis and extensions of RELIEF, in: Machine Learning: ECML-94 1994 Springer Berlin, Heidelberg 171 182
18. M.A. Hall Correlation-based feature selection for machine learning (Doctoral dissertation) 1999 The University of Waikato
19. M. Dash, and H. Liu Consistency-based search in feature selection Artif. Intell. 151 1 2003 155 176
20. H. Liu, J. Sun, L. Liu, and H. Zhang Feature selection with dynamic mutual information Pattern Recognit. 42 7 2009 1330 1339
21. H. Yang, J. Moody, Feature selection based on joint mutual information, in: Proceedings of International ICSC Symposium on Advances in Intelligent Data Analysis, 1999, pp. 22-25.
22. R. Battiti Using mutual information for selecting features in supervised neural net learning IEEE Trans. Neural Netw. 5 1994 537 550
23. H. Peng, F. Long, and C. Ding Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy IEEE Trans. Pattern Anal. Mach. Intell. 27 8 2005 1226 1238
24. F. Fleuret Fast binary feature selection with conditional mutual information J. Mach. Learn. Res. 5 2004 1531 1555
25. R. Cai, Z. Hao, X. Yang, and W. Wen An efficient gene selection algorithm based on mutual information Neurocomputing 72 4 2009 991 999
26. G. Wang, F.H. Lochovsky, Feature selection with conditional mutual information maximum in text categorization, in: Proceedings of the Thirteenth International Conference on Information and Knowledge Management, ACM, 2004, pp. 342-349.
27. D. Levi, and S. Ullman Learning to classify by ongoing feature selection Image Vis. Comput. 28 4 2010 715 723
28. L. Yu, and H. Liu Efficient feature selection via analysis of relevance and redundancy J. Mach. Learn. Res. 5 2004 1205 1224
29. Q. Song, J. Ni, and G. Wang A fast clustering-based feature subset selection algorithm for high-dimensional data IEEE Trans. Knowl. Data Eng. 25 1 2013 1 14
30. Z. Zhao, and H. Liu Searching for interacting features in subset selection Intell. Data Anal. 13 2 2009 207 228
31. G. Wang, Q. Song, B. Xu, and Y. Zhou Selecting feature subset for high dimension data via the propositional FOIL rules Pattern Recognit. 46 2013 199 214
32. J.H. Gennari, P. Langley, and D. Fisher Models of incremental concept formation Artif. Intell. 40 1 1989 11 61
33. G.H. John, R. Kohavi, K. Pfleger, Irrelevant features and the subset selection problem, In: Proceedings of the Eleventh International Conference on Machine Learning, 1994, pp. 121-129.
34. D. Koller, M. Sahami. Toward optimal feature selection, in: Proceedings of the Thirteenth International Conference on Machine Learning, 1996, pp. 284-292.
35. A. Jakulin Machine learning based on attribute interactions (Ph.D. thesis) 2005 Computer and Information Science, University of Ljubljana
36. W.J. McGill Multivariate information transmission Psychometrika 19 2 1954 97 116
37. I.H. Witten, and E. Frank Data Mining: Practical Machine Learning Tools and Techniques 2005 Morgan Kaufmann
38. J.R. Quinlan, C4.5: Programs for Machine Learning, Morgan Kaufmann, 1993.
39. D.W. Aha, D. Kibler, and M.K. Albert Instance-based learning algorithms Mach. Learn. 6 1 1991 37 66
40. E. Frank, I.H. Witten, Generating accurate rule sets without global optimization, in: Proceedings of the Fifteenth International Conference on Machine Learning, 1998, pp. 144-151.
41. A. Asuncion, D. Newman, UCI Machine Learning Repository, 2007, http://www.ics.uci.edu~mlearn/MLRepository
42. U. Fayyad, K. Irani, Multi-interval discretization of continuous-valued attributes for classification learning, in: Proceedings of Thirteenth International Joint Conference on Artificial Intelligence, 1993, pp. 1022-1027.
43. J.W. Grzymala-Busse, and M. Hu A comparison of several approaches to missing attribute values in data mining Wojciech Ziarko, Yiyu Yao, Rough Sets and Current Trends in Computing 2001 Springer Berlin Heidelberg 378 385