A survey on feature selection methods

Computers and Electrical Engineering

Volumn 40, Issue 1, 2014, Pages 16-28

  Chandrashekar, Girish ^a   Sahin, Ferat ^a  

^a Kate Gleason College of Engineering   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84894903349     PISSN: 00457906     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compeleceng.2013.11.024     Document Type: Article

References (83)

1. I. Guyon, and A. Elisseeff An introduction to variable and feature selection J Mach Learn Res 3 2003 1157 1182
2. I. Guyon, J. Weston, S. Barhill, and V. Vapnik Gene selection for cancer classification using support vector machines Mach Learn 46 2002 389 422
3. C. Ding, and H. Peng Minimum redundancy feature selection from microarray gene expression data J Bioinform Comput Biol 3 2005 185 205
4. L.-Y. Chuang, H.-W. Chang, C.-J. Tu, and C.-H. Yang Improved binary PSO for feature selection using gene expression data Comput Biol Chem 32 2008 29 38
5. C. Lazar, J. Taminau, S. Meganck, D. Steenhoff, A. Coletta, and C. Molter et al. A survey on filter techniques for feature selection in gene expression microarray analysis IEEE/ACM Trans Comput Biol Bioinform 9 2012
6. E. Alpaydin Introduction to machine learning 2004 The MIT Press
7. M.H. Law, M. rio A.T. Figueiredo, and A.K. Jain Simultaneous feature selection and clustering using mixture models IEEE Trans Pattern Anal Mach Intell 26 2004
8. R. Kohavi, and G.H. John Wrappers for feature subset selection Artif Intell 97 1997 273 324
9. Langley P. Selection of relevant features in machine learning. In: AAAI fall symp relevance; 1994.
10. A.L. Blum, and P. Langley Selection of relevant features and examples in machine learning Artif Intell 97 1997 245 270
11. John GH, Kohavi R, Pfleger K. Irrelevant features and the subset selection problem. In: Proc 11th int conf mach learn; 1994. p. 121-9.
12. R. Battiti Using mutual information for selecting features in supervised neural net learning IEEE Trans Neural Networks 5 1994
13. G. Forman An extensive empirical study of feature selection metrics for text classification J Mach Learn Res 3 2003 1289 1306
14. N. Kwak, and C.-H. Choi Input feature selection for classification problems IEEE Trans Neural Networks 13 2002 143 159
15. P. Comon Independent component analysis a new concept? Signal Process 36 1994 287 314
16. K. Torkkola On feature extraction by non-parametric mutual information maximization J Mach Learn Res 3 2003 1415 1438
17. F. Fleuret Fast binary feature selection with conditional mutual information Mach Learn Res 5 2004 1531 1555
18. R. Bekkerman, R. El-Yaniv, N. Tishby, and Y. Winter Distributional word clusters vs. words for text categorization J Mach Learn Res 3 2003 1245 1264
19. R. Caruana, and V. de S Benefitting from the variables that variable selection discards J Mach Learn Res 3 2003 1245 1264
20. Koller D, Sahami M. Towards optimal feature selection. In: ICML, vol. 96; 1996. p. 284-92.
21. Davidson JL, Jalan J. Feature selection for steganalysis using the mahalonobis distance. In: Proc SPIE 7541, Media Forensics and Security II 7541; 2010.
22. Yang Y, Perdersen JO. A comparative study on feature selection in text categorization. International conference on machine learning; 1997.
23. K. Javed, H.A. Babri, and M. Saeed Feature selection based on class-dependent densities for high-dimensional binary data IEEE Trans Knowl Data Eng 24 2010
24. H. Peng, F. Long, and C. Ding Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy IEEE Trans Pattern Anal Mach Intell 27 2005
25. Kira K, Rendell LA. The feature selection problem: traditional methods and a new algorithm. In: Proceedings of tenth national conference on artificial intelligence; 1992. p. 129-34.
26. E. Acuna, F. Coaquira, and M. Gonzalez A comparison of feature selection procedures for classifier based on kernel density estimation Proc Comput Commun Control Technol 1 2003 468 472
27. H. Stoppiglia, G. Dreyfus, R. Dubios, and Y. Oussar Ranking a random feature for variable and feature selection J Mach Res 3 2003 1399 1414
28. Liu H, Setiono R. A probabilistic approach to feature selection a filter solution. In: International conference on machine learning - ICML; 1996. p. 319-27.
29. Z. Xu, I. King, M.R.-T. Lyu, and R. Jin Discriminative semi-supervised feature selection via manifold regularization IEEE Trans Neural Networks 21 2010
30. P. Narendra, and K. Fukunaga A branch and bound algorithm for feature subset selection IEEE Trans Comput 6 1977 917 922
31. D. Goldberg Genetic algorithms in search, optimization and machine learning 1989 Addison-Wesley
32. Kennedy J, Eberhart RC. Particle swarm optimization. In: Proc IEEE int'l conf on neural networks, IV; 1995. p. 1942-1948.
33. P. Pudil, J. Novovicova, and J. Kittler Floating search methods in feature selection Pattern Recog Lett 15 1994 1119 1125
34. J. Reunanen Overfitting in making comparisons between variable selection methods J Mach Learn Res 3 2003 1371 1382
35. P. Pudil, J. Novovicova, J. Kittler, and P. Paclik Adaptive floating search methods in feature selection Pattern Recog Lett 20 1999 1157 1163
36. Sun Y, Babbs C, Delp E. A comparison of feature selection methods for the detection of breast cancers in mammograms: adaptive sequential floating search vs. genetic algorithm. Conf proc IEEE eng med biol soc, vol. 6.
37. S. Nakariyakul, and D.P. Casasent An improvement on floating search algorithms for feature subset selection Pattern Recog 42 2009 1932 1940
38. Stearns S. On selecting features for pattern classifiers. In: Proceedings of the 3rd international conference on pattern recognition; 1976. p. 71-5.
39. A. Alexandridis, P. Patrinos, H. Sarimveis, and G. Tsekouras A two-stage evolutionary algorithm for variable selection in the development of rbf neural network models Chemomet Intell Lab Syst 75 2005 149 162
40. Jouan-Rimbaud D, Massart DL, Leardi R, Noord OED. Genetic algorithms as a tool for wavenumber selection in multivariate calibration. Anal Chem 67.
41. J. Yang, and V. Honavar Feature subset selection using a genetic algorithm IEEE Intell Syst Appl 13 1998 44 49
42. Puch W, Goodman E, Pei M, Chia-Shun L, Hovland P, Enbody R. Further research on feature selection and classification using genetic algorithm. In International conference on genetic algorithm; 1993. p. 557-64.
43. L. Eshelman The CHC adaptive search algorithm: how to have safe search when engaging in nontraditional genetic recombination G.J.E. Rawlins, In foundations of genetic algorithms 1991 Morgan Kauffman
44. O. Cordon, S. Damas, and J. Santamaria Feature-based image registration by means of the chc evolutionary algorithm Image Vis Comput 24 2006 525 533
45. L. Oliveira, R. Sabourin, F. Bortolozzi, and C. Suen A methodology for feature selection using multiobjective genetic algorithms for handwritten digit sting recognition Int J Pattern Recog Artif Intell 17 2003 903 929
46. F. Ferri, P. Pudil, M. Hatef, and J. Kittler Comparative study of techniques for large-scale feature selection Pattern Recog Pract 1994 403 413
47. M. Kudo, and J. Sklansky Comparison of algorithms that select features for pattern classifiers Pattern Recog 33 2000 327 336
48. C.-J. Tu, L.-Y. Chuang, J.-Y. Chang, and C.-H. Yang Feature selection using pso-svm Int J Comput Sci 33 2006
49. E. Alba, J. Garcia-Nieto, L. Jourdan, and E.-G. Talbi Gene selection in cancer classification using pso/svm and ga/svm hybrid algorithms Evol Comput 2007 284 290
50. P.A. Mundra, and J.C. Rajapakse Svm-rfe with mrmr filter for gene selection IEEE Trans Nanobiosci 9 2010
51. Boser B, Guyon I, Vapnik V. A training algorithm for optimal margin classifiers. In: In fifth annual workshop on computational learning theory; 1992. p. 144-52.
52. Chapelle O, Keerthi SS. Multi-class feature selection with support vector machines; 2008.
53. R. Archibald, and G. Fann Feature selection and classification of hyperspectral images with support vector machines IEEE Geosci Remote Sens Lett 4 2007
54. J. Neumann, C. Schnorr, and G. Steidl Combined svm-based feature selection and classification Mach Learn 61 2005 129 150
55. R. Setiono, and H. Liu Neural-network feature selector IEEE Trans Neural Networks 8 1997 654 662
56. E. Romero, and J.M. Sopena Performing feature selection with multilayer perceptrons IEEE Trans Neural Networks 19 2008
57. D.J. Stracuzzi, and P.E. Utgoff Randomized variable elimination J Mach Learn 5 2004 1331 1364
58. D. Wu, Z. Zhou, S. Feng, and Y. He Uninformation variable elimination and successive projections algorithm in mid-infrared spectra wavenumber selection Image Signal Process 2009
59. V. Centner, D.-L. Massart, O.E. de Noord, S. de Jong, B.M. Vandeginste, and C. Sterna Elimination of uninformative variables for multivariate calibration Anal Chem 68 1996 3851 3858
60. B.K. Alsberg, A.M. Woodward, M.K. Winson, J.J. Rowl, and D.B. Kell Variable selection in wavelet regression models Anal Chim Acta 368 1998 29 44
61. Y. Peng, Z. Xuefeng, Z. Jianyong, and X. Yunhong Lazy learner text categorization algorithm based on embedded feature selection J Syst Eng Electron 20 2009 651 659
62. Xing E, Karp R. Cliff: clustering of high-dimensional microarray data via iterative feature filtering using normalized cuts. In: 9th International conference on intelligence systems for molecular biology; 2001.
63. P. Pudil, J. Novovicova, and J. Kittler Feature selection based on the approximation of class densities by finite mixtures of the special type Pattern Recog 28 1995 1389 1398
64. P. Mitra, C. Murthy, and S.K. Pal Unsupervised feature selection using feature similarity IEEE Trans Pattern Anal Mach Intell 24 2002
65. S.K. Pal, R.K. De, and J. Basak Unsupervised feature evaluation: a neuro-fuzzy approach IEEE Trans Neural Networks 11 2000
66. X. Zhu Semi-supervised learning literature survey Tech rep 1530, computer sciences 2005 University of Wisconsin-Madison
67. Zhao Z, Liu H. Semi-supervised feature selection via spectral analysis. In: Proc 7th SIAM data mining conf (SDM); 2007. p. 641-6.
68. A.-C. Haury, P. Gestraud, and J.-P. Vert The influence of feature selection methods on accuracy, stability and interpretability of molecular signatures PLoS ONE 6 2011 e28210
69. A. T, H. T, V. de Peer Y, D. P, and S. Y Robust biomarker identification for cancer diagnosis with ensemble feature selection methods Bioinformatics 26 2010 392 398
70. Dunne K, Cunningham P, Azuaje F. Solutions to instability problems with sequential wrapper-based approaches to feature selection. Tech rep, Trinity College; 2002.
71. A. Kalousis, J. Prados, and M. Hilario Stability of feature selection algorithms: a study on high dimensional spaces Knowl Inform Syst 2 2007 95 116
72. P. Somol, and J. Novovicova Evaluating stability and comparing output of feature selectors that optimize feature subset cardinality IEEE Trans Pattern Anal Mach Intell 32 2010 1921 1939
73. F. Yang, and K. Mao Robust feature selection for microarray data based on multicriterion fusion IEEE/ACM Trans Comput Biol Bioinform 8 2011
74. T. Dietterich Machine learning research: four current directions Artif Intell Mag 18 1997 97 136
75. C.-C. Chang, and C.-J. Lin Libsvm: a library for support vector machines ACM Trans Intell Syst Technol 2 2011 1 27
76. R. Rifkin, and A. Klautau In defense of one-vs-all classification J Mach Learn Res 5 2004 101 141
77. S. Haykin Neural networks: a comprehensive foundation 2008 Prentice Hall
78. Cinar E, Sahin F. A study of recent classification algorithms and a novel approach for EEG data classification. In: IEEE 2010 international conference on systems, man and cybernetics; 2010.
79. A.S. Loong, O.H. Choon, and L.H. Chin Criterion in selecting the clustering algorithm in radial basis functional link nets WSEAS Trans Syst 7 2008 1290 1299
80. J.V. Marcos, R. Hornero, and D. Alvarez Radial basis function classifiers to help in the diagnosis of the obstructive sleep apnoea syndrome from nocturnal oximetry Med Biol Eng Comput 46 2008 323 332
81. Hongyang L, He J. The application of dynamic k-means clustering algorithm in the center selection of rbf neural networks. In: Proc 3rd international conference on genetic and evolutionary computing, vol. 177; 2009. p. 488-91.
82. http://archive.ics.uci.edu/ml/.
83. Chandrashekar G, Sahin F. In-vivo fault prediction for rf generators using variable elimination and state-of-theart classifiers. 2012 IEEE international conference on systems, man, and cybernetics October 14-17, COEX, Seoul, Korea; 2012.