Feature subset selection by gravitational search algorithm optimization

Information Sciences

Volumn 281, Issue , 2014, Pages 128-146

  Han, Xiaohong ^a   Chang, Xiaoming ^a   Quan, Long ^a   Xiong, Xiaoyan ^a   Li, Jingxia ^a   Zhang, Zhaoxia ^a   Liu, Yi ^a  

^a TAIYUAN UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Chaotic map; Classification; Feature subset selection; Gravitational search algorithm; Learning algorithm; Sequential quadratic programming

Indexed keywords

ARTIFICIAL INTELLIGENCE; CHAOTIC SYSTEMS; CLASSIFICATION (OF INFORMATION); FEATURE EXTRACTION; GENETIC ALGORITHMS; GRAVITATION; LEARNING SYSTEMS; PARTICLE SWARM OPTIMIZATION (PSO); PIECEWISE LINEAR TECHNIQUES; QUADRATIC PROGRAMMING; SET THEORY; STOCHASTIC SYSTEMS;

ACCURACY OF CLASSIFICATIONS; CHAOTIC MAP; FEATURE SUBSET SELECTION; GRAVITATIONAL SEARCH ALGORITHMS; K-NEAREST NEIGHBORS; PIECEWISE LINEAR CHAOTIC MAP; SEQUENTIAL QUADRATIC PROGRAMMING; STOCHASTIC SEARCH ALGORITHMS;

LEARNING ALGORITHMS;

EID: 84904605824     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2014.05.030     Document Type: Article

References (86)

1. E. Alpaydin Combined 5×2cv F test for comparing supervised classification learning algorithms Neural Comput. 11 1999 1885 1892
2. M. Banerjee, and N.R. Pal Feature selection with SVD entropy: some modification and extension Inform. Sci. 264 2014 118 134
3. A. Baranovsky, and D. Daems Design of one-dimensional chaotic maps with prescribed statistical properties Int. J. Bifur. Chaos 5 1995 1585 1598
4. R. Bello, Y. Gomez, M.M. Garcia, A. Nowe, Two-step particle swarm optimization to solve the feature selection problem, in: Seventh International Conference on Intelligent Systems Design and Applications, ISDA, 2007, pp. 691-696.
5. B. Cestnik, Estimating probabilities: a crucial task in machine learning, in: Proceedings of the European Conference on Artificial Intelligence (ECAI-90) Stockholm, Sweden, 1990, pp. 147-149.
6. Z.h. Chen, X.h. Yuan, H. Tian, and B. Ji Improved gravitational search algorithm for parameter identification of water turbine regulation system Energy Convers. Manage. 78 2014 306 315
7. S. Choi, B. Ryu, S. Yoo, and J. Choi Combining relevancy and methodological quality into a single ranking for evidence-based medicine Inform. Sci. 214 2012 76 90
8. L.Y. Chuang, C.H. Yang, and J.C. Li Chaotic maps based on binary particle swarm optimization for feature selection Appl. Soft Comput. 11 2011 239 248
9. D. Cieslak, and N. Chawla A framework for monitoring classifiers' performance: when and why failure occurs? Knowl. Inform. Syst. 18 2009 83 109
10. T. Cover, and P. Hart Nearest neighbor pattern classification IEEE Trans. Inform. Theory 13 1967 21 27
11. M. Dash, and H. Liu Feature selection for classification Intell. Data Anal. 1 1997 131 156
12. M. Dash, K. Choi, P. Scheuermann, and H. Liu Feature selection for clustering-a filter solution Proceedings of the Second IEEE International Conference on Data Mining (ICDM'02) 2002 IEEE Computer Society Washington, DC, USA 115 122
13. R.C. David, R.E. Precup, E.M. Petriu, M.B. Rǎdac, and S. Preitl Gravitational search algorithm-based design of fuzzy control systems with a reduced parametric sensitivity Inform. Sci. 247 2013 154 173
14. J. Derrac, C. Cornelis, S. García, and Francisco Herrera Enhancing evolutionary instance selection algorithms by means of fuzzy rough set based feature selection Inform. Sci. 186 2012 73 92
15. T.G. Dietterich Approximate statistical tests for comparing supervised learning algorithms Neural Comput. 10 7 1998 1895 1924
16. O. Dor, and Y. Reich Strengthening learning algorithms by feature discovery Inform. Sci. 189 2012 176 190
17. M.B. Dowlatshahi, H. Nezamabadi-pour, and M. Mashinchi A discrete gravitational search algorithm for solving combinatorial optimization problems Inform. Sci. 258 2014 94 107
18. E. Fix, and J. Hodges Discriminatory analysis-nonparametric discrimination: consistency properties Int. Statist. Rev. 57 1989 238 247
19. R. Fletcher Practical Methods of Optimization 1987 Wiley New York
20. F.C. García, M. García, B. Melian, J.A. Moreno, and M. Moreno Solving feature subset selection problem by a parallel scatter search Euro. J. Operat. Res. 169 2006 477 489
21. Y. Gao, M. Wang, R. Ji, Z. Zha, and J. Shen k-Partite graph reinforcement and its application in multimedia information retrieval Inform. Sci. 194 2012 224 239
22. N. García-Pedrajas, A. Haro-García, and J. Pérez-Rodríguez A scalable approach to simultaneous evolutionary instance and feature selection Inform. Sci. 228 2013 150 174
23. M. García-Torres, R. Armañanzas, C. Bielza, and P. Larrañaga Comparison of metaheuristic strategies for peakbin selection in proteomic mass spectrometry data Inform. Sci. 222 2013 229 246
24. A. Ghasemi, H. Shayeghi, and H. Alkhatib Robust design of multimachine power system stabilizers using fuzzy gravitational search algorithm Int. J. Electr. Power Energy Syst. 51 2013 190 200
25. H. Guan, J. Zhou, B. Xiao, M. Guo, and T. Yang Fast dimension reduction for document classification based on imprecise spectrum analysis Inform. Sci. 222 2013 147 162
26. I. Guyon, and A. Elisseeff An introduction to variable and feature selection J. Mach. Learn. Res. 3 2003 157 1182
27. X. Han, and X. Chang A chaotic digital secure communication based on a modified gravitational search algorithm filter Inform. Sci. 208 2012 14 27
28. X.H. Han, and X.M. Chang An intelligent noise reduction method for chaotic signals based on genetic algorithms and lifting wavelet transforms Inform. Sci. 208 2013 103 118
29. X.H. Han, L. Quan, X.Y. Xiong, and B. Wu Facing the classification of binary problems with a hybrid system based on quantum-inspired binary gravitational search algorithm and K-NN method Eng. Appl. Artif. Intell. 26 2013 2424 2430
30. X.H. Han, and X.M. Chang Chaotic secure communication based on a gravitational search algorithm filter Eng. Appl. Artif. Intell. 25 2012 766 774
31. C.L. Huang, and C.J. Wang A GA-based feature selection and parameters optimization for support vector machines Exp. Syst. Appl. 31 2006 231 240
32. C.L. Huang, and J.F. Dun A distributed PSO-SVM hybrid system with features selection and parameter optimization Appl. Soft Comput. 8 2008 1381 1391
33. A. Jain, and D. Zongker Feature selection: evaluation, application, and small sample performance IEEE Trans. Pattern Recog. Mach. Intell. 19 1997 153 158
34. F.Y. Ju, and W.C. Hong Application of seasonal SVR with chaotic gravitational search algorithm in electricity forecasting Appl. Math. Modell. 37 2013 9643 9651
35. R. Kohavi, and G.H. John Wrappers for feature subset selection Artif. Intell. 97 1997 273 324
36. O.V. Laere, S. Schockaert, and B. Dhoedt Georeferencing Flickr resources based on textual meta-data Inform. Sci. 238 2013 52 74
37. M.S. Lew Principles of Visual Information Retrieval 2001 Springer-Verlag London
38. C. Li, and J. Zhou Parameters identification of hydraulic turbine governing system using improved gravitational search algorithm Energy Convers. Manage. 52 2011 374 381
39. L. Li, T.A. Darden, C.R. Weingberg, A.J. Levine, and L.G. Pedersen Gene assessment and sample classification for gene expression data using a genetic algorithm/k-nearest neighbor method Comb. Chem. High Through. Screen. 4 2001 727 739
40. C.s. Li, H.s. Li, and P. Kou Piecewise function based gravitational search algorithm and its application on parameter identification of AVR system Neurocomputing 124 2014 139 148
41. C.s. Li, J.z. Zhou, J. Xiao, and H. Xiao Hydraulic turbine governing system identification using T-S fuzzy model optimized by chaotic gravitational search algorithm Eng. Appl. Artif. Intell. 26 2013 2073 2082
42. H.X. Li, J.-L. Yang, G. Zhang, and B. Fan Probabilistic support vector machines for classification of noise affected data Inform. Sci. 221 2013 60 71
43. L. Liu, W.M. Zhong, and F. Qian An improved chaos-particle swarm optimization algorithm J. East China Univ. Sci. Technol. (Nat. Sci. Ed.) 36 2010 267 272
44. H. Liu, and L. Yu Towards integrating feature selection algorithms for classification and clustering IEEE Trans. Knowl. Data Eng. 17 2005 491 502
45. Y. Liu, F. Dellaert, A classification based similarity metric for 3D image retrieval, in: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, 1998, pp. 800-805.
46. Q. Luo, and D. Yi A co-evolving framework for robust particle swarm optimization Appl. Math. Comput. 199 2008 611 622
47. K. Mahadevan, and P.S. Kannan Comprehensive learning particle swarm optimization for reactive power dispatch Appl. Soft Comput. 10 2010 641 652
48. S. Maldonado, and R. Weber A wrapper method for feature selection using support vector machines Inform. Sci. 179 2009 2208 2217
49. E. Masciari, G.M. Mazzeo, and C. Zaniolo Analysing microarray expression data through effective clustering Inform. Sci. 262 2014 32 45
50. E. Mendel, R.A. Krohling, and M. Campos Swarm algorithms with chaotic jumps applied to noisy optimization problems Inform. Sci. 181 2011 4494 4514
51. W. Mendenhall, and T. Sincich Statistics for Engineering and the Sciences 1998 Prentice Hall Englewood Cliffs, NJ
52. P. Mitra, C.A. Murthy, and S.K. Pal Unsupervised feature selection using feature similarity IEEE Trans. Pattern Anal. Mach. Intell. 24 2002 301 312
53. F. Musharavati, and A.S.M. Hamouda Modified genetic algorithms for manufacturing process planning in multiple parts manufacturing lines Exp. Syst. Appl. 38 2011 10770 10779
54. I.S. Oh, J.S. Lee, and B.R. Moon Hybrid genetic algorithms for feature selection IEEE Trans. Pattern Anal. Mach. Intell. 26 2004 1424 1437
55. J. Pacheco, S. Casado, and L. Nunez A variable selection method based on tabu search for logistic regression models Euro. J. Operat. Res. 199 2009 506 511
56. B. Peralta, and A. Soto Embedded local feature selection within mixture of experts Inform. Sci. 269 2014 176 187.
57. J. Platt, Machines using sequential minimal optimization, in: B. Schoelkopf, C. Burges, A. Smola (Eds.), Advances in Kernel Methods - Support Vector Learning, 1998.
58. T. Pourhabibi, M.B. Imani, and S. Haratizadeh Feature selection on Persian fonts: a comparative analysis on GAA, GESA and GA Proc. Comp. Sci. 3 2011 1249 1255
59. J.R. Quinlan Induction of decision tree Mach. Learn. 1 1986 81 106
60. E. Rashedi, Gravitational Search Algorithm, M.Sc. Thesis, Electrical Engineering Department, Shahid Bahonar University of Kerman, Iran, 2007.
61. E. Rashedi, H. Nezamabadi-Pour, S. Saryazdi, Allocation of static var compensator using gravitational search algorithm, in: Proceedings of the First Joint Conference on Fuzzy and Intelligent Systems, Mashhad, Iran, 2007.
62. E. Rashedi, H. Nezamabadi-pour, and S. Saryazdi GSA: a gravitational search algorithm Inform. Sci. 179 2009 2232 2248
63. E. Rashedi, H. Nezamabadi-Pour, and S. Saryazdi BGSA: binary gravitational search algorithm Nat. Comput. 9 2010 727 745
64. M.L. Raymer, W.F. Punch, E.D. Goodman, L.A. Kuhn, and A.K. Jain Dimensionality reduction using genetic algorithms IEEE Trans. Evolut. Comput. 4 2000 164 171
65. F. Ren, and M.G. Sohrab Class-indexing-based term weighting for automatic text classification Inform. Sci. 236 2013 109 125
66. J.A. Sánchez del Rivero, E. Montañés-Roces, B. Roza-Delgado, A. Soldado, O. Luaces, J.R. Quevedo, and A. Bahamonde Feature selection for classification of animal feed ingredients from near infrared microscopy spectra Inform. Sci. 241 2013 58 69
67. S. Sarafrazi, H. Nezamabadi-pour, and S. Saryazdi Disruption: a new operator in gravitational search algorithm Sci. Iran. 18 2011 539 548
68. I. Santos, F. Brezo, X. Ugarte-Pedrero, and P.G. Bringas pcode sequences as representation of executables for data-mining-based unknown Malware detection Inform. Sci. 231 2013 64 82
69. B. Shaw, V. Mukherjee, and S.P. Ghoshal A novel opposition-based gravitational search algorithm for combined economic and emission dispatch problems of power systems Int. J. Electr. Pow. Energy Syst. 35 2012 21 33
70. B. Shaw, V. Mukherjee, and S.P. Ghoshal Solution of reactive power dispatch of power systems by an opposition-based gravitational search algorithm Int. J. Electr. Pow. Energy Syst. 55 2014 29 40
71. S.S. Shreem, S. Abdullah, and M.Z.A. Nazri Hybridising harmony search with a Markov blanket for gene selection problems Inform. Sci. 258 2014 108 121
72. N. Shrivastava, and V. Tyagi Content based image retrieval based on relative locations of multiple regions of interest using selective regions matching Inform. Sci. 259 2014 212 224
73. P. Suganthan, N. Hansen, J. Liang, K. Deb, Y. Chen, A. Auger, S. Tiwari, Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real- Parameter Optimization, Tech. Rep, Nanyang Technological University, vol. 2005005, Singapore, 2005.
74. S. Tan An effective refinement strategy for KNN text classifier Exp. Syst. Appl. 30 2006 290 298
75. K. Tanaka, T. Kurita, T. Kawabe, Selection of import vectors via binary particle swarm optimization and cross-validation for kernel logistic regression, in: Proceedings of International Joint Conference on Networks, Orlando, Florida, USA, 2007, pp. 12-17.
76. P.K. Tripathi, S. Bandyopadhyay, and S.K. Pal Multi-objective particle swarm optimization with time variant inertia and acceleration coefficients Inform. Sci. 177 2007 5033 5049
77. V.N. Vapnik The Nature of Statistical Learning Theory 1995 Springer New York, USA
78. X. Wang, J. Yang, X. Teng, W. Xia, and R. Jensen Feature selection based on rough sets and particle swarm optimization Pattern Recog. Lett. 28 2007 459 471
79. Y. Weiss, Y. Elovici, and L. Rokach The CASH algorithm-cost-sensitive attribute selection using histograms Inform. Sci. 222 2013 247 268
80. R.B. Wilson, A Simplicial Algorithm for Concave Programming, Ph.D. thesis. Harvard University, Cambridge, MA, 1963.
81. I.H. Witten, and E. Frank Data Mining: Practical Machine Learning Tools and Techniques second ed. Morgan Kaufmann Series in Data Management Systems 2005 Morgan Kaufmann San Francisco
82. T. Xiang, X. Liao, and K. Wong An improved particle swarm optimization algorithm combined with piecewise linear chaotic map Appl. Math. Comput. 190 2007 637 1645
83. M. Yin, Y. Hu, F. Yang, X. Li, and W. Gu A novel hybrid K-harmonic means and gravitational search algorithm approach for clustering Exp. Syst. Appl. 38 2011 9319 9324
84. Z. Yu, H.-S. Wong, J. You, and Guoqiang Han Visual query processing for efficient image retrieval using a SOM-based filter-refinement scheme Inform. Sci. 203 2012 83 101
85. H. Zhang, and G. Sun Feature selection using tabu search method Pattern Recog. 35 2002 701 711
86. Y. Zhuang, N. Jiang, Z. Wu, Q. Li, D.K.W. Chiu, and Hua Hu Efficient and robust large medical image retrieval in mobile cloud computing environment Inform. Sci. 263 2014 60 86