A novel hybrid system for feature selection based on an improved gravitational search algorithm and k-NN method

Applied Soft Computing Journal

Volumn 31, Issue , 2015, Pages 293-307

  Xiang, Jie ^a   Han, Xiaohong ^a   Duan, Fu ^a   Qiang, Yan ^a   Xiong, Xiaoyan ^a   Lan, Yuan ^a   Chai, Haishui ^a  

^a TAIYUAN UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Binary classification; Feature selection; Function optimization; Gravitational search algorithm; k nearest neighbor; Leave one out cross validation

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BINS; CHAOTIC SYSTEMS; CLASSIFICATION (OF INFORMATION); EVOLUTIONARY ALGORITHMS; FEATURE EXTRACTION; HEURISTIC ALGORITHMS; HYBRID SYSTEMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; NEAREST NEIGHBOR SEARCH; PIECEWISE LINEAR TECHNIQUES; PROBLEM SOLVING; QUADRATIC PROGRAMMING; STATISTICAL METHODS;

BINARY CLASSIFICATION; FUNCTION OPTIMIZATION; GRAVITATIONAL SEARCH ALGORITHMS; K-NEAREST NEIGHBORS; LEAVE-ONE-OUT CROSS VALIDATIONS;

OPTIMIZATION;

EID: 84939815093     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2015.01.043     Document Type: Article

References (49)

1. A. Asuncion, and D. Newman UCI Machine Learning Repository 2007
2. U. Alon, N. Barkai, D.A. Notterman, K. Gish, S. Ybarra, D. Mack, and A.J. Levine Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligo-nucleotide arrays Proc. Natl. Acad. Sci. U. S. A. 96 1999 6745 6750
3. A. Baranovsky, and D. Daems Design of one-dimensional chaotic maps with prescribed statistical properties Int. J. Bifurc. Chaos 5 1995 1585 1598
4. R. Bello, Y. Gomez, M.M. Garcia, and A. Nowe Two-step particle swarm optimization to solve the feature selection problem Seventh International Conference on Intelligent Systems Design and Applications ISDA 2007 691 696
5. T. Cover, and P. Hart Nearest neighbor pattern classification IEEE Trans. Inf. Theory 13 1967 21 27
6. M. Dash, and H. Liu Feature selection for classification Intell. Data Anal. 1 1997 131 156
7. M. Dash, K. Choi, P. Scheuermann, and H. Liu Feature selection for clustering-a filter solution Proceedings of the Second IEEE International Conference on Data Mining (ICDM'02) IEEE Computer Society, Washington, DC, USA 2002 115 122
8. E. Fix, and J. Hodges Discriminatory analysis-nonparametric discrimination: consistency properties Int. Stat. Rev. Revue Internationale de Statistique 57 1989 238 247
9. R. Fletcher Practical Methods of Optimization 1987 Wiley New York
10. F.C. García, M. García, B. Melian, J.A. Moreno, and M. Moreno Solving feature subset selection problem by a parallel scatter search Eur. J. Oper. Res. 169 2006 477 489
11. S. García, D. Molina, M. Lozano, and F. Herrera A study on the use of non-parametric tests for analyzing the evolutionary algorithms' behaviour: a case study on the CEC'2005 special session on real parameter optimization J. Heuristics 15 2009 617 644
12. I. Guyon, and A. Elisseeff An introduction to variable and feature selection J. Mach. Learn. Res. 3 2003 1157 1182
13. C.L. Huang, and C.J. Wang A GA-based feature selection and parameters optimization for support vector machines Expert Syst. Appl. 31 2006 231 240
14. C.L. Huang, and J.F. Dun A distributed PSO-SVM hybrid system with features selection and parameter optimization Appl. Soft Comput. 8 2008 1381 1391
15. A.A. Ibrahim, A. Mohamed, H. Shareef, and S.P. Ghoshal Optimal placement of power quality monitors in distribution systems using the topological monitor reach area Proceedings of the International Electric Machines and Drives Conference Niagara Falls, Canada, 15-18 May 2011 2011 IEEE Press New York
16. A.A. Ibrahim, A. Mohamed, H. Shareef, and S.P. Ghoshal An effective power quality monitor placement method utilizing quantum inspired particle swarm optimization Proceedings of the International Conference on Electrical Engineering and Informatics Bandung, Indonesia, 17-19 July 2011 2011 IEEE Press New York
17. A.A. Ibrahim, A. Mohamed, and H. Shareef Application of quantum-inspired binary gravitational search algorithm for optimal power quality monitor placement Proceedings of the 11th WSEAS International Conference on Artificial Intelligence, Knowledge Engineering and Data Bases (AIKED '12) Cambridge, UK, 22-24 February 2012 2012
18. A. Jain, and D. Zongker Feature selection: evaluation, application, and small sample performance IEEE Trans. Pattern Recogn. Mach. Intell. 19 1997 153 158
19. R. Kohavi, and G.H. John Wrappers for feature subset selection Artif. Intell. 97 1997 273 324
20. M.S. Lew Principles of Visual Information Retrieval 2001 Springer-Verlag London
21. C. Li, and J. Zhou Parameters identification of hydraulic turbine governing system using improved gravitational search algorithm Energy Convers. Manage. 52 2011 374 381
22. L. Liu, W.M. Zhong, and F. Qian An improved chaos-particle swarm optimization algorithm J. East China Univ. Sci. Technol.: Nat. Sci. Edn. 36 2010 267 272
23. H. Liu, and L. Yu Towards integrating feature selection algorithms for classification and clustering IEEE Trans. Knowl. Data Eng. 17 2005 491 502
24. Y. Liu, and F. Dellaert A classification based similarity metric for 3D image retrieval Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition 1998 800 805
25. Q. Luo, and D. Yi A co-evolving framework for robust particle swarm optimization Appl. Math. Comput. 199 2008 611 622
26. K. Mahadevan, and P.S. Kannan Comprehensive learning particle swarm optimization for reactive power dispatch Appl. Soft Comput. 10 2010 641 652
27. S. Maldonado, and R. Weber A wrapper method for feature selection using support vector machines Inf. Sci. 179 2009 2208 2217
28. E. Mendel, R.A. Krohling, and M. Campos Swarm algorithms with chaotic jumps applied to noisy optimization problems Inf. Sci. 181 2011 4494 4514
29. P. Mitra, C.A. Murthy, and S.K. Pal Unsupervised feature selection using feature similarity IEEE Trans. Pattern Anal. Mach. Intell. 24 2002 301 312
30. F. Musharavati, and A.S.M. Hamouda Modified genetic algorithms for manufacturing process planning in multiple parts manufacturing lines Expert Syst. Appl. 38 2011 10770 10779
31. I.S. Oh, J.S. Lee, and B.R. Moon Hybrid genetic algorithms for feature selection IEEE Trans. Pattern Anal. Mach. Intell. 26 2004 1424 1437
32. J. Pacheco, S. Casado, and L. Nunez A variable selection method based on tabu search for logistic regression models Eur. J. Oper. Res. 199 2009 506 511
33. T. Pourhabibi, M.B. Imani, and S. Haratizadeh Feature selection on Persian fonts: a comparative analysis on GAA, GESA and GA Procedia Comput. Sci. 3 2011 1249 1255
34. E. Rashedi Gravitational Search Algorithm (M.Sc. thesis) 2007 Electrical Engineering Department, Shahid Bahonar University of Kerman Iran
35. E. Rashedi, H. Nezamabadi-Pour, and S. Saryazdi Allocation of static var compensator using gravitational search algorithm Proceedings of the First Joint Conference on Fuzzy and Intelligent Systems Mashhad, Iran 2007
36. E. Rashedi, H. Nezamabadi-pour, and S. Saryazdi GSA: a gravitational search algorithm Inf. Sci. 179 2009 2232 2248
37. E. Rashedi, H. Nezamabadi-Pour, and S. Saryazdi BGSA: binary gravitational search algorithm Nat. Comput. 9 2010 727 745
38. M.L. Raymer, W.F. Punch, E.D. Goodman, L.A. Kuhn, and A.K. Jain Dimensionality reduction using genetic algorithms IEEE Trans. Evolut. Comput. 4 2000 164 171
39. S. Sarafrazi, H. Nezamabadi-pour, S. Saryazdi, and Disruption A new operator in gravitational search algorithm Sci. Iran. 18 2011 539 548
40. B. Shaw, V. Mukherjee, and S.P. Ghoshal A novel opposition-based gravitational search algorithm for combined economic and emission dispatch problems of power systems Int. J. Electr. Power Energy Syst. 35 2012 21 33
41. S. Tan An effective refinement strategy for KNN text classifier Expert Syst. Appl. 30 2006 290 298
42. K. Tanaka, T. Kurita, and T. Kawabe Selection of import vectors via binary particle swarm optimization and cross-validation for kernel logistic regression Proceedings of International Joint Conference on Networks Orlando, Florida, USA 2007 12 17
43. P.K. Tripathi, S. Bandyopadhyay, and S.K. Pal Multi-objective particle swarm optimization with time variant inertia and acceleration coefficients Inf. Sci. 177 2007 5033 5049
44. X. Wang, J. Yang, X. Teng, W. Xia, and R. Jensen Feature selection based on rough sets and particle swarm optimization Pattern Recogn. Lett. 28 2007 459 471
45. R.B. Wilson A Simplicial Algorithm for Concave Programming (Ph.D. thesis) 1963 Harvard University Cambridge, MA
46. T. Xiang, X. Liao, and K. Wong An improved particle swarm optimization algorithm combined with piecewise linear chaotic map Appl. Math. Comput. 190 2007 1637 1645
47. X. Yao, Y. Liu, and G. Lin Evolutionary programming made faster IEEE Trans. Evolut. Comput. 3 1999 82 102
48. M. Yin, Y. Hu, F. Yang, X. Li, and W. Gu A novel hybrid K-harmonic means and gravitational search algorithm approach for clustering Expert Syst. Appl. 38 2011 9319 9324
49. H. Zhang, and G. Sun Feature selection using tabu search method Pattern Recogn. 35 2002 701 711