Particle swarm optimisation for feature selection in classification: Novel initialisation and updating mechanisms

Applied Soft Computing Journal

Volumn 18, Issue , 2014, Pages 261-276

  Xue, Bing ^a   Zhang, Mengjie ^a   Browne, Will N ^a  

^a VICTORIA UNIVERSITY OF WELLINGTON   (New Zealand)

Author keywords

Classification; Feature selection; Particle swarm optimisation

Indexed keywords

ALGORITHMS; BENCHMARKING; FEATURE EXTRACTION; PARTICLE SWARM OPTIMIZATION (PSO);

BENCHMARK DATASETS; CLASSIFICATION PERFORMANCE; COMPUTATIONAL TIME; DATA PREPROCESSING; EVOLUTIONARY COMPUTATION TECHNIQUES; FEATURE SELECTION METHODS; FEATURE SELECTION PROBLEM; PARTICLE SWARM OPTIMISATION;

CLASSIFICATION (OF INFORMATION);

EID: 84897113235     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2013.09.018     Document Type: Article

References (54)

1. I. Guyon, and A. Elisseeff An introduction to variable and feature selection The Journal of Machine Learning Research 3 2003 1157 1182
2. M. Dash, and H. Liu Feature selection for classification Intelligent Data Analysis 1 1997 131 156
3. R. Kohavi, and G.H. John Wrappers for feature subset selection Artificial Intelligence 97 1997 273 324 (Pubitemid 127401107)
4. L.Y. Chuang, S.W. Tsai, and C.H. Yang Improved binary particle swarm optimization using catfish effect for feature selection Expert Systems with Applications 38 2011 12699 12707
5. I.A. Gheyas, and L.S. Smith Feature subset selection in large dimensionality domains Pattern Recognition 43 2010 5 13
6. J. Kennedy, and R. Eberhart Particle swarm optimization International Conference on Neural Networks, vol. 4 IEEE 1995 1942 1948
7. Y. Shi, and R. Eberhart A modified particle swarm optimizer International Conference on Evolutionary Computation (CEC'98) IEEE 1998 69 73
8. S.-W. Lin, and S.-C. Chen PSOLDA: a particle swarm optimization approach for enhancing classification accuracy rate of linear discriminant analysis Applied Soft Computing 9 2009 1008 1015
9. A. Gutierrez, M. Lanza, I. Barriuso, L. Valle, M. Domingo, J. Perez, and J. Basterrechea Comparison of different PSO initialization techniques for high dimensional search space problems: a test with FSS and antenna arrays The 5th European Conference on Antennas and Propagation (EUCAP'11) IEEE 2011 965 969
10. B. Xue, M. Zhang, and W. Browne Novel initialisation and updating mechanisms in PSO for feature selection in classification Applications of Evolutionary Computation, vol. 7835 of Lecture Notes in Computer Science 2013 Springer Berlin, Heidelberg 428 438
11. K. Kira, and L.A. Rendell A practical approach to feature selection Assorted Conferences and Workshops 1992 249 256
12. H. Almuallim, and T.G. Dietterich Learning Boolean concepts in the presence of many irrelevant features Artificial Intelligence 69 1994 279 305
13. A. Whitney A direct method of nonparametric measurement selection IEEE Transactions on Computers C-20 1971 1100 1103
14. T. Marill, and D. Green On the effectiveness of receptors in recognition systems IEEE Transactions on Information Theory 9 1963 11 17
15. S. Stearns On selecting features for pattern classifier Proceedings of the 3rd International Conference on Pattern Recognition, IEEE Coronado, CA 2003 71 75
16. Z.X. Zhu, Y.S. Ong, and M. Dash Wrapper-filter feature selection algorithm using a memetic framework IEEE Transactions on Systems, Man, and Cybernetics. Part B: Cybernetics 37 2007 70 76 (Pubitemid 46358481)
17. K. Neshatian, and M. Zhang Pareto front feature selection: using genetic programming to explore feature space Proceedings of the 11th Annual conference on Genetic and evolutionary computation (GECCO'09) New York, NY, USA 2009 1027 1034
18. D. Muni, N. Pal, and J. Das Genetic programming for simultaneous feature selection and classifier design IEEE Transactions on Systems, Man, and Cybernetics. Part B: Cybernetics 36 2006 106 117 (Pubitemid 43174145)
19. K. Neshatian, M. Zhang, and P. Andreae A filter approach to multiple feature construction for symbolic learning classifiers using genetic programming IEEE Transactions on Evolutionary Computation 16 2012 645 661
20. K. Neshatian, and M. Zhang Using genetic programming for context-sensitive feature scoring in classification problems Connection Science 23 2011 183 207
21. K. Neshatian, and M. Zhang Improving relevance measures using genetic programming European Conference on Genetic Programming (EuroGP 2012), vol. 7244 of Lecture Notes in Computer Science 2012 Springer Springer Berlin Heidelberg 97 108
22. R. Jensen, and Q. Shen Finding rough set reducts with ant colony optimization Proceedings of the 2003 UK Workshop on Computational Intelligence 2003 15 22
23. L. Ke, Z. Feng, and Z. Ren An efficient ant colony optimization approach to attribute reduction in rough set theory Pattern Recognition Letters 29 2008 1351 1357
24. R.A.A.M. Mishra, and D.T. Jena Rough ACO: a hybridized model for feature selection in gene expression data International Journal of Computer Communication and Technology 1 2009 85 98
25. Y. Chen, D. Miao, and R. Wang A rough set approach to feature selection based on ant colony optimization Pattern Recognition Letters 31 2010 226 233
26. L.Y. Chuang, H.W. Chang, C.J. Tu, and C.H. Yang Improved binary PSO for feature selection using gene expression data Computational Biology and Chemistry 32 2008 29 38
27. X. Wang, J. Yang, X. Teng, W. Xia, and R. Jensen Feature selection based on rough sets and particle swarm optimization Pattern Recognition Letters 28 2007 459 471 (Pubitemid 44920436)
28. K. Iswandy, and A. Koenig Feature-level fusion by multi-objective binary particle swarm based unbiased feature selection for optimized sensor system design IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems 2006 365 370 (Pubitemid 351409455)
29. M.A. Esseghir, G. Goncalves, and Y. Slimani Adaptive particle swarm optimizer for feature selection International Conference on Intelligent Data Engineering and Automated Learning (IDEAL'10) 2010 Springer Verlag Berlin, Heidelberg 226 233
30. Y. Marinakis, M. Marinaki, and G. Dounias Particle swarm optimization for pap-smear diagnosis Expert Systems with Applications 35 2008 1645 1656
31. C.L. Huang, and J.F. Dun A distributed PSO-SVM hybrid system with feature selection and parameter optimization Application on Soft Computing 8 2008 1381 1391
32. R. Fdhila, T. Hamdani, and A. Alimi Distributed MOPSO with a new population subdivision technique for the feature selection 5th International Symposium on Computational Intelligence and Intelligent Informatics (ISCIII'11) IEEE 2011 81 86
33. K. Parsopoulos, and M. Vrahatis Initializing the particle swarm optimizer using the nonlinear simplex method Advances in Intelligent Systems, Fuzzy Systems, Evolutionary Computation 216 2002 1 6
34. J.A. Nelder, and R. Mead A simplex method for function minimization The Computer Journal 7 1965 308 313
35. M. Richards, and D. Ventura Choosing a starting configuration for particle swarm optimization International Joint Conference on Neural Networks, vol. 3 IEEE 2004 2309 2312 (Pubitemid 40006618)
36. H. Jabeen, Z. Jalil, and A.R. Baig Opposition based initialization in particle swarm optimization (O-PSO) Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference GECCO'09, ACM 2009 2047 2052
37. H. Wang, Z. Wu, J. Wang, X. Dong, S. Yu, and C. Chen A new population initialization method based on space transformation search Fifth International Conference on Natural Computation (ICNC'09), vol. 5 IEEE Computer Society 2009 332 336
38. H. Wang, H. Li, Y. Liu, C. Li, and S. Zeng Opposition-based particle swarm algorithm with Cauchy mutation IEEE Congress on Evolutionary Computation (CEC'07) IEEE 2007 4750 4756
39. H.-C. Chen, and O.-C. Chen Particle swarm optimization incorporating a preferential velocity-updating mechanism and its applications in IIR filter design International Conference on Systems, Man and Cybernetics (SMC'06), vol. 2 IEEE 2006 1190 1195
40. J. Qi, and Y. Ding An improved particle swarm optimization with an adaptive updating mechanism Proceedings of the Second International Conference on Advances in swarm intelligence - vol. Part I. ICSI'11 2011 Springer-Verlag Springer Berlin Heidelberg 130 137
41. J. Kennedy, and R. Eberhart A discrete binary version of the particle swarm algorithm IEEE International Conference on Systems, Man, and Cybernetics, Computational Cybernetics and Simulation, vol. 5 1997 4104 4108
42. A.P. Engelbrecht Computational Intelligence: An Introduction 2nd ed. 2007 John Wiley & Sons Ltd Chichester, West Sussex, England
43. M. Khanesar, M. Teshnehlab, and M. Shoorehdeli A novel binary particle swarm optimization Mediterranean Conference on Control Automation (MED'07) IEEE 2007 1 6
44. S. Luke, and L. Panait Lexicographic parsimony pressure Proceedings of the Genetic and Evolutionary Computation Conference (GECCO'02) 2002 Morgan Kaufmann San Francisco, CA, USA 829 836
45. M. Gutlein, E. Frank, M. Hall, and A. Karwath Large-scale attribute selection using wrappers IEEE Symposium on Computational Intelligence and Data Mining (CIDM'09) IEEE 2009 332 339
46. R. Caruana, and D. Freitag Greedy attribute selection International Conference on Machine Learning 1994 Morgan Kaufmann San Francisco, CA, USA 28 36
47. B. Xue, M. Zhang, and W.N. Browne New fitness functions in binary particle swarm optimisation for feature selection IEEE Congress on Evolutionary Computation (CEC'12) 2012 2145 2152
48. X. Wang, J. Yang, R. Jensen, and X. Liu Rough set feature selection and rule induction for prediction of malignancy degree in brain glioma Computer Methods and Programs in Biomedicine 83 2006 147 156 (Pubitemid 44188980)
49. A. Frank, and A. Asuncion UCI Machine Learning Repository 2010
50. T. Hastie, R. Tibshirani, J. Friedman, and J. Franklin The elements of statistical learning: data mining, inference and prediction The Mathematical Intelligence 27 2005 83 85
51. M. Clerc, and J. Kennedy The particle swarm - explosion, stability, and convergence in a multidimensional complex space IEEE Transactions on Evolutionary Computation 6 2002 58 73 (Pubitemid 34404564)
52. B. Xue, M. Zhang, and W.N. Browne Multi-objective particle swarm optimisation (PSO) for feature selection Genetic and Evolutionary Computation Conference (GECCO'12) 2012 81 88
53. B. Xue, M. Zhang, and W. Browne Particle swarm optimization for feature selection in classification: a multi-objective approach IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 2012 1 16
54. A. Boubezoul, and S. Paris Application of global optimization methods to model and feature selection Pattern Recognition 45 2012 3676 3686