A multi-objective particle swarm optimisation for filter-based feature selection in classification problems

Connection Science

Volumn 24, Issue 2-3, 2012, Pages 91-116

  Xue, Bing ^a   Cervante, Liam ^a   Shang, Lin ^b   Browne, Will N ^a   Zhang, Mengjie ^a  

^a VICTORIA UNIVERSITY OF WELLINGTON   (New Zealand)

^b NANJING UNIVERSITY   (China)

Author keywords

feature selection; filter approaches; multi objective optimisation; particle swarm optimisation

Indexed keywords

BINARY PARTICLE SWARM OPTIMISATION; CLASSIFICATION ERROR RATE; CLASSIFICATION PERFORMANCE; FEATURE SELECTION METHODS; FILTER APPROACH; MULTI OBJECTIVE ALGORITHM; NON-DOMINATED SORTING; PARTICLE SWARM OPTIMISATION;

ALGORITHMS; FEATURE EXTRACTION; MULTIOBJECTIVE OPTIMIZATION;

PARTICLE SWARM OPTIMIZATION (PSO);

EID: 84871342606     PISSN: 09540091     EISSN: 13600494     Source Type: Journal    
DOI: 10.1080/09540091.2012.737765     Document Type: Article

References (43)

1. Almuallim, H. and Dietterich, T. G. 1994. Learning Boolean Concepts in the Presence of Many Irrelevant Features. Artificial Intelligence, 69: 279-305. (doi:10.1016/0004-3702(94)90084-1)
2. Azevedo, G., Cavalcanti, G. and Filho, E. 2007. "An Approach to Feature Selection for Keystroke Dynamics Systems based on PSO and Feature Weighting". In IEEE Congress on Evolutionary Computation (CEC'07), 3577-3584. Piscataway, NJ: IEEE Press.
3. Cardie, C. Using Decision Trees to Improve Case-Based Learning. Proceedings of the Tenth International Conference on Machine Learning (ICML). pp.25-32. San Francisco, CA: Morgan Kaufmann Publishers.
4. Chakraborty, B. Genetic Algorithm with Fuzzy Fitness Function for Feature Selection. IEEE International Symposium on Industrial Electronics (ISIE'02). Vol. 1, pp.315-319. Piscataway, NJ: IEEE Press.
5. Chakraborty, B. Feature Subset Selection by Particle Swarm Optimization with Fuzzy Fitness Function. 3rd International Conference on Intelligent System and Knowledge Engineering (ISKE'08). Vol. 1, pp.1038-1042. Piscataway, NJ: IEEE Press.
6. Cervante, L., Xue, B., Zhang, M. and Shang, L. 2012. Binary Particle Swarm Optimisation for Feature Selection: A Filter Based Approach. IEEE Congress on Evolutionary Computation (CEC'2012),: 881-888.
7. Chuang, L. Y., Chang, H. W., Tu, C. J. and Yang, C. H. 2008. Improved Binary PSO for Feature Selection using Gene Expression Data. Computational Biology and Chemistry, 32(29): 29-38. (doi:10.1016/j.compbiolchem.2007.09.005)
8. Chuang, L. Y., Tsai, S. W. and Yang, C. H. 2011. Improved Binary Particle Swarm Optimization using Catfish Effect for Feature Selection. Expert Systems with Applications, 38: 12699-12707. (doi:10.1016/j.eswa.2011.04.057)
9. Dash, M. and Liu, H. 1997. Feature Selection for Classification. Intelligent Data Analysis, 1(4): 131-156. (doi:10.1016/S1088-467X(97)00008-5)
10. Dash, M. and Lee, H. 2003. Consistency-Based Search in Feature Selection. Artificial Intelligence, 151(1-2): 155-176. (doi:10.1016/S0004-3702(03)00079-1)
11. Deb, K., Pratap, A., Agarwal, S. and Meyarivan, T. 2002. A Fast and Elitist Multiobjective Genetic Algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation, 6(2): 182-197. (doi:10.1109/4235.996017)
12. Engelbrecht, A. P. 2007. Computational Intelligence: An Introduction, 2, Chichester, UK: John Wiley & Sons.
13. Esseghir, M. A., Goncalves, G. and Slimani, Y. Adaptive Particle Swarm Optimizer for Feature Selection. International conference on Intelligent data engineering and automated learning (IDEAL'10). pp.226-233. Berlin, Heidelberg: Springer Verlag.
14. Frank, A. and Asuncion, A. 2010. Machine Learning Repository, Irvine, CA: University of California, School of Information and Computer Sciences.
15. Gao, H. H., Yang, H. H. and Wang, X. Y. Ant Colony Optimization Based Network Intrusion Feature Selection and Detection. International Conference on Machine Learning and Cybernetics. Vol. 6, pp.3871-3875. Piscataway, NJ: IEEE Press.
16. Hamdani, T. M., Won, J. M., Alimi, A. M. and Karray, F. Multi-Objective Feature Selection with NSGA II. 8th International Conference on Adaptive and Natural Computing Algorithms (ICANNGA'07) Par, Edited by: Beliczynski, B., Dzielinski, A., Iwanowski, M. and Ribeiro, B. Vol. 4431, pp.240-247. Berlin, Heidelberg: Springer-Verlag.
17. Huang, C. L. and Dun, J. F. 2008. A Distributed PSO-SVM Hybrid System with Feature Selection and Parameter Optimization. Application on Soft Computing, 8: 1381-1391. (doi:10.1016/j.asoc.2007.10.007)
18. Iswandy, K. and Koenig, A. Feature-Level Fusion by Multi-Objective Binary Particle Swarm Based Unbiased Feature Selection for Optimized Sensor System Design. IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems. pp.365-370. Piscataway, NJ: IEEE Press.
19. Kennedy, J. and Eberhart, R. Particle Swarm Optimization. IEEE International Conference on Neural Networks. Vol. 4, pp.1942-1948. Piscataway, NJ: IEEE Press.
20. Kennedy, J. and Eberhart, R. A Discrete Binary Version of the Particle Swarm Algorithm. IEEE International Conference on Systems, Man, and Cybernetics. 1997. Computational Cybernetics and Simulation., Vol. 5, pp.4104-4108. Piscataway, NJ: IEEE Press.
21. Kira, K. and Rendell, L. A. A Practical Approach to Feature Selection. Assorted Conferences and Workshops, Edited by: Sleeman, D. H. and Edwards, P. pp.249-256. San Francisco, CA: Morgan Kaufmann Publishers.
22. Kohavi, R. and John, G. H. 1997. Wrappers for Feature Subset Selection. Artificial Intelligence, 97: 273-324. (doi:10.1016/S0004-3702(97)00043-X)
23. Li, X. A Non-dominated Sorting Particle Swarm Optimizer for Multiobjective Optimization. Annual Conference on Genetic and Evolutionary Computation (GECCO'03). Edited by: Cantú-Paz, E., Foster, J. A., Deb, K., Davis, L., Roy, R., O'Reilly, U.-M., Beyer, H.-G., Standish, R. K., Kendall, G., Wilson, S. W., Harman, M., Wegener, J., Dasgupta, D., Potter, M. A., Schultz, A. C., Dowsland, K. A., Jonoska, N. and Miller, J. F. pp.37-48. Berlin, Heidelberg: Springer-Verlag.
24. Liu, Y., Wang, G., Chen, H. and Dong, H. 2011. An Improved Particle Swarm Optimization for Feature Selection. Journal of Bionic Engineering, 8(2): 191-200. (doi:10.1016/S1672-6529(11)60020-6)
25. Marill, T. and Green, D. 1963. On the Effectiveness of Receptors in Recognition Systems. IEEE Transactions on Information Theory, 9(1): 11-17. (doi:10.1109/TIT.1963.1057810)
26. Ming, H. A Rough Set Based Hybrid Method to Feature Selection. International Symposium on Knowledge Acquisition and Modeling (KAM '08, pp.585-588. Piscataway, NJ: IEEE Press.
27. Mohemmed, A., Zhang, M. and Johnston, M. Particle Swarm Optimization Based Adaboost for Face Detection. IEEE Congress on Evolutionary Computation (CEC'09). pp.2494-2501. Piscataway, NJ: IEEE Press.
28. Muni, D., Pal, N. and Das, J. 2006. Genetic Programming for Simultaneous Feature Selection and Classifier Design. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 36(1): 106-117. (doi:10.1109/TSMCB.2005.854499)
29. Neshatian, K. and Zhang, M. Genetic Programming for Feature Subset Ranking in Binary Classification Problems. European Conference on Genetic Programming. Edited by: Vanneschi, L., Gustafson, S., Moraglio, A., De Falco, I. and Ebner, M. pp.121-132. Berlin, Heidelberg: Springer-Verlag.
30. Pawlak, Z. 1982. Rough Sets. International Journal of Parallel Programming, 11: 341-356.
31. Pudil, P., Novovicova, J. and Kittler, J. V. 1994. Floating Search Methods in Feature Selection. Pattern Recognition Letters, 15(11): 1119-1125. (doi:10.1016/0167-8655(94)90127-9)
32. Shannon, C. and Weaver, W. 1949. The Mathematical Theory of Communication, Urbana: The University of Illinois Press.
33. Shi, Y. and Eberhart, R. A Modified Particle Swarm Optimizer. IEEE International Conference on Evolutionary Computation (CEC'98, pp.69-73. Piscataway, NJ: IEEE Press.
34. Sierra, M. R. and Coello, C. A.C. 2005. "Improving PSO-Based Multi-objective Optimization Using Crowding, Mutation and epsilon-Dominance". In EMO, Edited by: Coello Coello, C. A., Hernández Aguirre, A. and Zitzler, E. 505-519. Berlin, Heidelberg: Springer-Verlag.
35. Stearns, S. On Selecting Features for Pattern Classifier. Proceedings of the 3rd International Conference on Pattern Recognition. pp.71-75. Coronado, CA, Piscataway, NJ: IEEE Press.
36. Unler, A. and Murat, A. 2010. A Discrete Particle Swarm Optimization Method for Feature Selection in Binary Classification Problems. European Journal of Operational Research, 206(3): 528-539. (doi:10.1016/j.ejor.2010.02.032)
37. Van Den Bergh, F. 2001. An Analysis of Particle Swarm Optimizers, Pretoria: University of Pretoria, Faculty of Natural and Agricultural Science.
38. Wang, X., Yang, J., Teng, X., Xia, W. and Jensen, R. 2007. Feature Selection Based on Rough Sets and Particle Swarm Optimization. Pattern Recognition Letters, 28(4): 459-471. (doi:10.1016/j.patrec.2006.09.003)
39. Whitney, A. 1971. A Direct Method of Nonparametric Measurement Selection. IEEE Transactions on Computers, C-20(9): 1100-1103. (doi:10.1109/T-C.1971.223410)
40. Xue, B., Zhang, M. and Browne, W. N. 2012. "New Fitness Functions in Binary Particle Swarm Optimisation for Feature Selection". In IEEE Congress on Evolutionary Computation (CEC'12), 2145-2152. Piscataway, NJ: IEEE Press.
41. Yang, C. S., Chuang, L. Y. and Li, J. C. Chaotic Maps in Binary Particle Swarm Optimization for Feature Selection. IEEE Conference on Soft Computing in Industrial Applications (SMCIA '08). pp.107-112. Piscataway, NJ: IEEE Press.
42. Yusta, S. C. 2009. Different Metaheuristic Strategies to Solve the Feature Selection Problem. Pattern Recognition Letters, 30: 525-534. (doi:10.1016/j.patrec.2008.11.012)
43. Zhu, Z. X., Ong, Y. S. and Dash, M. 2007. Wrapper-Filter Feature Selection Algorithm Using a Memetic Framework. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 37(1): 70-76. (doi:10.1109/TSMCB.2006.883267)