Binary PSO and rough set theory for feature selection: A multi-objective filter based approach

International Journal of Computational Intelligence and Applications

Volumn 13, Issue 2, 2014, Pages

  Xue, Bing ^a,b   Cervante, Liam ^a   Shang, Lin ^b   Browne, Will N ^a   Zhang, Mengjie ^a  

^a VICTORIA UNIVERSITY OF WELLINGTON   (New Zealand)

^b NANJING UNIVERSITY   (China)

Author keywords

Feature selection; multi objective optimization; particle swarm optimization; rough set theory

Indexed keywords

DECISION TREES; FEATURE EXTRACTION; MULTIOBJECTIVE OPTIMIZATION; PARTICLE SWARM OPTIMIZATION (PSO); ROUGH SET THEORY;

BETTER PERFORMANCE; BINARY PARTICLE SWARM OPTIMIZATION; CLASSIFICATION ACCURACY; CLASSIFICATION ALGORITHM; CLASSIFICATION PERFORMANCE; K-NEAREST NEIGHBORS; MULTI OBJECTIVE ALGORITHM; MULTI-OBJECTIVE PROBLEM;

ALGORITHMS;

EID: 84903730957     PISSN: 14690268     EISSN: None     Source Type: Journal    
DOI: 10.1142/S1469026814500096     Document Type: Article

References (41)

1. I. Guyon and A. Elisseeff, An introduction to variable and feature selection, J. Mach. Learn. Res. 3 (2003) 1157-1182.
2. M. Dash and H. Liu, Feature selection for classification, Intell. Data Anal. 1(4) (1997) 131-156.
3. J. Kennedy and R. Eberhart, Particle swarm optimization, IEEE Int. Conf. Neural Networks, The University of Western Australia, Perth, Western Australia, Vol. 4, pp. 1942-1948, 1995.
4. Y. Shi and R. Eberhart, A modified particle swarm optimizer, IEEE Int. Conf. Evolutionary Computation (CEC'98), Anchorage, Alaska, USA, pp. 69-73, 1998.
5. J. Kennedy and W. Spears, Matching algorithms to problems: An experimental test of the particle swarm and some genetic algorithms on the multimodal problem generator, in IEEE Congr. Evolutionary Computation (CEC'98), Anchorage, Alaska, USA, pp. 78-83, 1998.
6. Y. Liu, G. Wang, H. Chen and H. Dong, An improved particle swarm optimization for feature selection, J. Bionic Eng. 8(2) (2011) 191-200.
7. L. Cervante, B. Xue, M. Zhang and L. Shang, Binary particle swarm optimisation for feature selection: A filter based approach, in IEEE Congr. Evolutionary Computation (CEC'2012), pp. 881-888, 2012.
8. I. A. Gheyas and L. S. Smith, Feature subset selection in large dimensionality domains, Pattern Recogn. 43(1) (2010) 5-13.
9. Z. Pawlak, Rough sets, Int. J. Parallel Program. 11 (1982) 341-356.
10. X. Wang, J. Yang, X. Teng, W. Xia and R. Jensen, Feature selection based on rough sets and particle swarm optimization, Pattern Recogn. Lett. 28(4) (2007) 459-471. (Pubitemid 44920436)
11. Y. Yao and Y. Zhao, Attribute reduction in decision-theoretic rough set models, Inf. Sci. 178(17) (2008) 3356-3373.
12. C. Bae, W.-C. Yeh, Y. Y. Chung and S.-L. Liu, Feature selection with intelligent dynamic swarm and rough set, Expert Syst. Appl. 37(10) (2010) 7026-7032.
13. Y. Chen, D. Miao and R. Wang, A rough set approach to feature selection based on ant colony optimization, Pattern Recogn. Lett. 31(3) (2010) 226-233.
14. L. Cervante, B. Xue, L. Shang and M. Zhang, A dimension reduction approach to classification based on particle swarm optimisation and rough set theory, in 25th Australasian Joint Conf. Artificial Intelligence, Lecture Notes in Computer Science, Vol. 7691 (Springer, 2012), pp. 313-325.
15. L. Cervante, B. Xue, L. Shang and M. Zhang, A multi-objective feature selection approach based on binary pso and rough set theory, in 13th European Conf. Evolutionary Computation in Combinatorial Optimization (EvoCOP), Lecture Notes in Computer Science, Vol. 7832 (Springer, 2013), pp. 25-36.
16. L. Cervante, B. Xue, L. Shang and M. Zhang, Binary particle swarm optimisation and rough set theory for dimension reduction in classification, in IEEE Congr. Evolutionary Computation (CEC'13), Cancun, Mexico, pp. 2428-2435, 2013.
17. J. Kennedy and R. Eberhart, A discrete binary version of the particle swarm algorithm, in IEEE Int. Conf. Systems, Man, and Cybernetics, 1997, Computational Cybernetics and Simulation, Orlando, Florida, USA, Vol. 5, pp. 4104-4108, 1997.
18. A. Whitney, A direct method of nonparametric measurement selection, IEEE Trans. Comput. C-20(9) (1971) 1100-1103.
19. T. Marill and D. Green, On the effectiveness of receptors in recognition systems, IEEE Trans. Inf. Theory 9(1) (1963) 11-17.
20. S. Stearns, On selecting features for pattern classifier, in Proc. 3rd Int. Conf. Pattern Recognition (Coronado, Calif, USA), pp. 71-75, 1976.
21. P. Pudil, J. Novovicova and J. V. Kittler, Floating search methods in feature selection, Pattern Recogn. Lett. 15(11) (1994) 1119-1125.
22. L. Oliveira, R. Sabourin, F. Bortolozzi and C. Suen, Feature selection using multi-objective genetic algorithms for handwritten digit recognition, in 16th Int. Conf. Pattern Recognition (ICPR'02), Quebec City, Canada, Vol. 1, pp. 568-571, 2002. (Pubitemid 44845061)
23. Z. X. Zhu, Y. S. Ong and M. Dash, Wrapper-filter feature selection algorithm using a memetic framework, IEEE Trans. Syst. Man Cybern. B, Cybern. 37(1) (2007) 70-76. (Pubitemid 46358481)
24. K. Neshatian and M. Zhang, Dimensionality reduction in face detection: A genetic programming approach, in 24th Int. Conf. Image and Vision Computing New Zealand (IVCNZ'09), pp. 391-396, 2009.
25. K. Neshatian, M. Zhang and P. Andreae, Genetic programming for feature ranking in classification problems, in Simulated Evolution and Learning, Lecture Notes in Computer Science, Vol. 5361 (Springer, Berlin/Heidelberg, 2008), pp. 544-554.
26. H. R. Kanan and K. Faez, An improved feature selection method based on ant colony optimization (aco) evaluated on face recognition system, Appl. Math. Comput. 205(2) (2008) 716-725.
27. Y. Marinakis, M. Marinaki and G. Dounias, Particle swarm optimization for pap-smear diagnosis, Expert Syst. Appl. 35(4) (2008) 1645-1656.
28. C. L. Huang and J. F. Dun, A distributed PSO-SVM hybrid system with feature selection and parameter optimization, Appl. Soft Comput. 8 (2008) 1381-1391.
29. R. Fdhila, T. Hamdani and A. Alimi, Distributed mopso with a new population subdivision technique for the feature selection, in 5th Int. Symp. Computational Intelligence and Intelligent Informatics (ISCIII 2011), Florida, USA, pp. 81-86, 2011.
30. L. Y. Chuang, H. W. Chang, C. J. Tu and C. H. Yang, Improved binary PSO for feature selection using gene expression data, Comput. Biol. Chem. 32(29) (2008) 29-38.
31. M. A. Hall, Correlation-based feature subset selection for machine learning, PhD thesis, The University of Waikato, Hamilton, New Zealand, 1999.
32. H. Almuallim and T. G. Dietterich, Learning boolean concepts in the presence of many irrelevant features, Artif. Intell. 69 (1994) 279-305.
33. K. Kira and L. A. Rendell, A practical approach to feature selection, Assorted Conf. and Workshops, Aberdeen, Scotland, pp. 249-256, 1992.
34. B. Chakraborty, Genetic algorithm with fuzzy fitness function for feature selection, in IEEE Int. Symp. Industrial Electronics (ISIE'02), L'Aquila, Italy, Vol. 1, pp. 315-319, 2002.
35. B. Chakraborty, Feature subset selection by particle swarm optimization with fuzzy fitness function, in 3rd Int. Conf. Intelligent System and Knowledge Engineering (ISKE'08), Xiamen, China, Vol. 1, pp. 1038-1042, 2008.
36. K. Neshatian and M. Zhang, Pareto front feature selection: Using genetic programming to explore feature space, in Proc. 11th Annual Conf. Genetic and Evolutionary Computation (GECCO'09), Montreal, Canada, pp. 1027-1034, 2009.
37. K. Iswandy and A. Koenig, Feature-level fusion by multi-objective binary particle swarm based unbiased feature selection for optimized sensor system design, in IEEE Int. Conf. Multisensor Fusion and Integration for Intelligent Systems, Heidelberg, Germany, pp. 365-370, 2006. (Pubitemid 351409455)
38. M. R. Sierra and C. A. C. Coello, Improving PSO-based multi-objective optimization using crowding, mutation and epsilon-dominance, in Proc. Third Int. Conf. Evolutionary Multi-Criterion Optimization, Guanajuato, Mexico, pp. 505-519, 2005. (Pubitemid 41251786)
39. K. Bache and M. Lichman, UCI Machine Learning Repository [http://archive.ics.uci.edu/ml]. Irvine, CA: University of California, School of Information and Computer Science (2013).
40. I. H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques, 2nd edn. (Morgan Kaufmann, 2005).
41. B. Xue, L. Cervante, L. Shang, W. N. Browne and M. Zhang, A multi-objective particle swarm optimisation for filter based feature selection in classification problems, Connect. Sci. 24 (2012) 91-116.