Multi-objective evolutionary algorithms for filter based feature selection in classification

International Journal on Artificial Intelligence Tools

Volumn 22, Issue 4, 2013, Pages

  Xue, Bing ^a,b   Cervante, Liam ^a   Shang, Lin ^b   Browne, Will N ^a   Zhang, Mengjie ^a  

^a VICTORIA UNIVERSITY OF WELLINGTON   (New Zealand)

^b NANJING UNIVERSITY   (China)

Author keywords

evolutionary algorithms; Feature selection; filter approaches; genetic algorithms; multi objective optimisation

Indexed keywords

CLASSIFICATION PERFORMANCE; EVOLUTIONARY COMPUTATION TECHNIQUES; EVOLUTIONARY MULTI-OBJECTIVE ALGORITHMS; FEATURE SELECTION ALGORITHM; FILTER APPROACH; MULTI OBJECTIVE EVOLUTIONARY ALGORITHMS; MULTI-OBJECTIVE GENETIC ALGORITHM; STRENGTH PARETO EVOLUTIONARY ALGORITHM;

DECISION TREES; EVOLUTIONARY ALGORITHMS; FEATURE EXTRACTION; GENETIC ALGORITHMS; MULTIOBJECTIVE OPTIMIZATION;

CLASSIFICATION (OF INFORMATION);

EID: 84883206290     PISSN: 02182130     EISSN: 17936349     Source Type: Journal    
DOI: 10.1142/S0218213013500243     Document Type: Article

References (43)

1. M. Dash and H. Liu, Feature selection for classification, Intelligent Data Analysis 1(4) (1997) 131-156.
2. I. Guyon and A. Elisseeff, An introduction to variable and feature selection, The Journal of Machine Learning Research 3 (2003) 1157-1182.
3. A. Unler and A. Murat, A discrete particle swarm optimization method for feature selection in binary classification problems, European Journal of Operational Research 206(3) (2010) 528-539.
4. R. Kohavi and G. H. John,Wrappers for feature subset selection, Artificial Intelligence 97 (1997) 273-324.
5. A. Whitney, A direct method of nonparametric measurement selection, IEEE Trans- actions on Computers C20(9) (1971) 1100-1103.
6. T. Marill and D. Green, On the effectiveness of receptors in recognition systems, IEEE Transactions on Information Theory 9(1) 11-17 (1963).
7. Y. Liu, G. Wang, H. Chen, and H. Dong, An improved particle swarm optimization for feature selection, Journal of Bionic Engineering 8(2) (2011) 191-200.
8. B. Chakraborty, Genetic algorithm with fuzzy fitness function for feature selection, in IEEE Int. Symp. on Industrial Electronics (ISIE02), Vol. 1 (2002), pp. 315-319.
9. K. Neshatian andM. Zhang, Genetic programming for feature subset ranking in binary classification problems, in European Conference on Genetic Programming (2009), pp. 121-132.
10. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, A fast and elitist multiobjective genetic algorithm: NSGA-II, IEEE Transactions on Evolutionary Computation 6(2) (2002) 182-197.
11. E. Zitzler, M. Laumanns, and L. Thiele, SPEA2: Improving the strength pareto evolutionary algorithm, in Evolutionary Methods for Design, Optimization and Control with Applications to Industrial Problems (2002), pp. 95-100.
12. K. Deb, Multi-Objective Optimization using Evolutionary Algorithms (Chichester, UK: John Wiley & Sons, 2001).
13. A. P. Engelbrecht, Computational Intelligence: An Introduction, 2nd edn. (Wiley, 2007).
14. J. H. Holland, Adaption in Natural and Artificial Systems (University of Michigan Press, 1975).
15. C. Shannon and W. Weaver, The Mathematical Theory of Communication. (Urbana: The University of Illinois Press, 1949).
16. L. Cervante, B. Xue, M. Zhang, and L. Shang, Binary particle swarm optimisation for feature selection: A filter based approach, in IEEE Congress on Evolutionary Compu- tation (CEC2012) (2012), pp. 881-888.
17. K. Kira and L. A. Rendell, A practical approach to feature selection, Assorted Conferences and Workshops (1992), pp. 249-256.
18. C. Cardie, Using decision trees to improve case-based learning, in Proc. of the 10th Int. Conf. on Machine Learning (ICML) (1993), pp. 25-32.
19. H. Almuallim and T. G. Dietterich, Learning boolean concepts in the presence of many irrelevant features, Artificial Intelligence 69 (1994) 279-305.
20. S. C. Yusta, Different metaheuristic strategies to solve the feature selection problem, Pattern Recognition Letters 30 (2009) 525-534.
21. S. Stearns, On selecting features for pattern classifier, in Proc. of the 3rd Int. Conf. on Pattern Recognition (Coronado, CA, 1976), pp. 71-75.
22. P. Pudil, J. Novovicova, and J. V. Kittler, Floating search methods in feature selection, Pattern Recognition Letters 15(11) (1994) 1119-1125.
23. C.-L. Huang and C.-J. Wang, A GA-based feature selection and parameters optimizationfor support vector machines, Expert Systems with Applications 31(2) (2006) 231-240.
24. T. M. Hamdani, J.-M. Won, A. M. Alimi, and F. Karray, Multi-objective feature selection with NSGA II, in 8th Int. Conf. on Adaptive and Natural Computing Algorithms (ICANNGA07), Part I, Vol. 4431 (Springer Berlin Heidelberg, 2007), pp. 240-247.
25. A. J. Soto, R. L. Cecchini, G. E. Vazquez, and I. Ponzoni, Multi-objective feature selection in QSAR using a machine learning approach, QSAR & Combinatorial Science 28(11-12) (2009) 1509-1523.
26. A. Guillen, H. Pomares, J. Gonzalez, I. Rojas, O. Valenzuela, and B. Prieto, Parallel multiobjective memetic rbfnns design and feature selection for function approximation problems, Neurocomputing 72(16-18) (2009) 3541-3555.
27. B. Huang, B. Buckley, and T.-M. Kechadi, Multi-objective feature selection by using NSGA-II for customer churn prediction in telecommunications, Expert Systems with Applications 37(5) (2010) 3638-3646.
28. Z. X. Zhu, Y. S. Ong, and M. Dash, Wrapper-filter feature selection algorithm using a memetic framework, IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 37(1) (2007) 70-76.
29. D. Muni, N. Pal, and J. Das, Genetic programming for simultaneous feature selection and classifier design, IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 36(1) (2006) 106-117.
30. K. Neshatian and M. Zhang, Pareto front feature selection: Using genetic programming to explore feature space, in Proc. of the 11th Ann. Conf. on Genetic and Evolutionary Computation (GECCO09) (New York, NY, USA, 2009), pp. 1027-1034.
31. X. Wang, J. Yang, X. Teng, W. Xia, and R. Jensen, Feature selection based on rough sets and particle swarm optimization, Pattern Recognition Letters, 28(4) (2007) 459-471.
32. Z. Pawlak, Rough sets, Int. Journal of Parallel Programming 11 (1982) 341-356.
33. M. A. Esseghir, G. Goncalves, and Y. Slimani, Adaptive particle swarm optimizer for feature selection, in Int. Conf. on Intelligent Data Engineering and Automated Learning (IDEAL10) (Springer Verlag, Berlin, Heidelberg, 2010), pp. 226-233.
34. S. W. Lin, K. C. Ying, S. C. Chen, and Z. J. Lee, Particle swarm optimization for parameter determination and feature selection of support vector machines, Expert Systems with Applications 35(4) (2008) 1817-1824.
35. H. Ming, A rough set based hybrid method to feature selection, in Int. Symp. on Knowledge Acquisition and Modeling (KAM 08) (2008), pp. 585-588.
36. R. K. Sivagaminathan and S. Ramakrishnan, A hybrid approach for feature subset selection using neural networks and ant colony optimization, Expert Systems with Applications 33(1) (2007) 49-60.
37. H. H. Gao, H. H. Yang, and X. Y. Wang, Ant colony optimization based network intrusion feature selection and detection, in Int. Conf. on Machine Learning and Cy- bernetics, Vol. 6 (2005), pp. 49-60.
38. A. Frank and A. Asuncion, UCI machine learning repository, (2010).
39. F. Streichert and H. Ulmer, JavaEvA - A java framework for evolutionary algorithms, Technical Report WSI-2005-06, Centre for Bioinformatics, Tubingen, University of Tubingen, (2005).
40. J. J. Durillo and A. J. Nebro, jMetal: A java framework for multi-objective optimization, Advances in Engineering Software 42 (2011) 760-771.
41. M. A. Hall, Correlation-based Feature Subset Selection for Machine Learning, PhD thesis (The University of Waikato, Hamilton, New Zealand, 1999).
42. I. H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Tech- niques, 2nd edn. (Morgan Kaufmann, 2005).
43. R. Caruana and D. Freitag, Greedy attribute selection, in Int. Conf. on Machine Learning (ICML94) (1994), pp. 28-36.