Particle swarm optimization for feature selection in classification: A multi-objective approach

IEEE Transactions on Cybernetics

Volumn 43, Issue 6, 2013, Pages 1656-1671

  Xue, Bing ^a   Zhang, Mengjie ^a   Browne, Will N ^a  

^a VICTORIA UNIVERSITY OF WELLINGTON   (New Zealand)

Author keywords

Feature selection; multi objective optimization; particle swarm optimization (PSO)

Indexed keywords

CLASSIFICATION PERFORMANCE; EVOLUTIONARY MULTI-OBJECTIVE ALGORITHMS; FEATURE SELECTION ALGORITHM; FEATURE SELECTION METHODS; FEATURE SELECTION PROBLEM; MINIMIZING THE NUMBER OF; MULTI OBJECTIVE ALGORITHM; MULTI OBJECTIVE PARTICLE SWARM OPTIMIZATION;

CLASSIFICATION (OF INFORMATION); FEATURE EXTRACTION; MULTIOBJECTIVE OPTIMIZATION; PARTICLE SWARM OPTIMIZATION (PSO);

ALGORITHMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; DECISION SUPPORT SYSTEM; INFORMATION RETRIEVAL; METHODOLOGY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DECISION SUPPORT TECHNIQUES; INFORMATION STORAGE AND RETRIEVAL; PATTERN RECOGNITION, AUTOMATED;

EID: 84887799080     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2227469     Document Type: Article

References (58)

1. I. A. Gheyas and L. S. Smith, "Feature subset selection in large dimensionality domains," Pattern Recognit., vol. 43, no. 1, pp. 5-13, Jan. 2010.
2. M. Dash and H. Liu, "Feature selection for classification," Intell. Data Anal., vol. 1, no. 1-4, pp. 131-156, 1997.
3. A. Unler and A. Murat, "A discrete particle swarm optimization method for feature selection in binary classification problems," Eur. J. Oper. Res., vol. 206, no. 3, pp. 528-539, Nov. 2010.
4. I. Guyon and A. Elisseeff, "An introduction to variable and feature selection," J. Mach. Learn. Res., vol. 3, pp. 1157-1182, Mar. 2003.
5. A. Whitney, "A direct method of nonparametric measurement selection," IEEE Trans. Comput., vol. C-20, no. 9, pp. 1100-1103, Sep. 1971.
6. T. Marill and D. Green, "On the effectiveness of receptors in recognition systems," IEEE Trans. Inf. Theory, vol. IT-9, no. 1, pp. 11-17, Jan. 1963.
7. J. Kennedy and R. Eberhart, "Particle swarm optimization," in Proc. IEEE Int. Conf. Neural Netw., 1995, vol. 4, pp. 1942-1948.
8. Y. Shi and R. Eberhart, "A modified particle swarm optimizer," in Proc. IEEE Int. CEC, 1998, pp. 69-73.
9. Y. Liu, G. Wang, H. Chen, and H. Dong, "An improved particle swarm optimization for feature selection," J. Bionic Eng., vol. 8, no. 2, pp. 191-200, Jun. 2011.
10. A. Mohemmed, M. Zhang, and M. Johnston, "Particle swarm optimization based AdaBoost for face detection," in Proc. IEEE CEC, 2009, pp. 2494-2501.
11. J. Kennedy and R. Eberhart, "A discrete binary version of the particle swarm algorithm," in Proc. IEEE Int. Conf. Syst., Man, Cybern., Comput. Cybern. Simul., 1997, vol. 5, pp. 4104-4108.
12. L. Y. Chuang, H. W. Chang, C. J. Tu, and C. H. Yang, "Improved binary PSO for feature selection using gene expression data," Comput. Biol. Chem., vol. 32, no. 1, pp. 29-37, Feb. 2008.
13. C. L. Huang and J. F. Dun, "A distributed PSO-SVM hybrid system with feature selection and parameter optimization," Appl. Soft Comput., vol. 8, no. 4, pp. 1381-1391, Sep. 2008.
14. A. P. Engelbrecht, Computational Intelligence: An Introduction., 2nd ed. Chichester, U.K.: Wiley, 2007.
15. R. Kohavi and G. H. John, "Wrappers for feature subset selection," Artif. Intell., vol. 97, no. 1/2, pp. 273-324, Dec. 1997. (Pubitemid 127401107)
16. S. C. Yusta, "Different metaheuristic strategies to solve the feature selection problem," Pattern Recognit. Lett., vol. 30, no. 5, pp. 525-534, Apr. 2009.
17. S. Stearns, "On selecting features for pattern classifier," in Proc. 3rd Int. Conf. Pattern Recog., Coronado, CA, 1976, pp. 71-75.
18. P. Pudil, J. Novovicova, and J. V. Kittler, "Floating search methods in feature selection," Pattern Recognit. Lett., vol. 15, no. 11, pp. 1119-1125, Nov. 1994.
19. K. Kira and L. A. Rendell, "A practical approach to feature selection," in Proc. 9th Int. Workshop Mach. Learn., 1992, pp. 249-256.
20. C. Cardie, "Using decision trees to improve case-based learning," in Proc. 10th ICML, 1993, pp. 25-32.
21. H. Almuallim and T. G. Dietterich, "Learning Boolean concepts in the presence of many irrelevant features," Artif. Intell., vol. 69, no. 1/2, pp. 279-305, Sep. 1994.
22. B. Chakraborty, "Genetic algorithm with fuzzy fitness function for feature selection," in Proc IEEE ISIE, 2002, vol. 1, pp. 315-319.
23. B. Chakraborty, "Feature subset selection by particle swarm optimization with fuzzy fitness function," in Proc. 3rd Int. Conf. ISKE, 2008, vol. 1, pp. 1038-1042.
24. T. M. Hamdani, J.-M. Won, A. M. Alimi, and F. Karray, "Multi-objective feature selection with NSGA II," in Proc. 8th ICANNGA Part I, 2007, vol. 4431, pp. 240-247.
25. M. Banerjee, S. Mitra, and H. Banka, "Evolutionary rough feature selection in gene expression data," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 37, no. 4, pp. 622-632, Jul. 2007. (Pubitemid 47061963)
26. Z. X. Zhu, Y. S. Ong, and M. Dash, "Wrapper-filter feature selection algorithm using a memetic framework," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 1, pp. 70-76, Feb. 2007. (Pubitemid 46358481)
27. D. Muni, N. Pal, and J. Das, "Genetic programming for simultaneous feature selection and classifier design," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 36, no. 1, pp. 106-117, Feb. 2006. (Pubitemid 43174145)
28. K. Neshatian and M. Zhang, "Genetic programming for feature subset ranking in binary classification problems," in Proc. Eur. Conf. Genetic Program., 2009, pp. 121-132.
29. K. Neshatian, M. Zhang, and P. Andreae, "Genetic programming for feature ranking in classification problems," in Simulated Evolution and Learning, vol. 5361, Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, 2008, pp. 544-554.
30. K. Neshatian andM. Zhang, "Pareto front feature selection: Using genetic programming to explore feature space," in Proc. 11th Annu. GECCO, New York, 2009, pp. 1027-1034.
31. K. Neshatian and M. Zhang, "Unsupervised elimination of redundant features using genetic programming," in Proc. 22nd Australas. Joint Conf. Artif. Intell., vol. 5866, Lecture Notes in Computer Science, 2009, pp. 432-442.
32. K. Neshatian and M. Zhang, "Using genetic programming for contextsensitive feature scoring in classification problems," Connect. Sci., vol. 23, no. 3, pp. 183-207, 2011.
33. K. Neshatian andM. Zhang, "Improving relevance measures using genetic programming," in Proc. EuroGP, vol. 7244, Lecture Notes in Computer Science, 2012, pp. 97-108.
34. H. H. Gao, H. H. Yang, and X. Y. Wang, "Ant colony optimization based network intrusion feature selection and detection," in Proc. Int. Conf. Mach. Learn. Cybern., 2005, vol. 6, pp. 3871-3875.
35. H. Ming, "A rough set based hybrid method to feature selection," in Proc. Int. Symp. KAM, 2008, pp. 585-588.
36. X. Wang, J. Yang, X. Teng, W. Xia, and R. Jensen, "Feature selection based on rough sets and particle swarm optimization," Pattern Recognit. Lett., vol. 28, no. 4, pp. 459-471, Mar. 2007. (Pubitemid 44920436)
37. G. Azevedo, G. Cavalcanti, and E. Filho, "An approach to feature selection for keystroke dynamics systems based on PSO and feature weighting," in Proc. IEEE CEC, 2007, pp. 3577-3584.
38. S. W. Lin, K. C. Ying, S. C. Chen, and Z. J. Lee, "Particle swarm optimization for parameter determination and feature selection of support vector machines," Expert Syst. Appl., vol. 35, no. 4, pp. 1817-1824, Nov. 2008.
39. C. S. Yang, L. Y. Chuang, and J. C. Li, "Chaotic maps in binary particle swarm optimization for feature selection," in Proc. IEEE Conf. SMCIA, 2008, pp. 107-112.
40. L. Y. Chuang, S. W. Tsai, and C. H. Yang, "Improved binary particle swarm optimization using catfish effect for feature selection," Expert Syst. Appl., vol. 38, no. 10, pp. 12 699-12 707, Sep. 2011.
41. H. N. A. Hamed, N. K. Kasabov, and S. M. Shamsuddin, " Quantuminspired particle swarm optimization for feature selection and parameter optimization in evolving spiking neural networks for classification tasks," Evol. Algorithms, vol. 1, pp. 132-148, 2011.
42. M. A. Esseghir, G. Goncalves, and Y. Slimani, "Adaptive particle swarm optimizer for feature selection," in Proc. Int. Conf. IDEAL, 2010, pp. 226-233.
43. B. Xue, M. Zhang, andW. N. Browne, "Single feature ranking and binary particle swarm optimisation based feature subset ranking for feature selection," in Proc. 35th ACSC, vol. 122, Lecture Notes in Computer Science, Melbourne, Australia, 2012, pp. 27-36.
44. L. Cervante, B. Xue, L. Shang, and M. Zhang, "A dimension reduction approach to classification based on particle swarm optimisation and rough set theory," in Proc. 25th Australas. Joint Conf. Artif. Intell., Lecture Notes in Computer Science, Dec. 4, 2012.
45. L. Cervante, B. Xue, M. Zhang, and L. Shang, "Binary particle swarm optimisation for feature selection: A filter based approach," in Proc. IEEE CEC, 2012, pp. 1-8.
46. B. Xue, M. Zhang, and W. N. Browne, "New fitness functions in binary particle swarm optimisation for feature selection," in Proc. IEEE CEC, 2012, pp. 1-8.
47. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, "A fast and elitist multiobjective genetic algorithm: NSGA-II," IEEE Trans. Evol. Comput., vol. 6, no. 2, pp. 182-197, Apr. 2002. (Pubitemid 34555372)
48. X. Li, "A non-dominated sorting particle swarm optimizer for multiobjective optimization," in Proc. Annu. GECCO, 2003, pp. 37-48.
49. M. R. Sierra and C. A. C. Coello, "Improving PSO-based multi-objective optimization using crowding, mutation and epsilon-dominance, " in Proc. EMO, 2005, pp. 505-519. (Pubitemid 41251786)
50. M. Gutlein, E. Frank, M. Hall, and A. Karwath, "Large-scale attribute selection using wrappers," in Proc. IEEE Symp. CIDM, 2009, pp. 332-339.
51. R. Caruana and D. Freitag, "Greedy attribute selection," in Proc. ICML, 1994, pp. 28-36.
52. E. Zitzler, M. Laumanns, and L. Thiele, "SPEA2: Improving the strength Pareto evolutionary algorithm," in Proc. Evol. Methods Des., Optim., Control Appl. Ind. Probl., 2001, pp. 95-100.
53. J. Knowles and D. Corne, "The Pareto archived evolution strategy: A new baseline algorithm for Pareto multiobjective optimisation," in Proc. CEC, 1999, vol. 1, pp. 98-105.
54. A. Frank and A. Asuncion, UCI Machine Learning Repository, 2010.
55. T. Abeel, Y. V. de Peer, and Y. Saeys, "Java-ml: A machine learning library," J. Mach. Learn. Res., vol. 10, pp. 931-934, Dec. 2009.
56. T. Hastie, R. Tibshirani, J. Friedman, and J. Franklin, "The elements of statistical learning: Data mining, inference and prediction," in The Mathematical Intelligencer, vol. 27. New York: Springer-Verlag, 2005, pp. 83-85.
57. F. Van Den Bergh, "An analysis of particle swarm optimizers," Ph.D. dissertation, Faculty Nat. Agricult. Sci., Univ. Pretoria, Pretoria, South Africa, 2001.
58. A. Auger, J. Bader, D. Brockhoff, and E. Zitzler, "Theory of the hypervolume indicator: Optimal distributions and the choice of the reference point," in Proc. 10th ACM SIGEVO Workshop FOGA, New York, 2009, pp. 87-102.