Relevance-redundancy feature selection based on ant colony optimization

Pattern Recognition

Volumn 48, Issue 9, 2015, Pages 2798-2811

  Tabakhi, Sina ^a   Moradi, Parham ^a  

^a UNIVERSITY OF KURDISTAN   (Iran)

Author keywords

Ant colony optimization; Curse of dimensionality; Feature selection; Filter model; Multivariate technique; Pattern recognition

Indexed keywords

ANT COLONY OPTIMIZATION; FEATURE EXTRACTION; PATTERN RECOGNITION; REDUNDANCY;

CLASSIFICATION TASKS; CURSE OF DIMENSIONALITY; FEATURE SELECTION METHODS; FILTER MODEL; HEURISTIC INFORMATION; MULTIVARIATE METHODS; MULTIVARIATE TECHNIQUES; RELEVANCE AND REDUNDANCIES;

HEURISTIC METHODS;

EID: 84929504035     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2015.03.020     Document Type: Article

References (62)

1. S. Theodoridis, and K. Koutroumbas Pattern Recognition 2008 Academic Press Oxford
2. H. Liu, and L. Yu Toward integrating feature selection algorithms for classification and clustering IEEE Trans. Knowl. Data Eng. 17 2005 491 502
3. A.J. Ferreira, and M.A.T. Figueiredo An unsupervised approach to feature discretization and selection Pattern Recognit. 45 2012 3048 3060
4. I.A. Gheyas, and L.S. Smith Feature subset selection in large dimensionality domains Pattern Recognit. 43 2010 5 13
5. A. Unler, A. Murat, and R.B. Chinnam mr2PSO: A maximum relevance minimum redundancy feature selection method based on swarm intelligence for support vector machine classification Inf. Sci. 181 2011 4625 4641
6. S. Tabakhi, P. Moradi, and F. Akhlaghian An unsupervised feature selection algorithm based on ant colony optimization Eng. Appl. Artif. Intell. 32 2014 112 123
7. H. Uʇuz A two-stage feature selection method for text categorization by using information gain, principal component analysis and genetic algorithm Knowl.-Based Syst. 24 2011 1024 1032
8. J. Yang, Y. Liu, Z. Liu, X. Zhu, and X. Zhang A new feature selection algorithm based on binomial hypothesis testing for spam filtering Knowl.-Based Syst. 24 2011 904 914
9. H.R. Kanan, and K. Faez An improved feature selection method based on ant colony optimization (ACO) evaluated on face recognition system Appl. Math. Comput. 205 2008 716 725
10. Z. Yan, C. Yuan, Ant colony optimization for feature selection in face recognition, in: David Zhang, Anil K. Jain (Eds.) Biometric Authentication, Springer, Berlin, Heidelberg, 2004, pp. 221-226.
11. Y. Leung, Y. Hung, and A Multiple-Filter-Multiple-Wrapper Approach to gene selection and microarray data classification IEEE/ACM Trans. Comput. Biol. Bioinform. 7 2010 108 117
12. Y. Saeys, I. Inza, and P. Larrañaga A review of feature selection techniques in bioinformatics Bioinformatics 23 2007 2507 2517
13. S. Nemati, and M.E. Basiri Text-independent speaker verification using ant colony optimization-based selected features Expert Syst. Appl. 38 2011 620 630
14. H. Yu, G. Gu, H. Liu, J. Shen, and J. Zhao A modified ant colony optimization algorithm for tumor marker gene selection Genomics Proteomics Bioinform. 7 2009 200 208
15. I. Guyon, J. Weston, S. Barnhill, and V. Vapnik Gene selection for cancer classification using support vector machines Mach. Learn. 46 2002 389 422
16. C.-L. Huang, and C.-Y. Tsai A hybrid SOFM-SVR with a filter-based feature selection for stock market forecasting Expert Syst. Appl. 36 2009 1529 1539
17. Y. Marinakis, M. Marinaki, M. Doumpos, and C. Zopounidis Ant colony and particle swarm optimization for financial classification problems Expert Syst. Appl. 36 2009 10604 10611
18. H. Liu, and H. Motoda Computational Methods of Feature Selection 2007 Chapman & Hall/CRC London
19. H. Peng, F. Long, and C. Ding Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy IEEE Trans. Pattern Anal. Mach. Intell. 27 2005 1226 1238
20. P.M. Narendra, and K. Fukunaga A branch and bound algorithm for feature subset selection IEEE Trans. Comput. 26 1977 917 922
21. L. Xu, P. Yan, T. Chang, Best first strategy for feature selection, in: Proceedings of the Ninth International Conference on Pattern Recognition, 1988, pp. 706-708.
22. J. Martínez Sotoca, and F. Pla Supervised feature selection by clustering using conditional mutual information-based distances Pattern Recognit. 43 2010 2068 2081
23. S. Nemati, M.E. Basiri, N. Ghasem-Aghaee, and M.H. Aghdam A novel ACO-GA hybrid algorithm for feature selection in protein function prediction Expert Syst. Appl. 36 2009 12086 12094
24. M.H. Aghdam, N. Ghasem-Aghaee, and M.E. Basiri Text feature selection using ant colony optimization Expert Syst. Appl. 36 2009 6843 6853
25. B. Chen, L. Chen, and Y. Chen Efficient ant colony optimization for image feature selection Signal Process. 93 2013 1566 1576
26. M. Dorigo, T. Stützle, Ant colony optimization: overview and recent advances, in: Handbook of Metaheuristics, Springer, US, 2010, pp. 227-263.
27. M. Dorigo, G. Di Caro, Ant colony optimization: a new meta-heuristic, in: Proceedings of the 1999 Congress on Evolutionary Computation, 1999, pp. 1470-1477.
28. M. Dorigo, and L.M. Gambardella Ant colony system: a cooperative learning approach to the traveling salesman problem IEEE Trans. Evol. Comput. 1 1997 53 66
29. M. Dorigo, and L.M. Gambardella Ant colonies for the travelling salesman problem Biosystems 43 1997 73 81
30. M. Dorigo, V. Maniezzo, and A. Colorni Ant system: optimization by a colony of cooperating agents IEEE Trans. Syst. Man Cybern.-Part B: Cybern. 26 1996 29 41
31. I. Guyon, and A. Elisseeff An introduction to variable and feature selection J. Mach. Learn. Res. 3 2003 1157 1182
32. C. Lai, M.J.T. Reinders, and L. Wessels Random subspace method for multivariate feature selection Pattern Recognit. Lett. 27 2006 1067 1076
33. L.E. Raileanu, and K. Stoffel Theoretical comparison between the Gini Index and information gain criteria Ann. Math. Artif. Intell. 41 2004 77 93
34. L. Yu, H. Liu, Feature selection for high-dimensional data: a fast correlation-based filter solution, in: Proceedings of the 20th International Conference on Machine Learning, 2003, pp. 856-863.
35. W. Shang, H. Huang, H. Zhu, Y. Lin, Y. Qu, and Z. Wang A novel feature selection algorithm for text categorization Expert Syst. Appl. 33 2007 1 5
36. T.M. Mitchell Machine Learning 1997 McGraw-Hill, Inc.
37. J.R. Quinlan Induction of decision trees Mach. Learn. 1 1986 81 106
38. J. Biesiada, W. Duch, Feature selection for high-dimensional data: a Pearson redundancy based filter, in: Computer Recognition Systems, vol. 2, Springer, Berlin, Heidelberg, 2007, pp. 242-249.
39. Q. Gu, Z. Li, J. Han, Generalized Fisher score for feature selection, in: Proceedings of the International Conference on Uncertainty in Artificial Intelligence, 2011.
40. X. He, D. Cai, and P. Niyogi Laplacian Score for feature selection Adv. Neural Inf. Process. Syst. 18 2005
41. K. Kira, L.A. Rendell, The feature selection problem: traditional methods and a new algorithm, in: Proceedings of the Tenth National Conference on Artificial intelligence, AAAI Press, San Jose, CA, 1992, pp. 129-134.
42. G. Wang, Q. Song, B. Xu, and Y. Zhou Selecting feature subset for high dimensional data via the propositional FOIL rules Pattern Recognit. 46 2013 199 214
43. P. Mitra, C.A. Murthy, and S.K. Pal Unsupervised feature selection using feature similarity IEEE Trans. Pattern Anal. Mach. Intell. 24 2002 301 312
44. M. Haindl, P. Somol, D. Ververidis, C. Kotropoulos, Feature selection based on mutual correlation, in: Pattern Recognition, Image Analysis and Applications, Springer, Berlin, Heidelberg, 2006, pp. 569-577.
45. L. Yu, and H. Liu Efficient feature selection via analysis of relevance and redundancy J. Mach. Learn. Res. 5 2004 1205 1224
46. A. Unler, and A. Murat A discrete particle swarm optimization method for feature selection in binary classification problems Eur. J. Oper. Res. 206 2010 528 539
47. R. Sikora, and S. Piramuthu Framework for efficient feature selection in genetic algorithm based data mining Eur. J. Oper. Res. 180 2007 723 737
48. J. Yang, and V. Honavar Feature subset selection using a genetic algorithm IEEE Intell. Syst. Their Appl. 13 1998 44 49
49. M.E. Farmer, S. Bapna, A.K. Jain, Large scale feature selection using modified random mutation hill climbing, in: Proceedings of the 17th International Conference on Pattern Recognition, 2004, pp. 287-290.
50. D.B. Skalak, Prototype and feature selection by sampling and random mutation hill climbing algorithms, in: Proceedings of the 11th International Conference on Machine Learning 1994, pp. 293-301.
51. R. Meiri, and J. Zahavi Using simulated annealing to optimize the feature selection problem in marketing applications Eur. J. Oper. Res. 171 2006 842 858
52. H. Chouaib, O.R. Terrades, S. Tabbone, F. Cloppet, N. Vincent, Feature selection combining genetic algorithm and Adaboost classifiers, in: 19th International Conference on Pattern Recognition, 2008, ICPR 2008, 2008, pp. 1-4.
53. V. Sugumaran, V. Muralidharan, and K.I. Ramachandran Feature selection using Decision Tree and classification through Proximal Support Vector Machine for fault diagnostics of roller bearing Mech. Syst. Signal Process. 21 2007 930 942
54. N. Friedman, D. Geiger, and M. Goldszmidt Bayesian network classifiers Mach. Learn. 29 1997 131 163
55. M.E. ElAlami A filter model for feature subset selection based on genetic algorithm Knowl.-Based Syst. 22 2009 356 362
56. C.-K. Zhang, H. Hu, Feature selection using the hybrid of ant colony optimization and mutual information for the forecaster, in: Proceedings of the Fourth International Conference on Machine Learning and Cybernetics, 2005, pp. 1728-1732.
57. J. Huang, Y. Cai, X. Xu, A wrapper for feature selection based on mutual information, in: Proceedings of the 18th International Conference on Pattern Recognition, 2006, pp. 618-621.
58. H.-H. Hsu, C.-W. Hsieh, M.-D. Lu, A hybrid feature selection mechanism, in: Proceedings of the Eighth International Conference on Intelligent Systems Design and Applications, 2008, pp. 271-276.
59. A. Asuncion, D. Newman, UCI repository of machine learning datasets, Available from: (http://archive.ics.uci.edu/ml/datasets.html), 2007.
60. A. Statnikov, C.F. Aliferis, I. Tsamardinos, Gems: Gene Expression Model Selector, Available from: (http://www.gems-system.org/), 2005.
61. I. Guyon, NIPS feature selection challenge, Available from: (http://www.nipsfsc.ecs.soton.ac.uk/datasets), 2003.
62. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, I. Witten, The WEKA data mining software, Available from: (http://www.cs.waikato.ac.nz/ml/weka).