Evolutionary wrapper approaches for training set selection as preprocessing mechanism for support vector machines: Experimental evaluation and support vector analysis

Applied Soft Computing Journal

Volumn 38, Issue , 2015, Pages 10-22

  Verbiest, Nele ^a   Derrac, Joaquín ^b   Cornelis, Chris ^a,c   García, Salvador ^c,d   Herrera, Francisco ^c  

^a GHENT UNIVERSITY   (Belgium)

^b Affectv Limited   (United Kingdom)

^c UNIVERSITY OF GRANADA   (Spain)

^d KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

Author keywords

Data reduction; Support vector machines; Training set selection

Indexed keywords

DATA REDUCTION; VECTORS;

CLASSIFICATION TECHNIQUE; EVOLUTIONARY APPROACH; EXPERIMENTAL EVALUATION; SUPPORT VECTOR; SUPPORT VECTOR MACHINE (SVMS); TRAINING ACCURACY; TRAINING SET SELECTION; WRAPPER APPROACH;

SUPPORT VECTOR MACHINES;

EID: 84944226789     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2015.09.006     Document Type: Article

References (39)

1. S. García, A. Fernandez, and F. Herrera Enhancing the effectiveness and interpretability of decision tree and rule induction classifiers with evolutionary training set selection over imbalanced problems Appl. Soft Comput. 9 2009 1304 1314
2. J.R. Cano, F. Herrera, and M. Lozano Evolutionary stratified training set selection for extracting classification rules with trade-off precision-interpretability Data Knowl. Eng. 60 2007 90 108
3. S. García, J. Luengo, and F. Herrera Data Preprocessing in Data Mining 2015 Springer
4. J. Derrac, S. García, and F. Herrera Fuzzy nearest neighbor algorithms: taxonomy, experimental analysis and prospects Inf. Sci. 260 2014 98 119
5. S. García, J. Derrac, J.R. Cano, and F. Herrera Prototype selection for nearest neighbor classification: taxonomy and empirical study IEEE Trans. Pattern Anal. Mach. Intell. 34 3 2012 417 435
6. J. Chen, C. Zhang, X. Xue, and C.L. Liu Fast instance selection for speeding up support vector machines Knowl. Based Syst. 45 2013 1 7
7. M. Zechner, and M. Granitzer A competitive learning approach to instance selection for support vector machines Knowledge Science Engineering and Management, Vol. 5914 2009 146 157
8. L.I. Kuncheva, and L.C. Jain Nearest neighbor classifier: simultaneous editing and feature selection Pattern Recogn. Lett. 20 1999 1149 1156
9. L.I. Kuncheva Editing for the k-nearest neighbors rule by a genetic algorithm Pattern Recogn. Lett. 16 8 1995 809 814
10. W. Ting-Fan, L. Chih-Jen, and W.C. Ruby Probability estimates for multi-class classification by pairwise coupling J. Mach. Learn. Res. 5 2004 975 1005
11. M. Galar, A. Fernandez, E. Barrenechea, H. Bustince, and F. Herrera An overview of ensemble methods for binary classifiers in multi-class problems: experimental study on one-vs-one and one-vs-all schemes Pattern Recogn. 44 8 2011 1761 1776
12. T. Hastie, and R. Tibshirani Classification by pairwise coupling Ann. Stat. 26 2 1998 451 471
13. S.H. Park, and J. Fürnkranz Efficient pairwise classification Proceedings of the 18th European Conference on Machine Learning 2007 658 665
14. D.L. Wilson Asymptotic properties of nearest neighbor rules using edited data IEEE Trans. Syst. Man Cybern. 2 3 1972 408 421
15. F. Vazquez, J. Sánchez, and F. Pla A stochastic approach to Wilsons' editing algorithm 2nd Iberian Conference on Pattern Recognition and Image Analysis 2005 35 42
16. I. Tomek An experiment with the edited nearest-neighbor rule IEEE Trans. Syst. Man Cybern. 6 6 1976 448 452
17. K. Hattori, and M. Takahashi A new edited k-nearest neighbor rule in the pattern classification problem Pattern Recogn. 32 2000 521 528
18. J.S. Sánchez, R. Barandela, A.I. Marqués, R. Alejo, and J. Badenas Analysis of new techniques to obtain quality training sets Pattern Recogn. Lett. 24 2003 1015 1022
19. P. Devijver On the editing rate of the multiedit algorithm Pattern Recogn. Lett. 4 1 1986 9 12
20. J.S. Sánchez, F. Pla, and F.J. Ferri Prototype selection for the nearest neighbour rule through proximity graphs Pattern Recogn. Lett. 18 1997 507 513
21. C.E. Brodley Recursive automatic bias selection for classifier construction Mach. Learn. 20 1995 63 94
22. M. Grochowski, and N. Jankowski Comparison of instances selection algorithms Artif. Intell. Soft Comput. 2004 598 603
23. J.R. Cano, F. Herrera, and M. Lozano Using evolutionary algorithms as instance selection for data reduction in KDD: an experimental study IEEE Trans. Evol. Comput. 7 6 2003 561 575
24. L. Eshelman The CHC adaptive search algorithm: how to have safe search when engaging in nontraditional genetic recombination Found. Genet. Algorithms 1991 265 283
25. D.B. Skalak Prototype and feature selection by sampling and random mutation hill climbing algorithms Proceedings of the Eleventh International Conference on Machine Learning 6 1994 293 301
26. N. Verbiest, C. Cornelis, and F. Herrera Frps: a fuzzy rough prototype selection method Pattern Recogn. 46 10 2013 2770 2782
27. D. Dubois, and H. Prade Rough fuzzy sets and fuzzy rough sets Int. J. Gen. Syst. 17 1990 191 209
28. K. Bache, M. Lichman, UCI machine learning repository (2013). http://archive.ics.uci.edu/ml/.
29. J. Cano, F. Herrera, and M. Lozano Stratification for scaling up evolutionary prototype selection Pattern Recogn. Lett. 26 2005 953 963
30. N. García-Pedrajas Constructing ensembles of classifiers by means of weighted instance selection IEEE Trans. Neural Netw. 20 2 2009 258 277
31. A. de Haro-García, N. García-Pedrajas, and J.A.R. del Castillo Large scale instance selection by means of federal instance selection Data Knowl. Eng. 75 2012 58 77
32. A. de Haro-García, and N. García-Pedrajas A divide-and-conquer recursive approach for scaling up instance selection algorithms Data Min. Knowl. Discov. 18 3 2009 392 418
33. C. García-Osorio, A. de Haro-García, and N. García-Pedrajas Democratic instance selection: a linear complexity instance selection algorithm based on classifier ensemble concepts Artif. Intell. 174 2010 410 441
34. J. Platt Fast Training of Support Vector Machines Using Sequential Minimal Optimization 1998 MIT Press 185 208
35. M. Friedman The use of ranks to avoid the assumption of normality implicit in the analysis of variance J. Am. Stat. Assoc. 32 1937 675 701
36. S. García, A. Fernández, J. Luengo, and F. Herrera Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power Inf. Sci. 180 2010 2044 2064
37. S. García, and F. Herrera An extension on "statistical comparisons of classifiers over multiple data sets" for all pairwise comparisons J. Mach. Learn. Res. 9 2008 2677 2694
38. J. Demsar Statistical comparisons of classifiers over multiple data sets J. Mach. Learn. Res. 7 2006 1 30
39. S. Holm A simple sequentially rejective multiple test procedure J. Stat. 6 1979 65 70