Evolutionary-based selection of generalized instances for imbalanced classification

Knowledge-Based Systems

Volumn 25, Issue 1, 2012, Pages 3-12

  García, Salvador ^a   Derrac, Joaquín ^b   Triguero, Isaac ^b   Carmona, Cristóbal J ^a   Herrera, Francisco ^b  

^a UNIVERSITY OF JAÉN   (Spain)

^b UNIVERSITY OF GRANADA   (Spain)

Author keywords

Evolutionary algorithms; Imbalanced classification; Instance selection; Nested generalized exemplar learning; Rule induction

Indexed keywords

EUCLIDEAN; EXPERIMENTAL ANALYSIS; IMBALANCED CLASSIFICATION; IMBALANCED DATA SETS; INSTANCE SELECTION; LEARNING PROCESS; NESTED GENERALIZED EXEMPLAR LEARNING; NESTED GENERALIZED EXEMPLARS; REAL-WORLD PROBLEM; RULE INDUCTION; SUPERVISED CLASSIFICATION;

STATISTICAL TESTS;

EVOLUTIONARY ALGORITHMS;

EID: 80052414830     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2011.01.012     Document Type: Article

References (50)

1. D.W. Aha, D. Kibler, and M.K. Albert Instance-based learning algorithms Machine Learning 6 1 1991 37 66 (Pubitemid 21727227)
2. F. Al-Obeidat, N. Belacel, J.A. Carretero, and P. Mahanti Differential evolution for learning the classification method proaftn Knowledge-Based Systems 23 5 2010 418 426
3. J. Alcalá-Fdez, A. Fernández, J. Luengo, J. Derrac, S. García, L. Sánchez, and F. Herrera KEEL data-mining software tool: Data set repository, integration of algorithms and experimental analysis framework Journal of Multiple-Valued Logic and Soft Computing 17 2-3 2011 255 287
4. J. Alcala-Fdez, L. Sánchez, S. García, M. del Jesus, S. Ventura, J. Garrell, J. Otero, C. Romero, J. Bacardit, V. Rivas, J. Fernández, and F. Herrera Keel: a software tool to assess evolutionary algorithms for data mining problems Soft Computing 13 3 2009 307 318
5. G.E.A.P.A. Batista, R.C. Prati, and M.C. Monard A study of the behavior of several methods for balancing machine learning training data Sigkdd Explorations 6 1 2004 20 29
6. A.P. Bradley The use of the area under the roc curve in the evaluation of machine learning algorithms Pattern Recognition 30 7 1997 1145 1159 (Pubitemid 127406521)
7. J.R. Cano, F. Herrera, and M. Lozano Using evolutionary algorithms as instance selection for data reduction in KDD: an experimental study IEEE Transactions on Evolutionary Computation 7 6 2003 561 575
8. Y.-W. Chang Chien, and Y.-L. Chen Mining associative classification rules with stock trading data - a ga-based method Knowledge-Based Systems 23 6 2010 605 614
9. N. Chawla, K. Bowyer, L. Hall, and W. Kegelmeyer Smote: synthetic minority over-sampling technique Journal of Artificial Intelligence Research 16 2002 321 357 (Pubitemid 43057176)
10. N. Chawla, D. Cieslak, L. Hall, and A. Joshi Automatically countering imbalance and its empirical relationship to cost Data Mining and Knowledge Discovery 17 2 2008 225 252
11. N.V. Chawla, N. Japkowicz, and A. Kotcz Editorial: special issue on learning from imbalanced data sets SIGKDD Explorations Newsletter 6 1 2004 1 6
12. W.W. Cohen, Fast effective rule induction, in: Proceedings of the Twelfth International Conference on Machine Learning, 1995, pp. 115-123.
13. T.M. Cover, and P.E. Hart Nearest neighbor pattern classification IEEE Transactions on Information Theory 13 1 1967 21 27
14. J. Demšar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30 (Pubitemid 43022939)
15. J. Derrac, S. García, and F. Herrera IFS-CoCo: Instance and feature selection based on cooperative coevolution with nearest neighbor rule Pattern Recognition 43 6 2010 2082 2105
16. P. Domingos Unifying instance-based and rule-based induction Machine Learning 24 1996 141 168 (Pubitemid 126724383)
17. A.E. Eiben, and J.E. Smith Introduction to Evolutionary Computing 2003 Springer-Verlag
18. L.J. Eshelman, The CHC adaptive search algorithm: how to safe search when engaging in nontraditional genetic recombination, in: G.J.E. Rawlings (Ed.), Foundations of genetic algorithms, 1991, pp. 265-283.
19. A. Fernández, M.J. del Jesus, and F. Herrera On the 2-tuples based genetic tuning performance for fuzzy rule based classification systems in imbalanced data-sets Information Sciences 180 8 2010 1268 1291
20. A. Fernández, S. García, J. Luengo, E. Bernadó- Mansilla, F. Herrera, Genetics-based machine learning for rule induction: Taxonomy, experimental study and state of the art, in: IEEE Transactions on Evolutionary Computation 4 (6) (2010) 913-941.
21. E. Frank, I.H. Witten, Generating accurate rule sets without global optimization, in: Proceedings of the Fifteenth International Conference on Machine Learning, ICML, 1998, pp. 144-151.
22. A.A. Freitas Data Mining and Knowledge Discovery with Evolutionary Algorithms 2002 Springer-Verlag New York, Inc. Secaucus, NJ, USA
23. J. Fürnkranz Separate-and-conquer rule learning Artificial Intelligence Review 13 1 1999 3 54
24. S. García, J.R. Cano, and F. Herrera A memetic algorithm for evolutionary prototype selection: a scaling up approach Pattern Recognition 41 8 2008 2693 2709
25. S. García, A. Fernández, and F. Herrera Enhancing the effectiveness and interpretability of decision tree and rule induction classifiers with evolutionary training set selection over imbalanced problems Applied Soft Computing 9 4 2009 1304 1314
26. S. García, A. Fernández, J. Luengo, and F. Herrera A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability Soft Computing 13 10 2009 959 977
27. S. García, A. Fernández, J. Luengo, and F. Herrera Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power Information Sciences 180 2010 2044 2064
28. S. García, and F. Herrera An extension on statistical comparisons of classifiers over multiple data sets for all pairwise comparisons Journal of Machine Learning Research 9 2008 2677 2694
29. S. García, and F. Herrera Evolutionary under-sampling for classification with imbalanced data sets: proposals and taxonomy Evolutionary Computation 17 3 2009 275 306
30. J. Grzymala-Busse, J. Stefanowski, and S. Wilk A comparison of two approaches to data mining from imbalanced data Journal of Intelligent Manufacturing 16 6 2005 565 573 (Pubitemid 41605674)
31. C. Guerra-Salcedo, S. Chen, D. Whitley, S. Smith, Fast and accurate feature selection using hybrid genetic strategies, in: CEC, 1999, pp. 177-184.
32. H. He, and E.A. Garcia Learning from imbalanced data IEEE Transactions on Knowledge and Data Engineering 21 9 2009 1263 1284
33. E.R. Hruschka, R.J.G.B. Campello, A.A. Freitas, and A.C.P.L.F. De Carvalho A survey of evolutionary algorithms for clustering IEEE Transactions on Systems Man and Cybernetics. Part C 39 2 2009 133 155
34. I. Kononenko, and M. Kukar Machine Learning and Data Mining: Introduction to Principles and Algorithms 2007 Horwood Publishing Limited
35. M. Laguia, and J.L. Castro Local distance-based classification Knowledge-Based Systems 21 7 2008 692 703
36. S. Li, H. Wu, D. Wan, and J. Zhu An effective feature selection method for hyperspectral image classification based on genetic algorithm and support vector machine Knowledge-Based Systems 24 1 2011 40 48
37. H. Liu, and H. Motoda Instance Selection and Construction for Data Mining 2001 Springer
38. O. Luaces, and A. Bahamonde Inflating examples to obtain rules International Journal of Intelligent Systems 18 11 2003 1113 1143
39. M.A. Mazurowski, P.A. Habas, J.M. Zurada, J.Y. Lo, J.A. Baker, and G.D. Tourassi Training neural network classifiers for medical decision making: the effects of imbalanced datasets on classification performance Neural Networks 21 2-3 2008 427 436
40. D. Medin, and M. Schaffer Context theory of classification learning Psychological Review 85 1978 207 238
41. A. Orriols-Puig, and E. Bernadó-Mansilla Evolutionary rule-based systems for imbalanced data sets Soft Computing 13 3 2009 213 225
42. D. Pyle Data Preparation for Data Mining 1999 The Morgan Kaufmann Series in DMS
43. S. Salzberg A nearest hyperrectangle method Machine Learning 6 1991 151 276
44. S. Senthamarai Kannan, and N. Ramaraj A novel hybrid feature selection via symmetrical uncertainty ranking based local memetic search algorithm Knowledge-Based Systems 23 6 2010 580 585
45. D. Sheskin Handbook of parametric and nonparametric statistical procedures 2006 Chapman & Hall/CRC
46. I. Triguero, S. García, and F. Herrera Differential evolution for optimizing the positioning of prototypes in nearest neighbor classification Pattern Recognition 44 4 2011 901 916
47. I. Triguero, S. García, and F. Herrera IPADE: Iterative prototype adjustment for nearest neighbor classification IEEE Transactions on Neural Networks 21 12 2010 1984 1990
48. D. Wettschereck, and T.G. Dietterich An experimental comparison of the nearest-neighbor and nearest-hyperrectangle algorithms Machine Learning 19 1995 5 27
49. Q. Yang, and X. Wu 10 challenging problems in data mining research International Journal of Information Technology & Decision Making 5 4 2006 597 604
50. S. Zhang Cost-sensitive classification with respect to waiting cost Knowledge-Based Systems 23 5 2010 369 378