A proposal for evolutionary fuzzy systems using feature weighting: Dealing with overlapping in imbalanced datasets

Knowledge-Based Systems

Volumn 73, Issue , 2015, Pages 1-17

  Alshomrani, Saleh ^a   Bawakid, Abdullah ^a   Shim, Seong O ^a   Fernández, Alberto ^b   Herrera, Francisco ^a,c  

^a KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

^b UNIVERSITY OF JAÉN   (Spain)

^c UNIVERSITY OF GRANADA   (Spain)

Author keywords

Evolutionary fuzzy systems; Feature weighting; Fuzzy rule based classification systems; Imbalanced datasets; Overlapping

Indexed keywords

FUZZY RULES; FUZZY SYSTEMS;

EVOLUTIONARY FUZZY SYSTEMS; FEATURE WEIGHTING; FUZZY RULE BASED CLASSIFICATION SYSTEMS; IMBALANCED DATA-SETS; OVERLAPPING;

CLASSIFICATION (OF INFORMATION);

EID: 84915749948     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2014.09.002     Document Type: Article

References (61)

1. J. Alcalá-Fdez, R. Alcalá, and F. Herrera A fuzzy association rule-based classification model for high-dimensional problems with genetic rule selection and lateral tuning IEEE Trans. Fuzzy Syst. 19 5 2011 857 872
2. J. Alcalá-Fdez, A. Fernández, J. Luengo, J. Derrac, S. García, L. Sánchez, and F. Herrera KEEL data-mining software tool: data set repository, integration of algorithms and experimental analysis framework J. Multi-Valued Logic Soft Comput. 17 2-3 2011 255 287
3. J. Alcalá-Fdez, L. Sánchez, S. García, M.J. del Jesus, S. Ventura, J.M. Garrell, J. Otero, C. Romero, J. Bacardit, V.M. Rivas, J.C. Fernández, and F. Herrera KEEL: a software tool to assess evolutionary algorithms for data mining problems Soft. Comput. 13 2009 307 318
4. R. Barandela, J.S. Sánchez, V. García, and E. Rangel Strategies for learning in class imbalance problems Pattern Recogn. 36 3 2003 849 851
5. G.E.A.P.A. Batista, R.C. Prati, and M.C. Monard A study of the behaviour of several methods for balancing machine learning training data SIGKDD Explor. 6 1 2004 20 29
6. F.J. Berlanga, A.J.R. Rivas, M.J. del Jesús, and F. Herrera GP-COACH: genetic programming-based learning of compact and accurate fuzzy rule-based classification systems for high-dimensional problems Inform. Sci. 180 8 2010 1183 1200
7. A.P. Bradley The use of the area under the ROC curve in the evaluation of machine learning algorithms Pattern Recogn. 30 7 1997 1145 1159
8. H. Bustince, M. Pagola, E. Barrenechea, J. Fernández, P. Melo-Pinto, P. Couto, H.R. Tizhoosh, and J. Montero Ignorance functions. an application to the calculation of the threshold in prostate ultrasound images Fuzzy Sets Syst. 161 1 2010 20 36
9. N.V. Chawla, K.W. Bowyer, L.O. Hall, and W.P. Kegelmeyer SMOTE: synthetic minority over-sampling technique J. Artif. Intell. Res. 16 2002 321 357
10. Z. Chi, H. Yan, and T. Pham Fuzzy Algorithms with Applications to Image Processing and Pattern Recognition 1996 World Scientific
11. O. Cordón, F. Gomide, F. Herrera, F. Hoffmann, and L. Magdalena Ten years of genetic fuzzy systems: current framework and new trends Fuzzy Sets Syst. 141 1 2004 5 31
12. J. Demšar Statistical comparisons of classifiers over multiple data sets J. Mach. Learn. Res. 7 2006 1 30
13. M. Denil, T. Trappenberg, Overlap versus imbalance, in: Proceedings of the 23rd Canadian conference on Advances in artificial intelligence (CCAI'10), Lecture Notes on Artificial Intelligence, vol. 6085, 2010, pp. 220-231.
14. P. Domingos, Metacost: a general method for making classifiers cost-sensitive, in: Proceedings of the 5th International Conference on Knowledge Discovery and Data Mining (KDD'99), 1999, pp. 155-164.
15. A. Eiben, and J. Smith Introduction to evolutionary computation Natural Computing Series 2003 Springer
16. L.J. Eshelman Foundations of genetic algorithms The CHC Adaptive Search Algorithm: How to have Safe Search When Engaging in Nontraditional Genetic Recombination 1991 Morgan Kaufman
17. M. Fazzolari, R. Alcalà, Y. Nojima, H. Ishibuchi, and F. Herrera A review of the application of multi-objective evolutionary systems: current status and further directions IEEE Trans. Fuzzy Syst. 21 1 2013 45 65
18. A. Fernández, M.J. del Jesus, and F. Herrera On the 2-tuples based genetic tuning performance for fuzzy rule based classification systems in imbalanced data-sets Inform. Sci. 180 8 2010 1268 1291
19. A. Fernández, S. García, M.J. del Jesus, and F. Herrera A study of the behaviour of linguistic fuzzy rule based classification systems in the framework of imbalanced data-sets Fuzzy Sets Syst. 159 18 2008 2378 2398
20. A. Fernandez, S. García, J. Luengo, E. Bernadó-Mansilla, and F. Herrera Genetics-based machine learning for rule induction: state of the art, taxonomy and comparative study IEEE Trans. Evol. Comput. 14 6 2010 913 941
21. S. García, J. Derrac, I. Triguero, C.J. Carmona, and F. Herrera Evolutionary-based selection of generalized instances for imbalanced classification Knowl. Based Syst. 25 1 2012 3 12
22. S. García, A. Fernández, J. Luengo, and F. Herrera Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power Inform. Sci. 180 10 2010 2044 2064
23. S. García, and F. Herrera An extension on "statistical comparisons of classifiers over multiple data sets" for all pairwise comparisons J. Mach. Learn. Res. 9 2008 2607 2624
24. V. García, R. Mollineda, and J.S. Sánchez On the k-NN performance in a challenging scenario of imbalance and overlapping Pattern Anal. Appl. 11 3-4 2008 269 280
25. V. García, J. Sánchez, and R. Mollineda On the effectiveness of preprocessing methods when dealing with different levels of class imbalance Knowl. Based Syst. 25 1 2012 13 21
26. J. Han, and M. Kamber Data Mining. Concepts and Techniques second ed. 2006 Morgan Kaufman
27. H. He, and E.A. Garcia Learning from imbalanced data IEEE Trans. Knowl. Data Eng. 21 9 2009 1263 1284
28. H. He, and Y. Ma Imbalanced Learning: Foundations, Algorithms, and Applications first ed. 2013 Wiley
29. F. Herrera, M. Lozano, and A.M. Sánchez A taxonomy for the crossover operator for real-coded genetic algorithms: an experimental study Int. J. Intell. Syst. 18 2003 309 338
30. F. Herrera, and L. Martínez A 2-tuple fuzzy linguistic representation model for computing with words IEEE Trans. Fuzzy Syst. 8 6 2000 746 752
31. T. Ho, and M. Basu Complexity measures of supervised classification problems IEEE Trans. Pattern Anal. Mach. Intell. 24 3 2002 289 300
32. S. Holm A simple sequentially rejective multiple test procedure Scand. J. Stat. 6 1979 65 70
33. J. Huang, and C.X. Ling Using AUC and accuracy in evaluating learning algorithms IEEE Trans. Knowl. Data Eng. 17 3 2005 299 310
34. H. Ishibuchi, T. Nakashima, and M. Nii Classification and Modeling with Linguistic Information Granules: Advanced Approaches to Linguistic Data Mining 2004 Springer-Verlag
35. H. Ishibuchi, and T. Yamamoto Rule weight specification in fuzzy rule-based classification systems IEEE Trans. Fuzzy Syst. 13 2005 428 435
36. N. Japkowicz, and S. Stephen The class imbalance problem: a systematic study Intell. Data Anal. J. 6 5 2002 429 450
37. B. Kavsek, and N. Lavrac Apriori-sd: adapting association rule learning to subgroup discovery Appl. Artif. Intell. 20 7 2006 543 583
38. M. Lin, K. Tang, and X. Yao Dynamic sampling approach to training neural networks for multiclass imbalance classification IEEE Trans. Neural Netw. Learn. Syst. 24 4 2013 647 660
39. H. Liu, and L. Yu Toward integrating feature selection algorithms for classification and clustering IEEE Trans. Knowl. Data Eng. 17 4 2005 491 502
40. V. López, A. Fernández, M.J. del Jesus, and F. Herrera A hierarchical genetic fuzzy system based on genetic programming for addressing classification with highly imbalanced and borderline data-sets Knowl. Based Syst. 38 2013 85 104
41. V. López, A. Fernández, S. García, V. Palade, and F. Herrera An insight into classification with imbalanced data: empirical results and current trends on using data intrinsic characteristics Inform. Sci. 250 20 2013 113 141
42. V. López, A. Fernández, J.G. Moreno-Torres, and F. Herrera Analysis of preprocessing vs. cost-sensitive learning for imbalanced classification. Open problems on intrinsic data characteristics Expert Syst. Appl. 39 7 2012 6585 6608
43. J. Luengo, A. Fernández, S. García, and F. Herrera Addressing data complexity for imbalanced data sets: analysis of SMOTE-based oversampling and evolutionary undersampling Soft. Comput. 15 10 2011 1909 1936
44. J.G. Moreno-Torres, F. Herrera, A preliminary study on overlapping and data fracture in imbalanced domains by means of genetic programming-based feature extraction, in: Proceedings of the 10th International Conference on Intelligent Systems Design and Applications (ISDA'10), 2010, pp. 501-506.
45. A. Orriols-Puig, and E. Bernadó-Mansilla Evolutionary rule-based systems for imbalanced datasets Soft. Comput. 13 3 2009 213 225
46. A. Orriols-Puig, E. Bernadó-Mansilla, D.E. Goldberg, K. Sastry, and P.L. Lanzi Facetwise analysis of XCS for problems with class imbalances IEEE Trans. Evol. Comput. 13 2009 260 283
47. A. Palacios, L. Sanchez, and I. Couso Combining adaboost with preprocessing algorithms for extracting fuzzy rules from low quality data in possibly imbalanced problems Int. J. Uncertain. Fuzz. Knowl. Based Syst. 20 SUPPL. 2 2012 51 71
48. R.C. Prati, G.E.A.P.A. Batista, Class imbalances versus class overlapping: an analysis of a learning system behavior, in: Proceedings of the 2004 Mexican International Conference on Artificial Intelligence (MICAI'04), 2004, pp. 312-321.
49. J. Quinlan C4.5: Programs for Machine Learning 1993 Morgan Kauffman
50. J.A. Sanz, A. Fernández, H. Bustince, and F. Herrera IIVFDT: ignorance functions based interval-valued fuzzy decision tree with genetic tuning Int. J. Uncertain., Fuzz. Knowl.-Based Syst. 20 SUPPL. 2 2012 1 30
51. C. Seiffert, T.M. Khoshgoftaar, J.V. Hulse, and A. Folleco An empirical study of the classification performance of learners on imbalanced and noisy software quality data Inform. Sci. 259 2014 571 595
52. Y. Sun, A.K.C. Wong, and M.S. Kamel Classification of imbalanced data: a review Int. J. Pattern Recogn. Artif. Intell. 23 4 2009 687 719
53. K.M. Ting An instance-weighting method to induce cost-sensitive trees IEEE Trans. Knowl. Data Eng. 14 3 2002 659 665
54. P. Villar, A. Fernández, R.A. Carrasco, and F. Herrera Feature selection and granularity learning in genetic fuzzy rule-based classification systems for highly imbalanced data-sets Int. J. Uncertain., Fuzz. Knowl.-Based Syst. 20 3 2012 369 397
55. G.M. Weiss Mining with rarity: a unifying framework SIGKDD Explor. 6 1 2004 7 19
56. G.M. Weiss The impact of small disjuncts on classifier learning R. Stahlbock, S.F. Crone, S. Lessmann, Data Mining Annals of Information Systems vol. 8 2010 Springer 193 226
57. G.M. Weiss, and Y. Tian Maximizing classifier utility when there are data acquisition and modeling costs Data Min. Knowl. Discov. 17 2 2008 253 282
58. B. Zadrozny, C. Elkan, Learning and making decisions when costs and probabilities are both unknown, in: Proceedings of the 7th International Conference on Knowledge Discovery and Data Mining (KDD'01), 2001, pp. 204-213.
59. B. Zadrozny, J. Langford, N. Abe, Cost-sensitive learning by cost-proportionate example weighting, in: Proceedings of the 3rd IEEE International Conference on Data Mining (ICDM'03), 2003, pp. 435-442.
60. C. Zhang, and S. Zhang Association rule mining, models and algorithms Lecture Notes in Computer Science vol. 2307 2002 Springer
61. W. Zong, G.-B. Huang, and Y. Chen Weighted extreme learning machine for imbalance learning Neurocomputing 101 2013 229 242