SMOTE-IPF: Addressing the noisy and borderline examples problem in imbalanced classification by a re-sampling method with filtering

Information Sciences

Volumn 291, Issue C, 2015, Pages 184-203

  Sáez, José A ^a   Luengo, Julián ^b   Stefanowski, Jerzy ^c   Herrera, Francisco ^a  

^a UNIVERSITY OF GRANADA   (Spain)

^b UNIVERSITY OF BURGOS   (Spain)

^c POZNAN UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

Borderline examples; Imbalanced classification; Noise filters; Noisy data; SMOTE

Indexed keywords

DATA HANDLING; ITERATIVE METHODS;

BORDERLINE EXAMPLES; IMBALANCED CLASSIFICATION; NOISE FILTERS; NOISY DATA; SMOTE;

CLASSIFICATION (OF INFORMATION);

EID: 84923328437     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2014.08.051     Document Type: Article

References (57)

1. J. Alcalá-Fdez, A. Fernández, J. Luengo, J. Derrac, S. García, L. Sánchez, F. Herrera, KEEL data-mining software tool: data set repository, integration of algorithms and experimental analysis framework, J. Multiple-Valued Logic Soft Comput. 17 (2011) 255-287.
2. J. Alcalá-Fdez, L. Sánchez, S. García, M. del Jesus, S. Ventura, J. Garrell, J. Otero, C. Romero, J. Bacardit, V. Rivas, J. Fernández, F. Herrera, KEEL: a software tool to assess evolutionary algorithms for data mining problems, Soft Comput.-Fus. Found. Methodol. Appl. 13 (2009) 307-318.
3. R. Barandela, J.S. Sánchez, V. García, E. Rangel, Strategies for learning in class imbalance problems, Pattern Recogn. 36 (2003) 849-851.
4. G. Batista, R. Prati, M. Monard, A study of the behavior of several methods for balancing machine learning training data, ACM SIGKDD Explor. Newslett. 6 (2004) 20-29.
5. U. Bhowan, M. Johnston, M. Zhang, Developing new fitness functions in genetic programming for classification with unbalanced data, IEEE Trans. Syst. Man Cybern., Part B: Cybern. 42 (2012) 406-421.
6. A.P. Bradley, The use of the area under the ROC curve in the evaluation of machine learning algorithms, Pattern Recogn. 30 (1997) 1145-1159.
7. C.E. Brodley, M.A. Friedl, Identifying mislabeled training data, J. Artif. Intell. Res. 11 (1999) 131-167.
8. C. Bunkhumpornpat, K. Sinapiromsaran, C. Lursinsap, Safe-level-SMOTE: safe-level-synthetic minority over-sampling technique for handling the class imbalanced problem, in: Proceedings of the 13th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining, PAKDD '09, Springer-Verlag, Berlin, Heidelberg, 2009, pp. 475-482.
9. N.V. Chawla, K.W. Bowyer, L.O. Hall, W.P. Kegelmeyer, SMOTE: synthetic minority over-sampling technique, J. Artif. Intell. Res. 16 (2002) 321-357.
10. N.V. Chawla, D.A. Cieslak, L.O. Hall, A. Joshi, Automatically countering imbalance and its empirical relationship to cost, Data Min. Knowl. Discov. 17 (2008) 225-252.
11. N.V. Chawla, N. Japkowicz, A. Kotcz, Editorial: special issue on learning from imbalanced data sets, SIGKDD Explor. 6 (2004) 1-6.
12. W.W. Cohen, Fast effective rule induction, in: Proceedings of the Twelfth International Conference on Machine Learning, Morgan Kaufmann Publishers, 1995, pp. 115-123.
13. C. Cortes, V. Vapnik, Support vector networks, Mach. Learn. 20 (1995) 273-297.
14. J. Demšar, Statistical comparisons of classifiers over multiple data sets, J. Mach. Learn. Res. 7 (2006) 1-30.
15. A. Fernández, M.J. del Jesus, F. Herrera, On the 2-tuples based genetic tuning performance for fuzzy rule based classification systems in imbalanced data-sets, Inf. Sci. 180 (2010) 1268-1291.
16. E. Frank, I.H. Witten, Generating accurate rule sets without global optimization, in: ICML98: Proceedings of the Fifteenth International Conference on Machine Learning, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1998, pp. 144-151.
17. D. Gamberger, R. Boskovic, N. Lavrac, C. Groselj, Experiments with noise filtering in a medical domain, in: Proceedings of the Sixteenth International Conference on Machine Learning, Morgan Kaufmann Publishers, 1999, pp. 143-151.
18. D. Gamberger, N. Lavrac, S. Dzeroski, Noise detection and elimination in data preprocessing: experiments in medical domains, Appl. Artif. Intell. 14 (2000) 205-223.
19. S. García, A. Fernández, J. Luengo, F. Herrera, Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power, Inf. Sci. 180 (2010) 2044-2064.
20. V. García, R. Alejo, J. Sánchez, J. Sotoca, R. Mollineda, Combined effects of class imbalance and class overlap on instance-based classification, in: E. Corchado, H. Yin, V. Botti, C. Fyfe (Eds.), Intelligent Data Engineering and Automated Learning IDEAL 2006, Lecture Notes in Computer Science, vol. 4224, Springer, Berlin/Heidelberg, 2006, pp. 371-378.
21. V. García, R. Mollineda, J. Sánchez, On the k-NN performance in a challenging scenario of imbalance and overlapping, Pattern Anal. Appl. 11 (2008) 269-280.
22. V. García, J. Sánchez, R. Mollineda, An empirical study of the behavior of classifiers on imbalanced and overlapped data sets, in: L. Rueda, D. Mery, J. Kittler (Eds.), CIARP 2007, LNCS, vol. 4756, Springer, Heidelberg, 2007, pp. 397-406.
23. H. Han, W.Y. Wang, B.H. Mao, Borderline-SMOTE: a new over-sampling method in imbalanced data sets learning, in: Proceedings of the 2005 International Conference on Advances in Intelligent Computing-Volume Part I, Springer-Verlag, Berlin, Heidelberg, 2005, pp. 878-887.
24. H. He, E. Garcia, Learning from imbalanced data, IEEE Trans. Data Knowl. Eng. 21 (2009) 1263-1284.
25. Y. Hochberg, A sharper Bonferroni procedure for multiple tests of significance, Biometrika 75 (1988) 800-803.
26. J. Hodges, E. Lehmann, Ranks methods for combination of independent experiments in analysis of variance, Ann. Math. Stat. 33 (1962) 482-497.
27. K. Huang, H. Yang, I. King, M.R. Lyu, Imbalanced learning with a biased minimax probability machine, IEEE Trans. Syst. Man Cybern., Part B: Cybern. 36 (2006) 913-923.
28. N. Japkowicz, Class imbalance: are we focusing on the right issue, in: II Workshop on Learning from Imbalanced Data Sets, ICML, Morgan Kaufmann Publishers Inc, 2003, pp. 17-23.
29. T. Jo, N. Japkowicz, Class Imbalances versus small disjuncts, SIGKDD Explor. 6 (2004) 40-49.
30. K.L. Kermanidis, The effect of borderline examples on language learning, J. Exp. Theor. Artif. Intell. 21 (2009) 19-42.
31. K.C. Khor, C.Y. Ting, S. Phon-Amnuaisuk, A cascaded classifier approach for improving detection rates on rare attack categories in network intrusion detection, Appl. Intell. 36 (2012) 320-329.
32. T.M. Khoshgoftaar, P. Rebours, Improving software quality prediction by noise filtering techniques, J. Comput. Sci. Technol. 22 (2007) 387-396.
33. M. Kubat, S. Matwin, Addressing the curse of imbalanced training sets: one-sided selection, in: Proceedings of the 14th International Conference on Machine Learning, Morgan Kaufmann, 1997, pp. 179-186.
34. L.I. Kuncheva, Diversity in multiple classifier systems, Inf. Fus. 6 (2005) 3-4.
35. V. López, A. Fernández, F. Herrera, On the importance of the validation technique for classification with imbalanced datasets: addressing covariate shift when data is skewed, Inf. Sci. 257 (2014) 1-13.
36. V. López, I. Triguero, C.J. Carmona, S. García, F. Herrera, Addressing imbalanced classification with instance generation techniques: IPADE-ID, Neurocomputing 126 (2014) 15-28.
37. T. Maciejewski, J. Stefanowski, Local neighbourhood extension of SMOTE for mining imbalanced data, in: Proceedings of IEEE Symposium on Computational Intelligence and Data Mining, SSCI IEEE, IEEE Press, 2011, pp. 104-111.
38. R. Mathiasi Horta, B. Pires De Lima, C. Borges, A semi-deterministic ensemble strategy for imbalanced datasets (SDEID) applied to bankruptcy prediction, WIT Trans. Inf. Commun. Technol. 40 (2008) 205-213.
39. G.J. McLachlan, Discriminant Analysis and Statistical Pattern Recognition, John Wiley and Sons, 2004.
40. K. Napierala, J. Stefanowski, S. Wilk, Learning from imbalanced data in presence of noisy and borderline examples, in: Rough Sets and Current Trends in Computing, Lecture Notes in Computer Science, vol. 6086, Springer, Berlin/Heidelberg, 2010, pp. 158-167.
41. J.R. Quinlan, C4.5: Programs for Machine Learning, Morgan Kaufmann Publishers, San Francisco, CA, USA, 1993.
42. J.A. Sáez, M. Galar, J. Luengo, F. Herrera, Tackling the problem of classification with noisy data using multiple classifier systems: analysis of the performance and robustness, Inf. Sci. 247 (2013) 1-20.
43. J.A. Sáez, M. Galar, J. Luengo, F. Herrera, Analyzing the presence of noise in multi-class problems: alleviating its influence with the one-vs-one decomposition, Knowl. Inf. Syst. 38 (2014) 179-206.
44. J.A. Sáez, J. Luengo, F. Herrera, Predicting noise filtering efficacy with data complexity measures for nearest neighbor classification, Pattern Recogn. 46 (2013) 355-364.
45. K. Slowin ski, J. Stefanowski, D. Siwin ski, Application of rule induction and rough sets to verification of magnetic resonance diagnosis, Fund. Inform. 53 (2002) 345-363.
46. J. Stefanowski, Overlapping, rare examples and class decomposition in learning classifiers from imbalanced data, in: S. Ramanna, L.C. Jain, R.J. Howlett (Eds.), Emerging Paradigms in Machine Learning, Smart Innovation, Systems and Technologies, vol. 13, Springer, Berlin, Heidelberg, 2013, pp. 277-306.
47. J. Stefanowski, S. Wilk, Selective pre-processing of imbalanced data for improving classification performance, in: I.Y. Song, J. Eder, T. Nguyen (Eds.), Data Warehousing and Knowledge Discovery, Lecture Notes in Computer Science, vol. 5182, Springer, Berlin/Heidelberg, 2008, pp. 283-292.
48. C.T. Su, Y.H. Hsiao, An evaluation of the robustness of MTS for imbalanced data, IEEE Trans. Knowl. Data Eng. 19 (2007) 1321-1332.
49. A. Sun, E.P. Lim, Y. Liu, On strategies for imbalanced text classification using SVM: a comparative study, Decis. Support Syst. 48 (2009) 191-201.
50. Y. Sun, M.S. Kamel, A.K. Wong, Y. Wang, Cost-sensitive boosting for classification of imbalanced data, Pattern Recogn. 40 (2007) 3358-3378.
51. Y. Tang, Y. Zhang, N.V. Chawla, SVMs modeling for highly imbalanced classification, IEEE Trans. Syst. Man Cybern., Part B: Cybern. 39 (2009) 281-288.
52. F.B. T.k, A.G. Dempster, I. Kale, Parasite detection and identification for automated thin blood film malaria diagnosis, Comput. Vis. Image Understand. 114 (2010) 21-32.
53. I. Tomek, Two modifications of CNN, IEEE Trans. Syst. Man Commun. 6 (1976) 769-772.
54. S. Verbaeten, A.V. Assche, Ensemble methods for noise elimination in classification problems, in: Fourth International Workshop on Multiple Classifier Systems, Springer, 2003, pp. 317-325.
55. D.L. Wilson, Asymptotic properties of nearest neighbor rules using edited data, IEEE Trans. Syst. Man Cybern. 2 (1972) 408-421.
56. D.R. Wilson, T.R. Martinez, Improved heterogeneous distance functions, J. Artif. Intell. Res. 6 (1997) 1-34.
57. X. Zhu, X. Wu, Class noise vs. attribute noise: a quantitative study, Artif. Intell. Rev. 22 (2004) 177-210.