On the effectiveness of preprocessing methods when dealing with different levels of class imbalance

Knowledge-Based Systems

Volumn 25, Issue 1, 2012, Pages 13-21

  Garcia V ^a   Sanchez J S ^a   Mollineda, R A ^a  

^a UNIVERSITAT JAUME I   (Spain)

Author keywords

Classification; Imbalance; Multi dimensional scaling; Performance measures; Resampling

Indexed keywords

ARTIFICIAL INTELLIGENCE; KNOWLEDGE BASED SYSTEMS; SOFTWARE ENGINEERING;

IMBALANCE; IMBALANCED DATA-SETS; MULTI-DIMENSIONAL SCALING; PERFORMANCE EVALUATIONS; PERFORMANCE MEASURE; PRE-PROCESSING METHOD; RESAMPLING; RESAMPLING ALGORITHMS;

CLASSIFICATION (OF INFORMATION);

EID: 80052394779     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2011.06.013     Document Type: Article

References (56)

1. H. He, and E.A. Garcia Learning from imbalanced data IEEE Transactions on Knowledge and Data Engineering 21 9 2009 1263 1284
2. N. Japkowicz, and S. Stephen The class imbalance problem: a systematic study Intelligent Data Analysis 6 5 2002 429 449
3. J. Liu, Q. Hu, and D. Yu A comparative study on rough set based class imbalance learning Knowledge-Based Systems 21 8 2008 753 763
4. G. Cohen, M. Hilario, H. Sax, S. Hugonnet, and A. Geissbuhler Learning from imbalanced data in surveillance of nosocomial infection Artificial Intelligence in Medicine 37 1 2006 7 18
5. T. Fawcett, and F. Provost Adaptive fraud detection Data Minining and Knowledge Discovery 1 3 1997 291 316
6. C.S. Hilas, and P.A. Mastorocostas An application of supervised and unsupervised learning approaches to telecommunications fraud detection Knowledge-Based Systems 21 7 2008 721 726
7. P.K. Chan, F. Wei, A. Prodromidis, and S.J. Stolfo Distributed data mining in credit card fraud detection IEEE Intelligent Systems 14 6 1999 67 74 (Pubitemid 30535784)
8. M. Kubat, R.C. Holte, and S. Matwin Machine learning for the detection of oil spills in satellite radar images Machine Learning 30 2-3 1998 195 215
9. S. Tan Neighbor-weighted K-nearest neighbor for unbalanced text corpus Expert Systems with Applications 28 4 2005 667 671 (Pubitemid 40583844)
10. Z. Zheng, X. Wu, and R. Srihari Feature selection for text categorization on imbalanced data SIGKDD Explorations Newsletter 6 1 2004 80 89
11. Y.-M. Huang, C.-M. Hung, and H.C. Jiau Evaluation of neural networks and data mining methods on a credit assessment task for class imbalance problem Nonlinear Analysis: Real World Applications 7 4 2006 720 757
12. S. Daskalaki, I. Kopanas, and N. Avouris Evaluation of classifiers for an uneven class distribution problem Applied Artificial Intelligence 20 5 2006 381 417
13. N. García-Pedrajas, J. Pérez-Rodríguez, M. García-Pedrajas, D. Ortiz-Boyer, and C. Fyfe Class imbalance methods for translation initiation site recognition in DNA sequences Knowledge-Based Systems 25 1 2012 22 34
14. R. Barandela, J.S. Sánchez, V. García, and E. Rangel Strategies for learning in class imbalance problems Pattern Recognition 36 3 2003 849 851
15. N.V. Chawla, K.W. Bowyer, L.O. Hall, and W.P. Kegelmeyer SMOTE: synthetic minority over-sampling technique Journal of Artificial Intelligence Research 16 2002 321 357 (Pubitemid 43057176)
16. S. García, J. Derrac, I. Triguero, C.J. Carmona, and F. Herrera Evolutionary-based selection of generalized instances for imbalanced classification Knowledge-Based Systems 25 1 2012 3 12
17. H. Jin, and C.X. Ling Using AUC and accuracy in evaluating learning algorithms IEEE Transactions on Knowledge and Data Engineering 17 3 2005 299 310 (Pubitemid 40320164)
18. R. Ranawana, V. Palade, Optimized precision - a new measure for classifier performance evaluation, in: Proceedings of the IEEE Congress on Computational Intelligence, Vancouver, Canada, 2006, pp. 2254-2261. (Pubitemid 47130775)
19. T.K. Jo, and N. Japkowicz Class imbalances versus small disjuncts SIGKDD Explorations Newsletter 6 1 2004 40 49
20. R.C. Prati, G.E.A.P.A. Batista, M.C. Monard, Learning with class skews and small disjuncts, in: Proceedings of the 17th Brazilian Symposium on Artificial Intelligence, Sao Luiz, Brazil, 2004, pp. 296-306. (Pubitemid 39751639)
21. X.-Y. Liu, J. Wu, and Z.-H. Zhou Exploratory undersampling for class-imbalance learning IEEE Transactions on Systems, Man, and Cybernetics - Part B 39 2 2009 539 550
22. J.V. Hulse, T.M. Khoshgoftaar, A. Napolitano, Experimental perspectives on learning from imbalanced data, in: Proceedings of the 24th International Conference on Machine Learning, Corvalis, Oregon, 2007, pp. 935-942.
23. G.E.A.P.A. Batista, R.C. Prati, and M.C. Monard A study of the behavior of several methods for balancing machine learning training data ACM SIGKDD Explorations Newsletter 6 1 2004 20 29
24. R. Barandela, R.M. Valdovinos, J.S. Sánchez, and F.J. Ferri The imbalance training sample problem: under or over sampling Structural, Syntactic, and Statistical Pattern Recognition 2004 Springer-Verlag 806 814
25. A. Estabrooks, T. Jo, and N. Japkowicz A multiple resampling method for learning from imbalanced data sets Computational Intelligence 20 1 2004 18 36
26. J. Yang, X. Yu, Z.-Q. Xie, and J.-P. Zhang A novel virtual sample generation method based on Gaussian distribution Knowledge-Based Systems 24 6 2011 740 748
27. G.M. Weiss, and F.J. Provost Learning when training data are costly: the effect of class distribution on tree induction Journal of Artificial Intelligence Research 19 2003 315 354 (Pubitemid 41525924)
28. Y. Liu, A. An, X. Huang, Boosting prediction accuracy on imbalanced datasets with SVM ensembles, in: Proceedings of the 10th Pacific-Asia Conference on Knowledge Discovery and Data Mining, Singapore, 2006, pp. 107-118. (Pubitemid 44019410)
29. N.V. Chawla, A. Lazarevic, L.O. Hall, K.W. Bowyer, SMOTEBoost: improving prediction of the minority class in boosting, in: Proceedings of the 7th European Conference on Principles and Practice of Knowledge Discovery in Databases, Dubrovnik, Croatia, 2003, pp. 107-119. (Pubitemid 37231089)
30. V. García, J.S. Sánchez, R.A. Mollineda, On the use of surrounding neighbors for synthetic over-sampling of the minority class, in: Proceedings of the 8th WSEAS International Conference on Simulation, Modelling and Optimization, Santander, Spain, 2008, pp. 389-394.
31. H. Han, W.-Y. Wang, B.-H. Mao, Borderline-SMOTE: a new over-sampling method in imbalanced data sets learning, in: Proceedings of the 1th International Conference on Intelligent Computing, Hefei, China, 2005, pp. 878-887. (Pubitemid 41491129)
32. S. Hu, Y. Liang, L. Ma, Y. He, MSMOTE: improving classification performance when training data is imbalanced, in: Proceedings of the 2nd International Workshop on Computer Science and Engineering, Qingdao, China, 2009, pp. 13-17.
33. G. Hongyu, and V.L. Herna Learning from imbalanced data sets with boosting and data generation: the DataBoost-IM approach SIGKDD Explorations Newsletter 6 1 2004 30 39
34. J. Zhang, I. Mani, kNN approach to unbalanced data distributions: a case study involving information extraction, in: Proceedings of the Workshop on Learning from Imbalanced Datasets, Washington DC, USA, 2003.
35. M. Kubat, S. Matwin, Addressing the curse of imbalanced training sets: one-sided selection, in: Proceedings of the 14th International Conference on Machine Learning, Nashville, USA, 1997, p. 179-186.
36. I. Tomek Two modifications of CNN IEEE Transactions on Systems, Man and Cybernetics 6 11 1976 769 772
37. P.E. Hart The condensed nearest negihbor rule IEEE Transactions on Information Theory 14 1968 515 516
38. J. Laurikkala, Improving identification of difficult small classes by balancing class distribution, in: Proceedings of the 8th Conference on Artificial Intelligence in Medicine, Cascais, Portugal, 2001, pp. 63-66. (Pubitemid 33301585)
39. D.L. Wilson Asymptotic properties of nearest neighbour rules using edited data IEEE Transactions on Systems, Man and Cybernetics 2 1972 408 421
40. R. Barandela, F.J. Ferri, and J.S. Sánchez Decision boundary preserving prototype selection for nearest neighbor classification International Journal of Pattern Recognition and Artificial Intelligence 19 6 2005 787 806 (Pubitemid 41374104)
41. S.-J. Yen, Y.-S. Lee, C.-H. Lin, J.-C. Ying, Investigating the effect of sampling methods for imbalanced data distributions, in: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, vol. 5, Taipei, Taiwan, 2006, pp. 4163-4168.
42. S. García, and F. Herrera Evolutionary undersampling for classification with imbalanced datasets: proposals and taxonomy Evolutionary Computation 17 3 2009 275 306
43. X. Chen, B. Gerlach, D. Casasent, Pruning support vectors for imbalanced data classification, in: Proceedings of the International Joint Conference on Neural Networks, Montreal, Canada, 2005, pp. 1883-1888. (Pubitemid 44591487)
44. F. Provost, and T. Fawcett Robust classification for imprecise environments Machine Learning 42 3 2001 203 231 (Pubitemid 32188799)
45. A.P. Bradley The use of the area under the ROC curve in the evaluation of machine learning algorithms Pattern Recognition 30 7 1997 1145 1159 (Pubitemid 127406521)
46. M. Sokolova, N. Japkowicz, S. Szpakowicz, Beyond accuracy, F-score and ROC: a family of discriminant measures for performance evaluation, in: Proceedings of the 19th ACS Australian Joint Conference on Artificial Intelligence, Hobart, Australia, 2006, pp. 1015-1021.
47. C.J.V. Rijsbergen Information Retrieval 1979 Butterworths London, UK
48. V. García, R.A. Mollineda, J.S. Sánchez, Theoretical analysis of a performance measure for imbalanced data, in: Proceedings of the 20th International Conference on Pattern Recognition, Istanbul, Turkey, 2010, pp. 617-620.
49. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I.H. Witten The WEKA data mining software: an update SIGKDD Explorations Newsletter 11 2009 10 18
50. R. Alaiz-Rodríguez, N. Japkowicz, P. Tischer, A visualization-based exploratory technique for classifier comparison with respect to multiple metrics and multiple domains, in: Proceedings of the 15th European Conference on Machine Learning, Antwerp, Belgium, 2008, pp. 660-665.
51. R. Caruana, A. Niculescu-Mizil, Data mining in metric space: an empirical analysis of supervised learning performance criteria, in: Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Seattle, USA, 2004, pp. 69-78. (Pubitemid 40114917)
52. V. García, R.A. Mollineda, and J.S. Sánchez On the k-NN performance in a challenging scenario of imbalance and overlapping Pattern Analysis and Applications 11 3 2008 269 280
53. J.V. Hulse, and T. Khoshgoftaar Knowledge discovery from imbalanced and noisy data Data & Knowledge Engineering 68 12 2009 1513 1542
54. T.M. Khoshgoftaar, N. Seliya, and D.J. Drown Evolutionary data analysis for the class imbalance problem Intelligent Data Analysis 14 1 2010 69 88
55. G.M. Weiss The impact of small disjuncts on classifier learning R. Stahlbock, S.F. Crone, S. Lessmann, Data Mining Annals of Information Systems vol. 8 2010 Springer US 193 226 (chapter 9)
56. J. Luengo, A. Fernández, S. García, F. Herrera, Addressing data complexity for imbalanced data sets: analysis of SMOTE-based oversampling and evolutionary undersampling, Soft Computing - A Fusion of Foundations, Methodologies and Applications, in press, doi:10.1007/s00500-010-0625-8.