A dynamic over-sampling procedure based on sensitivity for multi-class problems

Pattern Recognition

Volumn 44, Issue 8, 2011, Pages 1821-1833

  Fernández Navarro, Francisco ^a   Hervás Martínez, César ^a   Antonio Gutiérrez, Pedro ^a  

^a UNIVERSITY OF CÓRDOBA   (Spain)

Author keywords

Accuracy; Classification; Imbalanced datasets; Memetic algorithm; Multi class; Over sampling method; Sensitivity; SMOTE

Indexed keywords

ACCURACY; CLASSIFICATION; IMBALANCED DATA-SETS; MEMETIC ALGORITHMS; MULTI-CLASS; OVER-SAMPLING METHOD; SENSITIVITY; SMOTE;

ALGORITHMS; DATA HANDLING; LEARNING SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; NEURAL NETWORKS; POPULATION STATISTICS; RADIAL BASIS FUNCTION NETWORKS;

CLASSIFICATION (OF INFORMATION);

EID: 79953050208     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2011.02.019     Document Type: Article

References (61)

1. N.V. Chawla, N. Japlowicz, and A. Kotcz Editorial: special issue on learning from imbalanced data sets Aigkdd Explorations 6 1 2006 1 6
2. J.H. Zhao, X. Li, Z.Y. Dong, Online rare events detection, in: PAKDD'07, Springer-Verlag, Berlin, Heidelberg, 2007.
3. H. He, and E.A. Garcia Learning from imbalanced data IEEE Transactions on Knowledge and Data Engineering 21 9 2009 1263 1284
4. Y. Sun, A.K.C. Wong, and M.S. Kamel Classification of imbalanced data: a review International Journal of Pattern Recognition and Artificial Intelligence 23 4 2009 687 719
5. M. Kubat, and S. Matwin Addressing the curse of imbalanced training sets: one-sided selection Proceedings of the 14th International Conference on Machine Learning 1997 179 186
6. M. Pazzani, C. Merz, P. Murphy, K. Ali, T. Hume, and C. Brunk Reducing misclassification costs: knowledge intensive approaches to learning from noisy data Proceedings of the 11th International Conference on Machine Learning (ICML-1994) 1994 100 109
7. N.V. Chawla, K.W. Bowyer, L.O. Hall, and W.P. Kegelmeyer Smote: synthetic minority over-sampling technique Journal of Artificial Intelligence Research 16 2002 321 357 (Pubitemid 43057176)
8. P. Moscato, and C. Cotta A gentle introduction to memetic algorithms Handbook of Metaheuristics, International Series in Operations Research and Management Science vol. 57 2003 Springer New York 105 144
9. T. Back Evolutionary Algorithms in Theory and Practice 1996 Oxford
10. S. García, and F. Herrera Evolutionary training set selection to optimize c4.5 in imbalanced problems International Conference on Hybrid Intelligent Systems 2008 IEEE Computer Society 567 572
11. A. Folleco, T.M. Khoshgoftaar, and A. Napolitano Comparison of four performance metrics for evaluating sampling techniques for low quality class-imbalanced data Seventh International Conference on Machine Learning and Applications, ICMLA '08 2008 153 158
12. L.M. Taft, R.S. Evans, C.R. Shyu, M.J. Egger, N. Chawla, J.A. Mitchell, S.N. Thornton, B. Bray, and M. Varner Countering imbalanced datasets to improve adverse drug event predictive models in labor and delivery Journal of Biomedical Informatics 42 2 2009 356 364
13. A. Orriols-Puig, and E. Bernadó-Mansilla Evolutionary rule-based systems for imbalanced data sets Soft Computing 13 3 2009 213 225
14. J. Stefanowski, S. Wilk, Extending rule-based classifiers to improve recognition of imbalanced classes, in: Studies in Computational Intelligence, vol. 223, 2009.
15. Z.-H. Zhou, and X.-Y. Liu Training cost-sensitive neural networks with methods addressing the class imbalance problem IEEE Transactions on Knowledge and Data Engineering 18 1 2006 63 77 (Pubitemid 43145089)
16. A. Fernández, M.J. Del Jesus, and F. Herrera On the influence of an adaptative inference system in fuzzy rule based classification systems for imbalanced data-sets Expert Systems with Applications 36 2009 9805 9812
17. J. Xue, and D.M. Titterington Do unbalanced data have a negative effect on lda? Pattern Recognition 41 5 2008 1575 1588
18. G.B. Ou, and Y.L. Murphey Multi-class pattern classification using neural networks Pattern Recognition 40 1 2007 4 18 (Pubitemid 44486283)
19. J. Van Hulse, T.M. Khoshgoftaar, and A. Napolitano Experimental perspectives on learning from imbalanced data Proceedings of the 24th International Conference on Machine Learning (ICML'07) vol. 227 2007 935 942
20. R.C. Prati, G.E.A.P.A. Batista, and M.C. Monard Class imbalances versus class overlapping: an analysis of a learning system behavior MICAI 2004: Advances in Artificial Intelligence, Lecture Notes in Computer Science vol. 2972 2004 312 321 (Pubitemid 38716795)
21. M. Kubat, R.C. Holte, and S. Matwin Machine learning for the detection of oil spills in satellite radar images Machine Learning 30 23 1998 195 215
22. T. Fawcett, and F. Provost Adaptive fraud detection Data Mining and Knowledge Discovery 1 3 1997 291 316
23. K.J. Ezawa, M. Singh, and S.W. Norton Learning goal oriented Bayesian networks for telecommunications management Proceedings of the 13th International Conference on Machine Learning 1996 139 147
24. P. Riddle, R. Segal, and O. Etzioni Representation design and brute-force induction in a boeing manufacturing domain Applied Artificial Intelligence 8 1 1994 125 147
25. F. Fernández-Navarro, A. Valero, C. Hervás-Martínez, P. Gutíerrez, R. García-Gimeno, and G. Zurera-Cosano Development of a multi-classification neural network model to determine the microbial growth/no growth interface International Journal of Food Microbiology 141 2010 203 212
26. C. Cardie, and N. Howe Improving minority class prediction using case-specific feature weights Proceedings of the 14th International Conference on Machine Learning 1997 57 65
27. G.E.A.P.A. Batista, R.C. Prati, and M.C. Monard A study of the behavior of several methods for balancing machine learning training data SIGKDD Explorations 6 1 2004 20 29
28. N. Japkowicz, and S. Stephen The class imbalance problem: a systematic study Intelligent Data Analysis Journal 6 5 2009 429 449
29. G.M. Weiss Mining with rarity: a unifying framework ACM SIGKDD Explorations Newsletter 2004 67 119
30. R. Akbani, S. Kwek, and N. Japkowicz Applying support vector machines to imbalanced datasets Proceedings of the 15th European Conference on Machine Learning (ECML) 2004 39 50 (Pubitemid 41050079)
31. B. Raskutti, and A. Kowalczyk Extreme re-balancing for SVMs: a case study SIGKDD Explorations 6 1 2004 60 69
32. A.K.C. Wong, and Y. Wang High-order pattern discovery from discrete-valued data IEEE Transactions on Knowledge and Data Engineering 9 6 1997 877 893
33. F. Provost, and T. Fawcett Analysis and visualization of the classifier performance: comparison under imprecise class and cost distribution Proceedings of the Third International Conference on Knowledge Discovery (KDD97) and Data Mining 1997 AAAI Press 43 88
34. J. Huang, and C.X. Ling Using auc and accuracy in evaluating learning algorithms IEEE Transactions on Knowledge and Data Engineering 17 3 2005 299 310 (Pubitemid 40320164)
35. T. Fawcett An introduction to ROC analysis Pattern Recognition Letters 27 2006 861 874
36. H. Mamitsuka Selecting features in microarray classification using ROC curves Pattern Recognition 39 12 2006 2393 2404 (Pubitemid 44349151)
37. M.J. Zolghadri, and E.G. Mansoori Weighting fuzzy classification rules using receiver operating characteristics analysis Information Sciences 177 11 2007 2296 2307 (Pubitemid 46435494)
38. C. Marrocco, R.P.W. Duin, and F. Tortorella Maximizing the area under the ROC curve by pairwise feature combination Pattern Recognition 41 6 2008 1961 1974
39. D.J. Hand, and R.J. Till A simple generalisation of the area under the roc curve for multiple class classification problems Machine Learning 45 2001 171 186 (Pubitemid 33635984)
40. C. Ferri, J. Hernández-Orallo, and M.A. Salido Volume under the roc surface for multi-class problems Machine Learning: ECML 2003, Lecture Notes in Computer Science vol. 2837 2003 108 120 (Pubitemid 37230970)
41. R.M. Everson, and J.E. Fieldsend Multi-class roc analysis from a multi-objective optimisation perspective Pattern Recognition Letters 27 8 2006 918 927
42. F.J. Martínez-Estudillo, P.A. Gutiérrez, C. Hervás-Martínez, and J.C. Fernández Evolutionary learning by a sensitivity-accuracy approach for multi-class problems Proceedings of the 2008 IEEE Congress on Evolutionary Computation (CEC'08) 2008 IEEE Press Hong Kong, China 1581 1588
43. J. Fernandez, C. Hervas, F. Martinez, and P. Gutierrez Memetic pareto evolutionary artificial neural networks to determine growth/no-growth in predictive microbiology Applied Soft Computing 11 1 2011 534 550
44. J. Fernandez-Caballero, F. Martinez, C. Hervas, and P. Gutierrez Sensitivity versus accuracy in multiclass problems using memetic pareto evolutionary neural networks IEEE Transactions on Neural Networks 21 5 2010 750 770
45. N. Japkowicz Supervised versus unsupervised binary-learning by feedforward neural networks Machine Learning 42 12 2001 97 122 (Pubitemid 32872400)
46. J.A.S. Freeman, and D. Saad Learning and generalization in radial basis function networks Neural Computation 7 5 1995 1000 1020
47. Y. Hwang, and S. Bang An efficient method to construct radial basis function neural network classifier Neural Networks 10 8 1997 1495 1503 (Pubitemid 28260899)
48. M.J.L. Orr Regularisation in the selection of radial basis function centres Neural Computation 7 3 1995 606 623
49. C.R. De Silva, S. Ranganath, and L.C. De Silva Cloud basis function neural network: a modified rbf network architecture for holistic facial expression recognition Pattern Recognition 41 4 2008 1241 1253 (Pubitemid 350218150)
50. F. Fernández-Navarro, C. Hervás-Martínez, M. Cruz-Ramírez, P.A. Gutiérrez, and A. Valero Evolutionary q-Gaussian radial basis function neural network to determine the microbial growth/no growth interface of Staphylococcus aureus, Applied Soft Computing 11 3 2011 3012 3020
51. K. Fukunaga Introduction to Statistical Pattern Recognition second ed. 1999 Academic Press
52. F.J. Martínez-Estudillo, C. Hervás-Martínez, P.A. Gutiérrez, and A.C. Martínez-Estudillo Evolutionary product-unit neural networks classifiers Neurocomputing 72 12 2008 548 561
53. A.C. Martínez-Estudillo, C. Hervás-Martínez, F.J. Martínez-Estudillo, and N. García-Pedrajas Hybridization of evolutionary algorithms and local search by means of a clustering method IEEE Transactions on Systems, Man and Cybernetics, Part B: Cybernetics 36 3 2006 534 545 (Pubitemid 43811312)
54. C. Igel, and M. Hüsken Empirical evaluation of the improved Rprop learning algorithms Neurocomputing 50 6 2003 105 123 (Pubitemid 36131033)
55. D.L. Whitley, V.S. Gordon, and K.E. Mathias Lamarckian evolution, the Baldwin effect and function optimization Y. Davidor, H.P. Schwefel, R. Männer, Parallel Problem Solving from Nature - PPSN III 1994 Springer Berlin 6 15
56. A. Asuncion, D. Newman, UCI machine learning repository, 〈 http://www.ics.uci.edu/∼mlearn/MLRepository.html 〉, 2007.
57. A. Valero, F. Pérez-Rodríguez, E. Carrasco, J.M. Fuentes-Alventosa, R.M. García-Gimeno, and G. Zurera Modelling the growth boundaries of Staphylococcus aureus: effect of temperature, ph and water activity International Journal of Food Microbiology 133 12 2009 186 194
58. F. Fernández-Navarro, A. Valero, C. Hervás-Martínez, P.A. Gutiérrez, R.M. García-Gimeno, and G. Zurera-Cosano Development of a multi-classification neural network model to determine the microbial growth/no growth interface International Journal of Food Microbiology 141 2010 203 212
59. M. Friedman A comparison of alternative tests of significance for the problem of m rankings Annals of Mathematical Statistics 11 1 1940 86 92
60. O.J. Dunn Multiple comparisons among means Journal of the American Statistical Association 56 1961 52 56
61. Y. Hochberg, and A. Tamhane Multiple Comparison Procedures 1987 John Wiley & Sons