The class imbalance problem: A systematic study

Intelligent Data Analysis

Volumn 6, Issue 5, 2002, Pages 429-449

  Japkowicz, Nathalie ^a   Stephen, Shaju ^a  

^a UNIVERSITY OF OTTAWA   (Canada)

Author keywords

C5.0; class imbalances; concept learning; misclassification costs; Multi Layer Perceptrons; re sampling; Support Vector Machines

Indexed keywords

SUPPORT VECTOR MACHINES;

C5.0; CLASS IMBALANCE; CONCEPT LEARNING; MISCLASSIFICATION COSTS; MULTI-LAYER PERCEPTRONS; RESAMPLING;

DECISION TREES;

EID: 33845536164     PISSN: 1088467X     EISSN: 15714128     Source Type: Journal    
DOI: 10.3233/ida-2002-6504     Document Type: Article

References (26)

1. N. Chawla, K. Bowyer, L. Hall and P. Kegelmeyer, SMOTE: Synthetic Minority Over-sampling TEchnique, International Conference on Knowledge Based Computer Systems, 2000.
2. P. Domingos, Metacost: A General Method for Making Classifiers Cost-sensitive, Proceedings of the Fifth ACMSIGKDD International Conference on Knowledge Discovery and Data Mining, 1999, pp. 155-164.
3. C. Elkan, The Foundations of Cost-Sensitive Learning, Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence, 2001.
4. A. Estabrooks, A Combination Scheme for Inductive Learning from Imbalanced Data Sets, MCS Thesis, Faculty of Computer Science, Dalhousie University, 2000.
5. A. Estabrooks and N. Japkowicz, A Mixture-of-Experts Framework for Concept-Learning from Imbalanced Data Sets, Proceedings of the 2001 Intelligent Data Analysis Conference, 2001, pp. 34-43.
6. T.E. Fawcett and F. Provost, Adaptive Fraud Detection, Data Mining and Knowledge Discovery 3(1) (1997), 291-316.
7. R.C. Holte, L.E. Acker and B.W. Porter, Concept Learning and the Problem of Small Disjuncts, Proceedings of the Eleventh Joint International Conference on Artificial Intelligence, 1989, pp. 813-818.
8. N. Japkowicz, C. Myers and M. Gluck, A Novelty Detection Approach to Classification, Proceedings of the Fourteenth Joint Conference on Artificial Intelligence, 1995, pp. 518-523.
9. N. Japkowicz, Learning from Imbalanced Data Sets: A Comparison of Various Solutions, in: Proceedings of the AAAI'2000 Workshop on Learning from Imbalanced Data Sets, N. Japkowicz, ed., AAAI Press, 2000.
10. N. Japkowicz, Concept-Learning in the Presence of Between-Class and Within-Class Imbalances, Advances in Artificial Intelligence: Proceedings of the 14th Conference of the Canadian Society for Computational Studies of Intelligence, 2001, pp. 67-77.
11. N. Japkowicz, Supervised versus Unsupervised Binary-Learning by Feedforward Neural Networks, Machine Learning 42(1/2) (2001), 97-122.
12. N. Japkowicz and S. Stephen, The Class Imbalance Problem: A Systematic Study, Technical Report TR-2001-07, University of Ottawa, 2001.
13. S. Lawrence, I. Burns, A.D. Back, A.C. Tsoi and C.L. Giles, Neural Network Classification and Unequal Prior Class Probabilities, in: Tricks of the Trade, Lecture Notes in Computer Science State-of-the-Art Surveys, G. Orr, R.-R. Muller and R. Caruana, eds, Springer Verlag, 1998, pp. 299-314.
14. M. Kubat and S. Matwin, Addressing the Curse of Imbalanced Data Sets: One-Sided Sampling, Proceedings of the Fourteenth International Conference on Machine Learning, 1997, pp. 179-186.
15. M. Kubat, R. Holte and S. Matwin, Machine Learning for the Detection of Oil Spills in Satellite Radar Images, Machine Learning 30 (1998), 195-215.
16. P.M. Murphy and D.W. Aha, UCI Repository of Machine Learning Databases, University of California at Irvine, Department of Information and Computer Science, 1994.
17. D. Lewis and J. Catlett, Heterogeneous Uncertainty Sampling for Supervised Learning, Proceedings of the Eleventh International Conference of Machine Learning, 1994, pp. 148-156.
18. C.X. Ling and C. Li, Data Mining for Direct Marketing: Problems and Solutions, International Conference on Knowledge Discovery & Data Mining, 1998.
19. A. Nickerson, N. Japkowicz and E. Milios, Using Unsupervised Learning to Guide Re-Sampling in Imbalanced Data Sets, Proceedings of the Eighth International Workshop on AI and Statitsics, 2001, pp. 261-265.
20. M. Pazzani, C. Merz, P. Murphy, K. Ali, T. Hume and C. Brunk, Reducing Misclassification Costs, Proceedings of the Eleventh International Conference on Machine Learning, 1994, pp. 217-225.
21. R. Quinlan, C5.0: An Informal Tutorial, http://www.rulequest.com/see5- unix.html, 2001.
22. D.E. Rumelhart, G.E. Hinton and R.J. Williams, Learning Internal Representations by Error Propagation, in: Parallel Distributed Processing, D.E. Rumelhart and J.L. McClelland, eds, MIT Press, Cambridge, MA, 1986, pp. 318-364.
23. C. Schaffer, Overfitting Avoidance as Bias, Machine Learning 10 (1993), 153-178.
24. J. Swets, R. Dawes and J. Monahan, Better Decisions through Science, Scientific American (2000), 82-97.
25. G. Weiss, Learning with Rare Cases and Small Disjuncts, Proceedings of the Twelfth International Conference on Machine Learning, 1995, pp. 558-565.
26. G.M. Weiss and F. Provost, The Effect of Class Distribution on Classifier Learning: An Empirical Study, Technical Report ML-TR-44, Department of Computer Science, Rutgers University, 2001.