Does cost-sensitive learning beat sampling for classifying rare classes?

Proceedings of the 1st International Workshop on Utility-Based Data Mining, UBDM '05

Volumn , Issue , 2005, Pages 69-77

  McCarthy, Kate ^a   Zabar, Bibi ^a   Weiss, Gary ^a  

^a FORDHAM UNIVERSITY   (United States)

Author keywords

class imbalance; cost sensitive learning; data mining; decision trees; induction; rare classes; sampling

Indexed keywords

CLASS DISTRIBUTIONS; CLASS IMBALANCE; COST-SENSITIVE LEARNING; DOWNSAMPLING; MEDICAL DIAGNOSIS; MISCLASSIFICATION COSTS; NONUNIFORM; RARE CLASS; SAMPLING TECHNIQUE; TRAINING SETS;

CLASSIFIERS; DATA MINING; DECISION TREES; DIAGNOSIS;

COSTS;

EID: 77953586736     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1089827.1089836     Document Type: Conference Paper

References (18)

1. Abe, N., Zadrozny, B., and Langford, J. An iterative method for multi-class cost-sensitive learning. KDD '04, August 22-25, 2004, Seattle, Washington, USA, 2004.
2. Breiman, E., J Friedman, R. Olshen and C. Stone. Classification and Regression Trees. Belmont, CA: Wadsworth International Group, 1984.
3. Chan, P., and Stolfo, S. Toward scalable learning with non-uniform cost and class distributions: a case study in credit card fraud detection. American Association for Artificial Intelligence, 1998.
4. Chawla, N. C4.5 and imbalanced datasets: investigating the effect of sampling method, probabilistic estimate, and decision tree structure. ICML 2003 Workshop on Imbalanced Datasets.
5. Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P. SMOTE: synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, Volume 16, 321-357, 2002.
6. Chen C., Liaw, A., and Breiman, L. Using random forest to learn unbalanced data. Technical Report 666, Statistics Department, University of California at Berkeley, 2004. 〈http://www.stat.berkeley.edu/users/chenchao/ 666.pdf〉
7. Ciraco, M., Rogalewski, M., and Weiss, G. Improving classifier utility by altering the misclassification cost ratio. Proceedings of the KDD-2005 Workshop on Utility-Based Data Mining.
8. Drummond, C., and Holte, R. C4.5, class imbalance, and cost sensitivity: why under-sampling beats over-sampling. Workshop on Learning from Imbalanced Data sets II, ICML, Washington DC, 2003.
9. Elkan, C. The foundations of cost-sensitive learning. Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence, 2001.
10. Japkowicz N, and Stephen, S. The class imbalance problem: a systematic study. Intelligent Data Analysis Journal, 6(5), 2002.
11. Kubat, M and Matwin, S. Addressing the curse of imbalanced training sets: one-sided selection. Proceedings of the Fourteenth International Conference on Machine Learning, 179-186, 1997.
12. Maloof, M. Learning when data sets are imbalanced and when costs are unequal and unknown. ICML 2003 Workshop on Imbalanced Datasets.
13. Pednault, E., Rosen, B., and Apte, C. The importance of estimation errors in cost-sensitive learning. IBM Research Report RC-21757, May 30, 2000.
14. Quinlan, J.R. C4.5: programs for machine learning. Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993.
15. Quinlan, J.R. Induction of decision trees. Machine Learning 1: 81-106, 1986.
16. Weiss, G., and Hirsh, H. A quantitative study of small disjuncts. Proceedings of the Seventeenth National Conference on Artificial Intelligence, 2000.
17. Weiss, G., and Provost, F. Learning when training data are costly: the effect of class distribution on tree induction. Journal of Artificial Intelligence Research, 2003.
18. "Data Mining Tools See5 and C5.0." RuleQuest, Nov. 2004. RuleQuest Research. May 13, 2005. 〈http://www.rulequest.com/see5-info. html〉