Severe class imbalance: Why better algorithms aren't the answer

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3720 LNAI, Issue , 2005, Pages 539-546

  Drummond, Chris ^a   Holte, Robert C ^b  

^a NATIONAL RESEARCH COUNCIL CANADA   (Canada)

^b UNIVERSITY OF ALBERTA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

BIT ERROR RATE; CLASSIFICATION (OF INFORMATION); COSTS;

BAYES OPTIMAL CLASSIFIER; CLASS IMBALANCE; MAJORITY CLASS;

ALGORITHMS;

EID: 33646410663     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11564096_52     Document Type: Conference Paper

References (11)

1. Chawla, N.V., Japkowicz, N., Kolcz, A., eds.: Proc. of ICML'2003 Workshop on Learning from Imbalanced Data Sets. (2003)
2. Cardie, C., Howe, N.: Improving minority class prediction using case-specific feature weights. In: Proc. of 14th Int. Conf. on Machine Learning. (1997) 57-65
3. Provost, F., Fawcett, T., Kohavi, R.: The case against accuracy estimation for comparing induction algorithms. In: Proc. of 15th Int. Conf. on Machine Learning. (1998) 43-48
4. Ling, C.X., Huang, J., Zhang, H.: AUC: a statistically consistent and more discriminating measure than accuracy. In: Proc. of 18th Int. Joint Conf. on Artificial Intelligence. (2003) 519-524
5. Pazzani, M., Merz, C., Murphy, P., Ali, K., Hume, T., Brunk, C.: Reducing misclassification costs. In: Proc. of 11th Int. Conf. on Machine Learning. (1994) 217-225
6. Fawcett, T., Provost, F.: Adaptive fraud detection. Data Mining and Knowledge Discovery 1 (1997) 291-316
7. Drummond, C., Holte, R.C.: Explicitly representing expected cost: An alternative to ROC representation. In: Proc. of 6th Int. Conf. on Knowledge Discovery and Data Mining. (2000) 198-207
8. Axelsson, S.: The base-rate fallacy and its implications for the difficulty of intrusion detection. In: Proc. of 6th ACM Conf. on Computer & Communications Security (1999) 1-7
9. Quinlan, J.R.: C4.5 Programs for Machine Learning. Morgan Kaufmann (1993)
10. Blake, C.L., Merz, C.J.: UCI repository of machine learning databases, University of California, Irvine, CA. www.ics.uci.edu/~mlearn/MLRepository.html (1998)
11. Provost, F., Fawcett, T.: Robust classification systems for imprecise environments. In: Proc. of 15th Nat. Conf. on Artificial Intelligence. (1998) 706-713