On the statistical consistency of algorithms for binary classification under class imbalance

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 2, 2013, Pages 1640-1648

  Menon, Aditya Krishna ^a   Narasimhan, Harikrishna ^b   Agarwal, Shivani ^b   Chawla, Sanjay ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b INDIAN INSTITUTE OF SCIENCE   (India)

^c UNIVERSITY OF SYDNEY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; LEARNING SYSTEMS;

BINARY CLASSIFICATION; MACHINE LEARNING APPLICATIONS; MEASURING PERFORMANCE; MISCLASSIFICATION ERROR; PERFORMANCE MEASURE; STATISTICAL CONSISTENCIES; TRUE NEGATIVE RATES; UNDERLYING DISTRIBUTION;

RISK ASSESSMENT;

EID: 84897506611     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (37)

1. Agarwal, S. Surrogate regret bounds for the area under the ROC curve via strongly proper losses. In COLT, 2013.
2. Bartlett, P.L., Jordan, M.I., and McAuliffe, J.D. Convexity, classification, and risk bounds. Journal of the American Statistical Association, 101(473):138-56, 2006. (Pubitemid 43500031)
3. Bousquet, O. and Elisseeff, A. Stability and generalization. Journal of Machine Learning Research, 2:499-526, 2002. (Pubitemid 135712570)
4. Cardie, C. and Howe, N. Improving minority class prediction using case-specific feature weights. In ICML, 1997.
5. Chan, P.K. and Stolfo, S.J. Learning with non-uniform class and cost distributions: Effects and a distributed multi-classifier approach. In KDD-98 Workshop on Distributed Data Mining, 1998.
6. Chawla, N.V., Bowyer, K.W., Hall, L.O., and Kegelmeyer, W.P. SMOTE: Synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, 16:321-357, 2002.
7. Chawla, N.V., Japkowicz, N., and Kolcz, A. (eds.). Proceedings of the ICML 2003 Workshop on Learning from Imbalanced Data Sets. 2003.
8. Chawla, N.V., Japkowicz, N., and Kotcz, A. Editorial: Special issue on learning from imbalanced data sets. SIGKDD Explorations Newsletter, 6(1):1-6, 2004.
9. Chawla, N.V., Cieslak, D.A., Hall, L.O., and Joshi, A. Automatically countering imbalance and its empirical relationship to cost. Data Mining & Knowledge Discovery, 17(2):225-252, 2008.
10. Cheng, J., Hatzis, C., Hayashi, H., Krogel, M-A., Morishita, S., Page, D., and Sese, J. KDD Cup 2001 report. ACM SIGKDD Explorations Newsletter, 3(2):47-64, 2002.
11. Daskalaki, S., Kopanas, I., and Avouris, N. Evaluation of classifiers for an uneven class distribution problem. Applied Artificial Intelligence, 20:381-417, 2006.
12. Davis, J. and Goadrich, M. The relationship between precision-recall and ROC curves. In Proc. ICML, 2006.
13. Drummond, C. and Holte, R.C. Severe class imbalance: Why better algorithms aren't the answer. In Proc. ECML, 2005.
14. Drummond, C. and Holte, R.C. Cost curves: An improved method for visualizing classifier performance. Machine Learning, 65(1):95-130, 2006. (Pubitemid 44451195)
15. Elkan, C. The foundations of cost-sensitive learning. In Proc. IJCAI, 2001.
16. Frank, A. and Asuncion, A. UCI machine learning repository, 2010. URL http://archive.ics.uci.edu/ml.
17. Gu, Q., Zhu, L., and Cai, Z. Evaluation measures of the classification performance of imbalanced data sets. In Computational Intelligence and Intelligent Systems, volume 51, pp. 461-471. 2009.
18. He, H. and Garcia, E.A. Learning from imbalanced data. IEEE Transactions on Knowledge and Data Engineering, 21(9):1263-1284, 2009.
19. Japkowicz, N. The class imbalance problem: Significance and strategies. In In Proc. ICAI, 2000.
20. Japkowicz, N. and Stephen, S. The class imbalance problem: A systematic study. Intelligent Data Analysis, 6(5):429-449, 2002.
21. Kennedy, K., Namee, B.M., and Delany, S.J. Learning without default: a study of one-class classification and the low-default portfolio problem. In ICAICS, 2009.
22. Kotlowski, W., Dembczynski, K., and Hüllermeier, E. Bipartite ranking through minimization of univariate loss. In Proc. ICML, 2011.
23. Kubat, M. and Matwin, S. Addressing the curse of imbalanced training sets: One-sided selection. In ICML, 1997.
24. Lawrence, S., Burns, I., Back, A., Tsoi, A-C., and Giles, C.L. Neural network classification and prior class probabilities. In Neural Networks: Tricks of the Trade, Lecture Notes in Computer Science, pp. 1524:299-313. 1998.
25. Lewis, D.D. and Gale, W.A. A sequential algorithm for training text classifiers. In Proc. SIGIR, 1994.
26. Ling, C., Ling, C.X., and Li, C. Data mining for direct marketing: Problems and solutions. In Proc. KDD, 1998.
27. Liu, W. and Chawla, S. A quadratic mean based supervised learning model for managing data skewness. In Proc. SDM, 2011.
28. Platt, J.C. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In Adv. Large Margin Classifiers, pp. 61-74, 1999.
29. Powers, R., Goldszmidt, M., and Cohen, I. Short term performance forecasting in enterprise systems. In Proc. KDD, 2005.
30. Qiao, X. and Liu, Y. Adaptive weighted learning for unbalanced multicategory classification. Biometrics, 65(1):159-168, 2009.
31. Reid, M.D. and Williamson, R.C. Surrogate regret bounds for proper losses. In Proc. ICML, 2009.
32. Reid, M.D. and Williamson, R.C. Composite binary losses. Journal of Machine Learning Research, 11:2387-2422, 2010.
33. Scott, C. Calibrated asymmetric surrogate losses. Electronic Journal of Statistics, 6:958-992, 2012.
34. Van Hulse, J., Khoshgoftaar, T.M., and Napolitano, A. Experimental perspectives on learning from imbalanced data. In Proc. ICML, 2007.
35. Wallace, B.C., K.Small, Brodley, C.E., and Trikalinos, T.A. Class imbalance, redux. In Proc. ICDM, 2011.
36. Zadrozny, Bianca, Langford, John, and Abe, Naoki. Cost-sensitive learning by cost-proportionate example weighting. In ICDM, 2003.
37. Zhang, T. Statistical behaviour and consistency of classification methods based on convex risk minimization. Annals of Mathematical Statistics, 32:56-134, 2004. (Pubitemid 41449305)