A new evaluation measure for learning from imbalanced data

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2011, Pages 537-542

  Thai Nghe, Nguyen ^a   Gantner, Zeno ^a   Schmidt Thieme, Lars ^a  

^a UNIVERSITY OF HILDESHEIM   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

AREA UNDER THE ROC CURVE; BETA DISTRIBUTIONS; EVALUATION MEASURES; IMBALANCED DATA; IMBALANCED DATA SETS; LOGISTIC REGRESSIONS; MISCLASSIFICATION COSTS; SMALL DATA SET; UNDER-SAMPLING; WEIGHT DISTRIBUTIONS;

NEURAL NETWORKS;

EID: 80054749130     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2011.6033267     Document Type: Conference Paper

References (23)

1. D. J. Hand, "Measuring classifier performance: A coherent alternative to the area under the ROC curve," Machine Learning, vol. 77, no. 1, pp. 103-123, October 2009.
2. N. V. Chawla, N. Japkowicz, and A. Kotcz, "Editorial: special issue on learning from imbalanced data sets," SIGKDD Explorations, vol. 6, no. 1, pp. 1-6, 2004.
3. H. He and E. A. Garcia, "Learning from imbalanced data," IEEE Transactions on Knowledge and Data Engineering, vol. 21, no. 9, pp. 1263-1284, September 2009.
4. Q. Yang and X. Wu, "10 challenging problems in data mining research," International Journal of Information Technology and Decision Making, vol. 5, no. 4, pp. 597-604, 2006.
5. J. Hanley and B. Mcneil, "The meaning and use of the area under receiver operating characteristics (ROC) curve," Radiology, vol. 143, no. 1, pp. 29-36, 1982.
6. A. P. Bradley, "The use of the area under the ROC curve in the evaluation of machine learning algorithms," Pattern Recognition, vol. 7, no. 30, pp. 1145-1159, 1997.
7. A. Jamain and D. J. Hand, "Where are the large and difficult datasets?" Advances in Data Analysis and Classification, vol. 3, no. 1, pp. 25-38, June 2009.
8. D. J. Hand, "Classifier technology and the illusion of progress," Statistical Science, vol. 21, no. 1, pp. 1-14, Jun 2006.
9. M. H. Degroot and M. J. Schervish, Probability and Statistics, 3rd Edition. Addison-Wesley, 2002.
10. N. Thai-Nghe, Z. Gantner, and L. Schmidt-Thieme, "Cost-sensitive learning methods for imbalanced data," in Proceeding of IEEE International Joint Conference on Neural Networks (IJCNN 2010). IEEE Xplore, 2010, pp. 1-8.
11. A. Estabrooks, T. Jo, and N. Japkowicz, "A multiple resampling method for learning from imbalanced data sets," Computational Intelligence, vol. 20, no. 1, pp. 18-36, 2004.
12. X.-Y. Liu, J. Wu, and Z.-H. Zhou, "Exploratory undersampling for class-imbalance learning," IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 39, no. 2, pp. 539-550, April 2009.
13. N. V. Chawla, K. Bowyer, L. Hall, and W. P. Kegelmeyer, "SMOTE: synthetic minority over-sampling technique," Journal of Artificial Intelligent Research, vol. 16, pp. 321-357, 2002.
14. K. Veropoulos, C. Campbell, and N. Cristianini, "Controlling the sensitivity of support vector machines," in Proceedings of International Joint Conferences on Artificial Intelligence (IJCAI 1999), 1999, pp. 55-60.
15. R. Akbani, S. Kwek, and N. Japkowicz, "Applying support vector machines to imbalanced datasets," in Proceedings of the 15th European Conference on Machine Learning (ECML 2004), 2004, pp. 39-50.
16. W. Liu, S. Chawla, D. A. Cieslak, and N. V. Chawla, "A robust decision tree algorithm for imbalanced data sets," in SIAM International Conference on Data Mining (SDM'10), 2010, pp. 766-777.
17. C. Elkan, "The foundations of cost-senstive learning," in Proceedings of International Joint Conferences on Artificial Intelligence (IJCAI 2001), 2001, pp. 973-978.
18. X.-Y. Liu and Z.-H. Zhou, "Learning with cost intervals," in Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining, ser. KDD '10. New York, NY, USA: ACM, 2010, pp. 403-412.
19. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin, "Liblinear: A library for large linear classification," Journal of Machine Learning Research, vol. 9, pp. 1871-1874, August 2008.
20. S. Hido, H. Kashima, and Y. Takahashi, "Roughly balanced bagging for imbalanced data," Statistical Analysis and Data Mining, vol. 2, no. 5-6, pp. 412-426, 2009.
21. N. Thai-Nghe, A. Busche, and L. Schmidt-Thieme, "Improving academic performance prediction by dealing with class imbalance," in Proceedings of the 9th IEEE International Conference on Intelligent Systems Design and Applications (ISDA 2009). IEEE Computer Society, 2009, pp. 878-883.
22. G. Batista, R. C. Prati, and M. C. Monard, "A study of the behavior of several methods for balancing machine learning training data," SIGKDD Explorations, vol. 6, no. 1, pp. 20-26, 2004.
23. J. Van Hulse, T. M. Khoshgoftaar, and A. Napolitano, "Experimental perspectives on learning from imbalanced data," in Proceedings of International Conference on Machine Learning (ICML 2007), 2007, pp. 935-942.