Assessment metrics for imbalanced learning

Imbalanced Learning: Foundations, Algorithms, and Applications

Volumn , Issue , 2013, Pages 187-206

  Japkowicz, Nathalie ^a,b  

^a UNIVERSITY OF OTTAWA   (Canada)

^b NORTHERN ILLINOIS UNIVERSITY   (United States)

Author keywords

Assessment metrics; Class imbalance; Evaluation metric families; Imbalanced learning; Ranking methods; Threshold metrics

Indexed keywords

EID: 85076269272     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781118646106.ch8     Document Type: Chapter

References (21)

1. N. Japkowicz and M. Shah, Evaluating Learning Algorithms: A Classification Perspective. (New York, USA), Cambridge University Press, 2011.
2. T. Raeder, T. R. Hoens, and N. V. Chawla, “Consequences of variability in classifier performance estimates,” in ICDM (Sydney, Australia), pp. 421-430, IEEE Computer Society, 2010.
3. C. Ferri, J. Haernandez-Orallo, and R. Modroiu, “An experimental comparison of performance measures for classification,” Pattern Recognition Letters, vol. 30, pp. 27-38, 2009.
4. R. Caruana and A. Niculescu-Mizil, “Data mining in metric space: An empirical analysis of supervised learning performance criteria,” in Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data mining, (Seattle, WA), pp. 69-78, 2004.
5. H. He and E. A. Garcia, “Learning from imbalanced data,” IEEE Transactions on Knowledge and Data Engineering, vol. 21, no. 9, pp. 1263-1284, 2009.
6. F. J. Provost and T. Fawcett, “Robust classification for imprecise environments,” Machine Learning, vol. 42, no. 3, pp. 203-231, 2001.
7. M. Kubat, R. C. Holte, and S. Matwin, “Machine learning for the detection of oil spills in satellite radar images,” Machine Learning, vol. 30, pp. 195-215, 1998.
8. G. Cohen, M. Hilario, H. Sax, S. Hugonnet, and A. GeissbUhler, “Learning from imbalanced data in surveillance of nosocomial infection,” Artificial Intelligence in Medicine, vol. 37, no. 1, pp. 7-18, 2006.
9. R. Ranawana and V. Palade, “Optimized precision: A new measure for classifier performance evaluation,” in Proceedings of the IEEE Congress on Evolutionary Computation (Vancouver, BC), pp. 2254-2261, IEEE Computer Society, 2006.
10. R. Batuwita and V. Palade, “A new performance measure for class imbalance learning. Application to bioinformatics problems,” in ICMLA (Miami Beach, FL, USA), pp. 545-550, IEEE Computer Society, 2009.
11. V. García, R. A. Mollineda, and J. S. Sanchez, “Theoretical analysis of a performance measure for imbalanced data,” in ICPR (Istanbul, Turkey), pp. 617-620, IEEE Computer Society, 2010.
12. G. I. Webb and K. M. Ting, “On the application of ROC analysis to predict classification performance under varying class distribution,” Machine Learning, vol. 58, pp. 25-32, 2005.
13. T. Fawcett and P. A. Flach, “A response to Webb and Ting’s on the application of ROC analysis to predict classification performance under varying class distribution’,” Machine Learning, vol. 58, pp. 33-38, 2005.
14. T. Landgrebe, P. Paclik, and R. P. W. Duin, “Precision-recall operating characteristics (p-ROC) curves in imprecise environments,” in Proceedings of the Eighteenth International Conference on Pattern Recognition (Hong Kong, China), pp. 123-127, IEEE Computer Society, 2006.
15. J. Davis and M. Goadrich, “The relationship between precision-recall and ROC curves,” in the Proceedings of the Twenty-Third International Conference on Machine Learning, (Pittsburgh, Pennsylvania, USA), pp. 233-240, ACM, 2006.
16. D. J. Hand, “Measuring classifier performance: A coherent alternative to the area under the ROC curve,” Machine Learning, vol. 77, no. 1, pp. 103-123, 2009.
17. P. Flach, J. Hernandez-Orallo, and C. Ferri, “A coherent interpretation of AUC as a measure of aggregated classification performance,” in Proceedings of the 28th International Conference on Machine Learning (ICML-11) (New York, NY, USA), pp. 657-664, Omnipress, 2011.
18. A. Cardenas and J. Baras, “B-ROC curves for the assessment of classifiers over imbalanced data sets,” in Proceedings of the Twenty-First National Conference on Artificial Intelligence (Boston, MA, USA), pp. 1581-1584, AAAI Press, 2006.
19. M. Keller, S. Bengio, and S. Y. Wong, “Benchmarking non-parametric statistical tests,” in NIPS, (Vancouver, BC, Canada), pp. 464, MIT Press, 2005.
20. T. Fawcett, “An introduction to ROC analysis,” Pattern Recognition Letters, vol. 27, pp. 861-874, 2006.
21. D. J. Hand and R. J. Till, “A simple generalisation of the area under the ROC curve for multiple class classification problems,” Machine Learning, vol. 45, pp. 171-186, 2001.