An alternative to ROC and AUC analysis of classifiers

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7014 LNCS, Issue , 2011, Pages 210-221

  Klawonn, Frank ^a,b   Höppner, Frank ^a   May, Sigrun ^b  

^a OSTFALIA UNIVERSITY OF APPLIED SCIENCES   (Germany)

^b HELMHOLTZ CENTRE FOR INFECTION RESEARCH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFIER PERFORMANCE; MISCLASSIFICATION RATES; MISCLASSIFICATIONS; PERFORMANCE EVALUATION;

VISUALIZATION;

DATA REDUCTION;

EID: 80455168539     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-24800-9_21     Document Type: Conference Paper

References (15)

1. Hand, D.:Measuring classifier performance: a coherent alternative to the area under the ROC curve. Machine Learning 77, 103-123 (2009)
2. Kohavi, R.: A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, pp. 1137-1143. Morgan Kaufmann, San Mateo (1995)
3. Obuchowsky, N., Lieber, M., Wians Jr., F.: ROC curves in clinical chemistry: Uses, misuses and possible solutions. Clinical Chemistry 50, 1118-1125 (2004)
4. Søreide, K.: Receiver-operating characteristic (ROC) curve analysis in diagnostic, prognostic and predictive biomarker research. Clinical Pathology 62, 1-5 (2009)
5. Berthold, M., Borgelt, C., Höppner, F., Klawonn, F.: Guide to Intelligent Data Analysis: How to Intelligently Make Sense of Real Data. Springer, London (2010)
6. Hand, D., Mannila, H., Smyth, P.: Principles of Data Mining. MIT Press, Cambridge (2001)
7. Provost, F., Fawcett, T., Kohavi, R.: The case against accuracy estimation for comparing induction algorithms. In: Proceedings of the 15th International Conference on Machine Learning (1998)
8. Mossman, D.: Three-way ROCs. Medical Decision Making 19, 78-89 (1999)
9. Hand, D., Till, R.: A simple generalisation of the area under the ROC curve for multiple class classification problems. Machine Learning 45, 171-186 (2001)
10. Li, J., Fine, J.: ROC analysis with multiple classes and multiple tests: methodology and its application in microarray studies. Biostatistics 9, 566-576 (2008)
11. Adams, N., Hand, D.: Comparing classifiers when the misallocation costs are uncertain. Pattern Recognition 32, 1139-1147 (1999)
12. Drummond, C., Holte, R.: Explicitly representing expected cost: An alternative to ROC representation. In: Proc. Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 198-207. ACM Press, New York (2000)
13. Drummond, C., Holte, R.: Cost curves: An improved method for visualizing classifier performance. Machine Learning 65, 95-130 (2006)
14. Hernández-Orallo, J., Flach, P., Ferri, C.: Brier curves: a new cost-based visualisation of classifier performance. In: Getoor, L., Scheffer, T. (eds.) Proc. 28th International Conference on Machine Learning (ICML 2011), pp. 585-592. ACM, New York (2011)
15. Turney, P.: Cost-sensitive classification: Empirical evaluation of a hybrid genetic decision tree induction algorithm. Journal of Artificial Intelligence Research 2, 369-409 (1995)