Integrated discrimination improvement and probability-sensitive AUC variants

Statistics in Medicine

Volumn 29, Issue 2, 2010, Pages 318-319

  Van Calster, Ben ^a   Van Huffel, Sabine ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

MARKER;

AREA UNDER THE CURVE; INTEGRATED DISCRIMINATION IMPROVEMENT; LETTER; MACHINE LEARNING; PREDICTION; PROBABILITY; RECEIVER OPERATING CHARACTERISTIC; SCORING SYSTEM; STATISTICAL ANALYSIS; STATISTICAL MODEL;

ALGORITHMS; AREA UNDER CURVE; HUMANS; MODELS, STATISTICAL; PROBABILITY; RISK ASSESSMENT; RISK FACTORS; ROC CURVE;

EID: 74749107167     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.3761     Document Type: Letter

References (9)

1. Pencina MJ, D'Agostino Sr RB, D'Agostino Jr RB, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Statistics in Medicine 2008; 27:157-172. DOI: 10.1002/sim.2929.
2. Ferri C, Flach P, Hernández-Orallo J, Senad A. Modifying ROC curves to incorporate predicted probabilities. Proceedings of the ICML Workshop on ROC Analysis in Machine Learning, Bonn, Germany, 2005. Available from: http://users.dsic.upv.es/∼flip/ROCML2005/papers/ferriCRC.pdf.
3. Wu S, Flach P. A scored AUC metric for classifier evaluation and selection. Proceedings of the ICML Workshop on ROC Analysis in Machine Learning, Bonn, Germany, 2005. Available from: http://users.dsic.upv.es/ ∼flip/ROCML2005/papers/wuCRC.pdf.
4. Wu S, Flach P, Ferri C. An Improved Model Selection Heuristic for AUC. Lecture Notes in Computer Science, vol. 4701. Springer: Berlin, 2007; 478-489. DOI: 10.1007/978-3-540-74958-5-44.
5. Ferri C, Hernández-Orallo J, Modroiu R. An experimental comparison of performance measures for classification. Pattern Recognition Letters 2009; 30:27-38. DOI: 10.1016/j.patrec.2008.08.010.
6. Van Calster B, Condous G, Kirk E, Bourne T, Timmerman D, Van Huffel S. An application of methods for the probabilistic three-class classification of pregnancies of unknown location. Artificial Intelligence in Medicine 2009; 46:139-154. DOI: 10.1016/j.artmed.2008.12.003.
7. Mossman D. Three-way ROCs. Medical Decision Making 1999; 19:78-89. DOI: 10.1177/0272989X9901900110.
8. Hand DJ, Till RJ. A simple generalization of the area under the ROC curve for multiple class classification problems. Machine Learning 2001; 45:171-186. DOI: 10.1023/A:1010920819831.
9. Van Calster B, Van Belle V, Condous G, Bourne T, Timmerman D, Van Huffel S. Multi-class AUC metrics and weighted alternatives. Proceedings of the 21st International Joint Conference on Neural Networks (IJCNN), Hong Kong, China, 2008; 1391-1397. DOI: 10.1109/IJCNN.2008.4633979.