Assessing classifiers in terms of the partial area under the ROC curve

Computational Statistics and Data Analysis

Volumn 64, Issue , 2013, Pages 51-70

  Yousef, Waleed A ^a  

^a Helwan University ^*  (Egypt)

Author keywords

Classification Classifier assessment Partial area under the ROC curve Bootstrap Nonparametric inference

Indexed keywords

DECISION VARIABLES; ESTIMATED VARIANCE; INFLUENCE FUNCTIONS; MATHEMATICAL PROPERTIES; MEDICAL COMMUNITY; NON-PARAMETRIC ESTIMATIONS; NONPARAMETRIC ESTIMATORS; PARTIAL AREA;

CLASSIFICATION (OF INFORMATION); ESTIMATION; STATISTICAL METHODS;

UNCERTAINTY ANALYSIS;

EID: 84875453168     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2013.02.032     Document Type: Article

References (25)

1. G. Casella, and R.L. Berger Statistical Inference second ed. Duxbury Advanced Series 2002 Duxbury/Thomson Learning Australia, Pacific Grove, CA
2. W. Chen, B.D. Gallas, and W.A. Yousef Classifier variability: accounting for training and testing Pattern Recognition 45 7 2012 2661 2671
3. C. Cortes, and M. Mohri AUC optimization vs. error rate minimization Advances in Neural Information Processing Systems 16 16 2004 313 320
4. L.E. Dodd, and M.S. Pepe Partial AUC estimation and regression Biometrics 59 3 2003 614 623 (Pubitemid 37093400)
5. B. Efron Estimating the error rate of a prediction rule: improvement on cross-validation Journal of the American Statistical Association 78 382 1983 316 331
6. B. Efron, and R. Tibshirani An Introduction to the Bootstrap Monographs on Statistics and Applied Probability vol. 57 1993 Chapman and Hall New York
7. B. Efron, and R. Tibshirani Improvements on cross-validation: the 0.632+ bootstrap method Journal of the American Statistical Association 92 438 1997 548 560
8. T. Fawcett An introduction to ROC analysis Pattern Recognition Letters 27 8 2006 861 874
9. K. Fukunaga Introduction to Statistical Pattern Recognition second ed. Computer Science and Scientific Computing 1990 Academic Press Boston
10. J. Hájek, Z. Šidák, and P.K. Sen Theory of Rank Tests second ed. Probability and Mathematical Statistics 1999 Academic Press San Diego, Calif
11. J.A. Hanley Receiver operating characteristic (ROC) curves Encyclopedia of Biostatistics, Vol. 5 1998 3738 3745
12. J.A. Hanley, and B.J. McNeil The meaning and use of the area under a receiver operating characteristic (ROC) curve Radiology 143 1 1982 29 36 (Pubitemid 12142173)
13. T. Hastie, R. Tibshirani, and J.H. Friedman The Elements of Statistical Learning: Data Mining, Inference, and Prediction Springer Series in Statistics 2001 Springer New York
14. Y. Jiang, C.E. Metz, and R.M. Nishikawa A receiver operating characteristic partial area index for highly sensitive diagnostic tests Radiology 201 3 1996 745 750 (Pubitemid 26392624)
15. Macskassy, S.A., Provost, F., 2005a. Pointwise ROC confidence bounds: an empirical evaluation. In: ICML, Proceedings of Workshop on ROC Analysis in Machine Learning.
16. Macskassy, S.A., Provost, F., 2005b. ROC confidence bands: an empirical evaluation. In: Proceedings of the Workshop on ROC Analysis in Machine Learning (ROCML-2005) at ICML-2005.
17. D. McClish Analyzing a portion of the ROC curve Medical Decision Making 9 3 1989 190 195 (Pubitemid 19181460)
18. Newman, D.J., Asuncion, A., 2007. UCI machine learning repository (http://www.ics.uci.edu/~mlearn/MLRepository.html). University of California, Irvine, Dept. of Information and Computer Sciences.
19. J.S. Ramberg, P.R. Tadikamalla, E.J. Dudewicz, and E.F. Mykytka A probability distribution and its uses in fitting data Technometrics 21 2 1979 201
20. L.L. Tian Confidence interval estimation of partial area under curve based on combined biomarkers Computational Statistics & Data Analysis 54 2 2010 466 472
21. S.D. Walter The partial area under the summary ROC curve Statistics in Medicine 24 13 2005 2025 2040 (Pubitemid 40895557)
22. W.A. Yousef, S. Kundu, and R.F. Wagner Nonparametric estimation of the threshold at an operating point on the ROC curve Computational Statistics & Data Analysis 53 12 2009 4370 4383
23. W.A. Yousef, R.F. Wagner, and M.H. Loew Comparison of non-parametric methods for assessing classifier performance in terms of ROC parameters Applied Imagery Pattern Recognition Workshop, 2004, Proceedings, 33rd 2004 IEEE Computer Society 190 195 (Pubitemid 41756575)
24. W.A. Yousef, R.F. Wagner, and M.H. Loew Estimating the uncertainty in the estimated mean area under the ROC curve of a classifier Pattern Recognition Letters 26 16 2005 2600 2610 (Pubitemid 41562831)
25. W.A. Yousef, R.F. Wagner, and M.H. Loew Assessing classifiers from two independent data sets using ROC analysis: a nonparametric approach IEEE Transactions on Pattern Analysis and Machine Intelligence 28 11 2006 1809 1817