Receiver operating characteristic (ROC) curve analysis for medical diagnostic test evaluation

Caspian Journal of Internal Medicine

Volumn 4, Issue 2, 2013, Pages 627-635

  Hajian Tilaki, Karimollah ^a  

^a BABOL UNIVERSITY OF MEDICAL SCIENCES   (Iran)

Author keywords

Area under the curve (AUC); Bias; Nonparametric; Parametric; ROC curve; Sensitivity; Specificity

Indexed keywords

AGE DISTRIBUTION; ANALYTICAL PARAMETERS; AREA UNDER THE CURVE; BAYES THEOREM; COMPARATIVE STUDY; CONFOUNDING VARIABLE; DIAGNOSTIC ACCURACY; DIAGNOSTIC TEST; DISEASE CLASSIFICATION; FALSE NEGATIVE RESULT; FALSE POSITIVE RESULT; HUMAN; INSTRUMENT VALIDATION; OPTIMAL CUT OFF VALUE; PREDICTIVE VALUE; PREVALENCE; PROBABILITY; RECEIVER OPERATING CHARACTERISTIC; RELIABILITY; REVIEW; SENSITIVITY AND SPECIFICITY; STATISTICAL ANALYSIS; SYSTEMATIC ERROR; VALIDITY;

EID: 84878997167     PISSN: 20086164     EISSN: 20086172     Source Type: Journal    
DOI: None     Document Type: Review

References (50)

1. Swets JA. ROC analysis applied to the evaluation of medical imaging techniques. Invest Radiol 1979; 14:109-21.
2. Hanley JA. Receiver operating characteristic (ROC) methodology: the state of the art. Crit Rev Diagn Imaging 1989; 29: 307-35.
3. Linnet K. Comparison of quantitative diagnostic tests: type I error, power, and sample size. Stat Med 1987; 6: 147-58.
4. Ben-Shakhar G, Lieblich I, Bar-Hillel M. An evaluation of polygraphers' judgement: a review from a decision theoretic perspective. J Appl Psychol 1982; 67: 701-13.
5. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982; 143: 29-36.
6. Hanley JA, McNeil BJ. A method of comparing the area under receiver operating characteristic curves derived from the same cases. Radiology 1983; 148: 839-43.
7. Kummar R, Indrayan A. Receiver operating characteristic (ROC) curve for medical researchers. Indian Pediatr 2011;
8. Daubin C, Quentin C, Allouche S, et al. Serum neuron-specific enolase as predictor of outcomes in comatose cardiac arrest survivor: a prospective cohort study. BMC Cardiovasc Disord 2011; 11: 48.
9. Darmon M,Vincentv J, Diagnostic performance of Fractional excretion of urea in the evaluation of critically III patients with acute kidney injury: a multicenter cohort study. Crit Care 2011; 15: R178.
10. Reddy S, Dutta S, Narang A. Evaluation of lactate dehydrogenase, creatine kinase and hepatic enzymes for retrospective diagnosis of perinatal asphyxia among sick neonates. Indian Pediatr 2008; 45: 144-7.
11. Zou KH, O'Malley AJ, Mauri L. Receiver operating characteristic analysis for evaluation diagnostic tests and predictive models. Circulation 2007; 115: 654-57.
12. Hajian-Tilaki KO, Gholizadehpasha AR, Bozogzadeh S, Hajian-Tilaki E. Body mass index and waist circumference are predictor biomarkers of breast cancer risk in Iranian women Med Oncol 2011; 28: 1296-301. [Epub ahead of print]
13. Kramer M. Clinical epidemiology and biostatistics: A primer for clinical investigation and decision making. First ed. Berlin: Springer-Verlag 1988; pp: 201-19.
14. Swets JA. Measuring the accuracy of diagnostic systems. Science 1988; 240: 1285-93.
15. Begg CB. Advances in statistical methodology for diagnostic medicine in the 1980's. Stat Med 1991; 10: 1887-95.
16. Swets JA. Indices of discrimination or diagnostic accuracy: their ROCs and implied models. Psychol Bull 1986; 99: 100-17.
17. Green DM, Swets JA. Signal detection theory and psychophysics. First ed. New York: John Wiley & Sons 1966.
18. Lusted LB. Logical analysis in roentgen diagnosis. Radiology 1960; 74: 178-93.
19. Dorfman DD, Alf EJR. Maximum likelihood estimation of parameters of signal detection theory - a direct solution. Psychometrika 1968; 33: 117-24.
20. FORTRAN programs ROCFIT, CORROC2, LABROC1 and LABROC4, ROCKIT. Available at: http://www. radiology.uchicago.edu/krk/KRL_ROC/software_index6.htm.
21. Metz CE. Basic principles of ROC analysis. Semin Nucl Med 1978; 8: 283-98.
22. Metz CE. ROC methodology in radiological imaging.Invest Radiol 1986; 21: 720-33.
23. McNeil BJ, Hanley JA. Statistical approaches to the analysis of receiver operating characteristic (ROC) curves. Med Decis Making 1984; 4: 137-50.
24. Wieand S, Gail MH, James BR, James KL. A family of nonparametric statistics for comparing diagnostic markers with paired or unpaired data. Biometrika 1989; 76: 585-92.
25. McClish DK. Analyzing a portion of the ROC curve. Med Decis Making 1989; 9: 190-95.
26. Greiner M, Pfeiffer D, Smith RD. Priciples and practical application of the receiver operating characteristic analysis for diagnostic test. Prev Vet Med 2000; 45: 23-41.
27. Chio B. Slopes of a receiver operating characteristic curve and likelihood ratio for a diagnostic test. Am J Epidemiol 1998; 148: 1127-32.
28. Detilleux J, Arendt J, Lomba F, Leroy P. Methods for estimating areas under receiver-operating characteristic curves: illustration with somatic-cell scores in subclinical intramammry infections. Prev Vet Med 1999; 41: 75-88.
29. Dodd LE, Pepe MS. Partial AUC estimation and regression. Biometrics 2003; 59: 614-23.
30. Walter SD. The partial area under the summary ROC curve. Stat Med 2005; 24: 2025-40.
31. Akobeng AK. Understanding diagnostic test 3: Receiver operating characteristic curves. Acta Paediatr 2007; 90: 644-7.
32. Perkins NJ, Schisterman EF. The inconsistency of optimal cut-points obtained using two criteria based on receiver operating characteristic curve. Am J Epidemiol 2006; 163: 670-5.
33. Fluss R, Faraggi D, Reiser B. Estimation of Youden index and its associated cutoff point. Biom J 2005; 47: 458-72.
34. Crichton N. Information point: receiver operating characteristic (ROC) curve. J Clin Nurs 2002; 11: 136.
35. Christensen E. Methodology of diagnostic tests in hepatology. Ann Hepatol 2009; 8: 177-83.
36. Obuchoswski NA. Receiver operating characteristic curves and their use in radiology. Radiology 2003; 229: 3-8.
37. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988; 44: 837-45.
38. Hanley JA, Hajian-Tilaki KO. Sampling variability of nonparametric estimates of the area under receiver operating characteristic curves: An update. Academ Radiol 1997; 4: 49-58.
39. Metz CE, Wang PL, Kronman HB. A new approach for testing the significance of differences between ROC curves from correlated data. In: Deconick F, Eds. Information processing in medical imaging. 1th ed. The Hague, Nijhoff, 1984; pp: 432-445.
40. Woster A, Carpenter C. Incorporation bias in studies of diagnostic tests: how to avoid being biased about bias. CJEM 2008; 10: 174-5.
41. Janese H, Pepe MS. Adjusting for covariates in studies of diagnostic, screening, or prognostic markers: An old concept in a new setting. Am J Epidemiol 2011; 168: 89-97.
42. Tosteson AN, Begg CB. A general regression methodology for ROC curve estimation. Med Decis Making 1988; 8: 207-15.
43. Hanley JA. The robustness of the 'binormal' assumptions used in fitting ROC curves. Med Decis Making 1988; 8: 197-203.
44. Hajian-Tilaki KO, Hanley JA, Joseph L, Collet JP. A comparison of parametric and nonparametric approaches to ROC analysis of quantitative diagnostic tests. Med Decis Making 1997; 17: 94-102.
45. Faraggi D, Reiser B. Estimation of the area under the ROC curve. Stat Med 2002; 21: 3093-106.
46. Hajian Tilaki KO, Hanley JA, Nassiri V. An extension of parametric ROC analysis for calculating diagnostic accuracy when the underlying distributions are mixture of Gausian. J App Stat 2011; 38: 2009-22.
47. Metz CE, Herman BA, Shen JH. Maximum-likelihood estimation of ROC curves from continuously-distributed data. Stat Med 1998; 17: 1033-53.
48. Hajian-Tilaki KO, Hanley JA, Joseph L, Collet JP. extention of receiver operating characteristic analysis to data concerning multiple signal detection taske. Acad Radiol 1977; 4: 222-9.
49. Hajian-Tilaki KO, Hanley JA. Comparison of three methods for estimation the standard error of the area under the curve in ROC analysis of quantitative data. Acad Radiol 2002; 9: 1278-85.
50. Lu Y, Dendukuri N, Schiller I, Joseph L. A Bayesian approach to simultaneously adjusting for verification and reference standard bias in diagnostic test studies. Stat Med 2010; 29: 2532-43.