Receiver operating characteristic (ROC) analysis: Basic principles and applications in radiology

European Journal of Radiology

Volumn 27, Issue 2, 1998, Pages 88-94

  Van Erkel, Arian R ^a   Pattynama, Peter M Th ^a  

^a LEIDEN UNIVERSITY MEDICAL CENTER   (Netherlands)

Author keywords

Medical decision making; Radiology; ROC analysis; Sensitivity; Specificity

Indexed keywords

DECISION MAKING; MEDICAL APPLICATIONS;

RECEIVER OPERATING CHARACTERISTIC (ROC) ANALYSIS;

RADIOLOGY;

DIAGNOSTIC ACCURACY; PRIORITY JOURNAL; RADIODIAGNOSIS; RADIOLOGY; RECEIVER OPERATING CHARACTERISTIC; REVIEW;

EID: 0032077905     PISSN: 0720048X     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0720-048X(97)00157-5     Document Type: Article

References (25)

1. Metz CE ROC methodology in radiologic imaging. Invest Radiol. 21:1986;720-733.
2. Dwyer AJ In pursuit of a piece of the ROC. Radiology. 202:1997;621-625.
3. Hanley JA Receiver operating characteristic analysis (ROC) methodology: The state of the art. Crit Rev Diagn Imaging. 29:1989;307-335.
4. Swets JA ROC analysis applied to the evaluation of medical imaging techniques. Invest Radiol. 14:1979;109-121.
5. Lusted LB Logical analysis in roentgen diagnosis. Radiology. 74:1960;178-193.
6. Lusted LB Signal detectability and medical decision making. Science. 171:1971;1217-1219.
7. Van Erkel AR, Van Gils APG, Lequin M, Kruitwagen C, Bloem JL, Falke THM CT and MR distinction of adenomas and nonadenomas of the adrenal gland. J Comput Assist Tomogr. 18:1994;432-438.
8. Metz CE Some practical issues of experimental design and data analysis in radiological ROC studies. Invest Radiol. 24:1989;234-245.
9. Rockette HE, Gur D, Metz CE The use of continuous and discrete judgements in receiver operating characteristic studies of diagnostic imaging techniques. Invest Radiol. 27:1992;169-172.
10. Metz CE, Kronman HB. Computer programs ROCFIT, LABROC1, CORROC2, CLABROC, INDROC, ROCPWRPC. Available from CE Metz, Department of Radiology, University of Chicago, Chicago, IL.
11. Hanley JA The robustness of the 'binormal' assumptions used in fitting ROC curves. Med Decis Mak. 8:1988;197-203.
12. Ransohoff DF, Feinstein AR Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. New Engl J Med. 299:1978;829-830.
13. Metz CE, Wang PL, Kronman HB A new approach for testing the significance of differences between ROC curves measured from correlated data. Deconinck F Information Processing in Medical Imaging. 1984;432-445 Nijhoff, The Hague.
14. Hanley JA, McNeil BJ The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 143:1982;29-36.
15. Hanley JA, McNeil BJ A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology. 148:1983;839-843.
16. Vida S A computer program for non-parametric receiver operating characteristic analysis. Comput Methods Programs Biomed. 40:1993;95-101.
17. DeLong ER, DeLong DM, Clarke Pearson DL Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach. Biometrics. 44:1988;837-845.
18. Swaving M, Van Houwelingen H, Ottes FP, Steerneman T Statistical comparison of ROC curves from multiple readers. Med Decis Mak. 16:1996;143-152.
19. Centor RM Signal detectability. The use of ROC curves and their analyses. Med Decis Mak. 11:1991;102-106.
20. Mann FA, Hildebolt CE, Wilson AJ Statistical analysis with receiver operating characteristic curves. Radiology. 184:1992;37-38.
21. McClish D Analyzing a portion of the ROC curve. Med Decis Mak. 9:1989;190-195.
22. Jiang Y, Metz CE, Nishikawa RM A receiver operating characteristic partial area index for highly sensitive diagnostic tests. Radiology. 201:1996;745-750.
23. Hunink MGM, Polak JF, Barlan MM, O'Leary DH Detection and quantification of carotid artery stenosis: Efficacy of various Doppler velocity parameters. Am J Radiol. 160:1993;619-625.
24. Halpern EJ, Albert M, Krieger AM, Metz CE, Maidment AD Comparison of receiver operating characteristic curves on the basis of optimal operating points. Acad Radiol. 3:1996;245-253.
25. DeNeef P, Kent DL Using treatment-tradeoff preferences to select diagnostic strategies. Linking the ROC curve to threshold analysis. Med Decis Mak. 13:1993;126-132.