On the Convexity of ROC Curves Estimated from Radiological Test Results

Academic Radiology

Volumn 17, Issue 8, 2010, Pages

  Pesce, Lorenzo L ^a   Metz, Charles E ^a   Berbaum, Kevin S ^b  

^a UNIVERSITY OF CHICAGO MEDICAL CENTER   (United States)

^b UNIVERSITY OF IOWA   (United States)

Author keywords

Contaminated ROC model; Maximum likelihood estimation (MLE); Proper ROC curve; Receiver operating characteristic (ROC) analysis

Indexed keywords

ARTICLE; CURVE FITTING; IMAGE DISPLAY; MAXIMUM LIKELIHOOD METHOD; MEDICAL DECISION MAKING; OBSERVATION; PRIORITY JOURNAL; RADIOLOGIST; RECEIVER OPERATING CHARACTERISTIC; SAMPLING;

EID: 77954178516     PISSN: 10766332     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.acra.2010.04.001     Document Type: Article

References (37)

1. Pepe M.S. The statistical evaluation of medical tests for classification and prediction 2004, Oxford University Press, Oxford; New York.
2. Zhou X.-H., Obuchowski N.A., McClish D.K. Statistical methods in diagnostic medicine 2002, Wiley-Interscience, New York, NY.
3. Wagner R.F., Metz C.E., Campbell G. Assessment of medical imaging systems and computer aids: a tutorial review. Acad Radiol 2007, 14:723-748.
4. Swets J.A., Pickett R.M., Whitehead S.F., et al. Assessment of diagnostic technologies. Science 1979, 205:753-759.
5. Swets J.A., Pickett R.M. Evaluation of diagnostic systems: methods from signal detection theory 1982, Academic Press, New York, NY.
6. Dorfman D.D., Alf E. Maximum-likelihood estimation of parameters of signal-detection theory and determination of confidence intervals-rating method data. J Math Psychol 1969, 6:487-496.
7. Metz C.E., Kronman H.B. Statistical significance tests for binormal ROC curves. J Math Psychol 1980, 22:218-243.
8. Metz C.E., Wang P.-L., Kronman H.B. A new approach for testing the significance of differences between ROC curves measured from correlated data. Information processing in medical imaging 1984, 432. Nijhoff, The Hague, The Netherlands. F. Deconinck (Ed.).
9. Metz C.E., Herman B.A., Roe C.A. Statistical comparison of two ROC-curve estimates obtained from partially-paired datasets. Med Decis Making 1998, 18:110-121.
10. Henkelman R.M., Kay I., Bronskill M.J. Receiver operator characteristic (ROC) analysis without truth. Med Decis Making 1990, 10:24-29.
11. Fryback D.G., Thornbury J.R. The efficacy of diagnostic imaging. Med Decis Making 1991, 11:88-94.
12. Receiver Operating Characteristic Analysis in Medical Imaging (ICRU Report 79). J ICRU 2008, 8:1-62. International Commission on Radiation Units and Measurements.
13. Swets J.A. Indices of discrimination or diagnostic accuracy: their ROCs and implied models. Psychol Bull 1986, 99:100-117.
14. Swets J.A. Form of empirical ROCs in discrimination and diagnostic tasks: implications for theory and measurement of performance. Psychol Bull 1986, 99:181-198.
15. Hanley J.A. Receiver operating characteristic (ROC) methodology: the state of the art. Crit Rev Diagn Imaging 1989, 29:307-335.
16. Hanley J.A. The robustness of the ″ binormal″ assumptions used in fitting ROC curves. Med Decis Making 1988, 8:197-203.
17. Green D.M., Swets J.A. Signal detection theory and psychophysics 1966, Wiley, New York, NY.
18. Metz C.E., Pan X. " Proper" binormal ROC curves: theory and maximum-likelihood estimation. J Math Psychol 1999, 43:1-33.
19. Dorfman D.D., Berbaum K.S., Metz C.E., et al. Proper receiver operating characteristic analysis: the bigamma model. Acad Radiol 1997, 4:138-149.
20. Dorfman D.D., Berbaum K.S. A contaminated binormal model for ROC data. Part II: a formal model. Acad Radiol 2000, 7:427-437.
21. Pesce L.L., Metz C.E. Reliable and computationally efficient maximum-likelihood estimation of ″ proper″ binormal ROC curves. Acad Radiol 2007, 14:814-829.
22. Lloyd C.J. Estimation of a convex ROC curve. Stat Prob Lett 2002, 59:99-111.
23. Egan J.P. Signal detection theory and ROC analysis 1975, Academic Press, New York, NY.
24. Rosen K.H. Discrete mathematics and its applications 2007, McGraw-Hill Higher Education, Boston, Ma. 6th ed.
25. Breast imaging reporting and data system (BI-RADS) 2003, American College of Radiology, American College of Radiology, Reston, Va.
26. Papoulis A. Probability, random variables, and stochastic processes 1984, McGraw-Hill, New York, NY. 2nd ed.
27. Anderson W.F., Reiner A.S., Matsuno R.K., et al. Shifting breast cancer trends in the United States. J Clin Oncol 2007, 25:3923-3929.
28. Beiden S.V., Campbell G., Meier K.L., et al. On the problem of ROC analysis without truth: the EM algorithm and the information matrix. Proc SPIE 2000, 3981:126-134.
29. Lang S. Undergraduate analysis 1997, Springer, New York, NY. 2nd ed.
30. Metz C.E. Some practical issues of experimental design and data analysis in radiological ROC studies. Invest Radiol 1989, 24:234-245.
31. Birdsall TG. The theory of signal detectability: ROC curves and their character. Doctoral thesis. Ann Arbor: University of Michigan, 1966.
32. Swensson R.G., King J.L., Gur D. A constrained formulation for the receiver operating characteristic (ROC) curve based on probability summation. Med Phys 2001, 28:1597-1609.
33. Kendall M.G., Stuart A., Ord J.K., et al. Kendall's advanced theory of statistics 1994, Edward Arnold; Halsted Press, London, UK. 6th ed.
34. Pisano E.D., Gatsonis C., Hendrick E., et al. Diagnostic performance of digital versus film mammography for breast-cancer screening. N Engl J Med 2005, 353:1773-1783.
35. Ogilvie J., Creelman C.D. Maximum likelihood estimaton of receiver operating characteristic curve parameters. J Math Psychol 1968, 5:377-391.
36. Metz C.E. Statistical analysis of ROC data in evaluating diagnostic performance. Multiple regression analysis: applications in the health sciences 1986, 365-384. American Institute of Physics: American Association of Physicists in Medicine, New York, NY. D.E. Herbert, R.H. Myers (Eds.).
37. Metz C.E., Herman B.A., Shen J.H. Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data. Stat Med 1998, 17:1033-1053.