Using the Mean-to-Sigma Ratio as a Measure of the Improperness of Binormal ROC Curves

Academic Radiology

Volumn 18, Issue 2, 2011, Pages 143-154

  Hillis, Stephen L ^a,b   Berbaum, Kevin S ^c  

^a VETERANS AFFAIRS MEDICAL CENTER   (United States)

^b UNIVERSITY OF IOWA   (United States)

^c UNIVERSITY OF IOWA   (United States)

Author keywords

Binormal model; Diagnostic radiology; Mean to sigma ratio; Proper ROC model; Receiver operating characteristic curve

Indexed keywords

ARTICLE; CLINICAL ARTICLE; COMPUTER PROGRAM; CONTROLLED STUDY; HUMAN; MAGNITUDE ESTIMATION METHOD; PRIORITY JOURNAL; QUANTITATIVE ANALYSIS; RADIODIAGNOSIS; RECEIVER OPERATING CHARACTERISTIC;

DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, STATISTICAL; OBSERVER VARIATION; RADIOGRAPHY; ROC CURVE;

EID: 78651089969     PISSN: 10766332     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.acra.2010.09.002     Document Type: Article

References (25)

1. Dorfman D.D., Alf E. Maximum likelihood estimation of parameters of signal-detection theory and determination of confidence intervals: rating method data. J Mathemat Psychol 1969, 6:487-496.
2. Dorfman D.D. RSCORE II. Evaluation of diagnostic systems: methods from signal detection theory 1982, Academic Press, San Diego, Calif. J.A. Swets, R.M. Pickett (Eds.).
3. Dorfman D.D., Berbaum K.S. Degeneracy and discrete receiver operating characteristic rating data. Acad Radiol 1995, 2:907-915.
4. Metz C.E., Herman B.A., Shen J.H. Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data. Stat Med 1998, 17:1033-1053.
5. Hanley J.A. The robustness of the binormal assumptions used in fitting ROC curves. Med Decision Making 1988, 8:197-203.
6. Hanley J.A. The use of the 'binormal' model for parametric ROC analysis of quantitative diagnostic tests. Stat Med 1996, 15:1575-1585.
7. HajianTilaki K.O., Hanley J.A., Joseph L., et al. A comparison of parametric and nonparametric approaches to ROC analysis of quantitative diagnostic tests. Med Decision Making 1997, 17:94-102.
8. Swets J.A. Form of empirical ROCS in discrimination and diagnostic tasks: implications for theory and measurement of performance. Psychol Bull 1986, 99:181-198.
9. Pepe M. The statistical evaluation of medical tests for classification and prediction 2003, Oxford University Press, New York.
10. Egan J.P. Signal detection theory and ROC analysis 1975, Academic, New York.
11. Stein S.K. Calculus and analytic geometry 1987, McGraw-Hill, New York. 4th ed.
12. Pan X.C., Metz C.E. The ''proper'' binormal model: parametric receiver operating characteristic curve estimation with degenerate data. Acad Radiol 1997, 4:380-389.
13. Van Dyke CW, White RD, Obuchowski NA, et al. Cine MRI in the diagnosis of thoracic aortic dissection. 79th RSNA Meetings, Chicago, Ill., November 28-December 3, 1993.
14. Swets J.A., Tanner W.P., Birdsall T.G. Decision processes in perception. Psychol Rev 1961, 68:301-340.
15. Swets J.A. Indices of discrimination or diagnostic accuracy: their ROCs and implied models. Psychol Bull 1986, 99:100-117.
16. Green D.M., Swets J.A. Signal detection theory and psychophysics 1988, Peninsula Publishing, Los Altos, Calif, (Original work: Green DM, Swets JA. Signal detection theory and psychophysics. New York: Wiley, 1966.).
17. Dorfman D.D., Berbaum K.S., Metz C.E., et al. Proper receiver operating characteristic analysis: the bigamma model. Acad Radiol 1997, 4:138-149.
18. Dorfman D.D., Berbaum K.S., Brandser E.A. A contaminated binormal model for ROC data-Part I. Some interesting examples of binormal degeneracy. Acad Radiol 2000, 7:420-426.
19. Dorfman D.D., Berbaum K.S. A contaminated binormal model for ROC data-Part II. A formal model. Acad Radiol 2000, 7:427-437.
20. Dorfman D.D., Berbaum K.S. A contaminated binormal model for ROC data-Part III. Initial evaluation with detection ROC data. Acad Radiol 2000, 7:438-447.
21. Metz C.E., Pan X.C. "Proper" binormal ROC curves: theory and maximum-likelihood estimation. J Mathemat Psychol 1999, 43:1-33.
22. Hillis SL, Schartz KM, Pesce LL, et al. DBM MRMC procedure for SAS (computer software). Available for download from Accessed August 1, 2009. http://perception.radiology.uiowa.edu.
23. Berbaum KS, Schartz KM, Pesce LL, et al. DBM MRMC 2.2 (computer software). Available for download from Accessed August 1, 2009. http://perception.radiology.uiowa.edu.
24. Berbaum KS, Metz CE, Pesce LL, et al. DBM MRMC 2.1 User's Guide (software manual). Available for download from Accessed August 1, 2009. http://perception.radiology.uiowa.edu.
25. Stein S.K. Calculus in the first three dimensions 1967, McGraw-Hill, New York.