Quasi-Continuous and Discrete Confidence Rating Scales for Observer Performance Studies. Effects on ROC Analysis1

Academic Radiology

Volumn 14, Issue 1, 2007, Pages 38-48

  Hadjiiski, Lubomir ^a   Chan, Heang Ping ^a   Sahiner, Berkman ^a   Helvie, Mark A ^a   Roubidoux, Marilyn A ^a  

^a UNIVERSITY OF MICHIGAN MEDICAL SCHOOL   (United States)

Author keywords

classification; Computer aided diagnosis; continuous and discrete confidence rating scales; mammography; ROC observer study

Indexed keywords

ARTICLE; BREAST TUMOR; COMPARATIVE STUDY; COMPUTER ASSISTED DIAGNOSIS; CONTROLLED STUDY; DATA ANALYSIS; DISEASE SEVERITY; FALSE POSITIVE RESULT; HUMAN; MAJOR CLINICAL STUDY; METHODOLOGY; PRIORITY JOURNAL; RADIODIAGNOSIS; RADIOLOGIST; RATING SCALE; RECEIVER OPERATING CHARACTERISTIC; SIMULATION; STATISTICAL SIGNIFICANCE;

BREAST NEOPLASMS; DIAGNOSIS, COMPUTER-ASSISTED; FALSE NEGATIVE REACTIONS; FALSE POSITIVE REACTIONS; HUMANS; LIKELIHOOD FUNCTIONS; MAMMOGRAPHY; OBSERVER VARIATION; ROC CURVE;

EID: 33845511122     PISSN: 10766332     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.acra.2006.09.048     Document Type: Article

References (15)

1. Rockette H.E., Gur D., and Metz C.E. The use of continuous and discrete confidence judgements in receiver operating characteristic studies of diagnostic imaging techniques. Invest Radiol 27 (1992) 169-172
2. King J.L., Britton C.A., Gur D., et al. On the validity of the continuous and discrete confidence rating scales in receiver operating characteristic studies. Invest Radiol 28 (1993) 962-963
3. Wagner R.F., Beiden S.V., and Metz C.E. Continuous versus categorical data for ROC analysis: Some quantitative considerations. Acad Radiol 8 (2001) 328-334
4. Berbaum K.S., Dorfman D.D., Franken E.A., et al. An empirical comparison of discrete ratings and subjective probability ratings. Acad Radiol 9 (2002) 756-763
5. Hadjiiski L.M., Chan H.P., Sahiner B., et al. ROC study: Effects of computer-aided diagnosis on radiologists' characterization of malignant and benign breast masses in temporal pairs of mammograms. Proc SPIE Med Imaging 5032 (2003) 94-101
6. Hadjiiski L.M., Chan H.P., Sahiner B., et al. Improvement of radiologists' characterization of malignant and benign breast masses in serial mammograms by computer-aided diagnosis: An ROC study. Radiology 233 (2004) 255-265
7. American College of Radiology. Breast imaging: Reporting and data system (BI-RADS) (1998), American College of Radiology, Reston, VA
8. Kobayashi T., Xu X.-W., MacMahon H., et al. Effect of a computer-aided diagnosis scheme on radiologists' performance in detection of lung nodules on radiographs. Radiology 199 (1996) 843-848
9. American College of Radiology Breast Imaging Reporting and Data System Atlas (BI-RADS Atlas) (2003), American College of Radiology, Reston, VA
10. Chan H.P., Goodsitt M.M., Helvie M.A., et al. ROC study of the effect of stereoscopic imaging on assessment of breast lesions. Med Physics 32 (2005) 1001-1009
11. Dorfman D.D., Berbaum K.S., and Metz C.E. ROC rating analysis: Generalization to the population of readers and cases with the jackknife method. Invest Radiol 27 (1992) 723-731
12. Jiang Y., Metz C.E., and Nishikawa R.M. A receiver operating characteristic partial area index for highly sensitive diagnostic tests. Radiology 201 (1996) 745-750
13. Metz C.E. Some practical issues of experimental design and data analysis in radiological ROC studies. Invest Radiol 24 (1989) 234-245
14. Dorfman D.D., Berbaum K.S., Metz C.E., et al. Proper receiver operating characteristic analysis: The bigamma model. Acad Radiol 4 (1997) 138-149
15. Metz C.E., and Pan X. "Proper" binormal ROC curves: Theory and maximum-likelihood estimation. J Math Psychol 43 (1999) 1-33