Reducing the Number of Reader Interpretations in MRMC Studies

Academic Radiology

Volumn 16, Issue 2, 2009, Pages 209-217

  Obuchowski, Nancy A ^a  

^a LERNER RESEARCH INSTITUTE   (United States)

Author keywords

diagnostic accuracy; MRMC study; multireader study; Receiver operating characteristic curve; ROC analysis

Indexed keywords

ARTICLE; COMPUTER AIDED DESIGN; COMPUTER ASSISTED DIAGNOSIS; CONTROLLED STUDY; COST CONTROL; DIAGNOSTIC VALUE; GOLD STANDARD; INTERMETHOD COMPARISON; PRIORITY JOURNAL; RECEIVER OPERATING CHARACTERISTIC; SAMPLE SIZE;

ALGORITHMS; DATA INTERPRETATION, STATISTICAL; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; OBSERVER VARIATION; REPRODUCIBILITY OF RESULTS; ROC CURVE; SAMPLE SIZE; SENSITIVITY AND SPECIFICITY;

EID: 58049200259     PISSN: 10766332     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.acra.2008.05.014     Document Type: Article

References (18)

1. Wagner R.F., Metz C.E., and Campbell G. Assessment of medical imaging systems and computer aids: a tutorial review. Acad Radiol 14 (2007) 723-748
2. Obuchowski N.A. Multi-reader ROC Studies: A comparison of study designs. Acad Radiol 2 (1995) 709-716
3. Obuchowski N.A. Multi-reader multi-modality ROC studies: hypothesis testing and sample size estimation using an ANOVA approach with dependent observations. With rejoinder. Acad Radiol 2 (1995) S22-S29
4. Zhou X.H., Obuchowski N.A., and McClish D.L. Statistical methods in diagnostic medicine (2002), Wiley and Sons, Inc, New York
5. Hillis S.L., Obuchowski N.A., Schartz K.M., et al. A comparison of the Dorfman-Berbaum-Metz and Obuchowski-Rockette methods for receiver operating characteristic (ROC) data. Stat Med 24 (2005) 1579-1607
6. Hillis S.L., and Berbaum K.S. Power estimation for the Dorfman-Berbaum-Metz method. Acad Radiol 11 (2004) 1260-1273
7. Hillis S.L. A comparison of denominator degrees of freedom methods for multiple observer ROC analysis. Stat Med 26 (2007) 596-619
8. Obuchowski N.A., Beiden S.V., Berbaum K.S., et al. Multireader, multicase receiver operating characteristic analysis: an empirical comparison of five methods. Acad Radiol 11 (2004) 980-995
9. Rao B.R., Bi J., Fung G., Salganicoff M., Obuchowski N., and Naidich D.P. Lung CAD: A clinically approved, machine learning system for lung cancer detection (2007) 1033-1037 Proc 13th ACM SIGKDD Int Conf on Knowledge Discovery and Data Mining, San Jose, CA.
10. Rockette H.E., Campbell W.L., Britton C.A., et al. Empiric assessment of parameters that affect the design of multiobserver receiver operating characteristic studies. Acad Radiol 6 (1999) 723-729
11. Dorfman D.D., Berbaum K.S., and Metz C.E. Receiver operating characteristic rating analysis: generalization to the population of readers and patients with the jackknife method. Invest Radiol 27 (1992) 723-731
12. Toledano A.Y., and Gatsonis C. Ordinal regression methodology for ROC curves derived from correlated data. Stat Med 15 (1996) 1807-1826
13. Obuchowski N.A., and Rockette H.E. Hypothesis testing of the diagnostic accuracy for multiple diagnostic tests: an ANOVA approach with dependent observations. Commun Stat Simulation Comput 24 (1995) 285-308
14. Song H.H. Analysis of correlated ROC areas in diagnostic testing. Biometrics 53 (1997) 370-382
15. Beiden S.V., Wagner R.F., and Campbell G. Components-of-variance models and multiple-bootstrap experiments: an alternative method for random-effects, receiver operating characteristic analysis. Acad Radiol 7 (2000) 341-349
16. Ishwaran H., and Gatsonis C.A. A general class of hierarchical ordinal regression models with applications to correlated ROC analysis. Can J Stat 28 (2000) 731-750
17. Beiden S.V., Wagner R.F., Campbell G., et al. Components-of-variance models for random-effects ROC analysis: the case of unequal variance structure across modalities. Acad Radiol 8 (2001) 605-615
18. Beiden S.V., Wagner R.F., Campbell G., et al. Analysis of uncertainties in estimates of components of variance in multivariate ROC analysis. Acad Radiol 8 (2001) 616-622