New methodological tools for multiple-reader ROC studies

Radiology

Volumn 243, Issue 1, 2007, Pages 10-12

  Obuchowski, Nancy A ^a  

^a LERNER RESEARCH INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA ANALYSIS; DIAGNOSTIC ACCURACY; DIAGNOSTIC IMAGING; PRIORITY JOURNAL; RADIODIAGNOSIS; RADIOLOGIST; RECEIVER OPERATING CHARACTERISTIC; REVIEW; STATISTICAL ANALYSIS;

HUMANS; OBSERVER VARIATION; RADIOLOGY; ROC CURVE; SAMPLE SIZE;

EID: 34147210675     PISSN: 00338419     EISSN: None     Source Type: Journal    
DOI: 10.1148/radiol.2432060387     Document Type: Review

References (21)

1. Beam CA, Layde PM, Sullivan DC. Variability in the interpretation of screening mammograms by US radiologists: findings from a national sample. Arch Intern Med 1990;156:209-213.
2. Dorfman DD, Berbaum KS, Metz CE. Receiver operating characteristic rating analysis: generalization to the population of readers and patients with the jackknife method. Invest Radiol 1992;27:723-731.
3. Obuchowski NA. Multireader, multimodality receiver operating characteristic curve studies: hypothesis testing and sample size estimation using an analysis of variance approach with dependent observations. Acad Radiol 1995;2(suppl 1):S22-S29.
4. Toledano AY, Gatsonis C. Ordinal regression methodology for ROC curves derived from correlated data. Stat Med 1996;15:1807-1826.
5. Song HH. Analysis of correlated ROC areas in diagnostic testing. Biometrics 1997;53:370-382.
6. Beiden SV, Wagner RF, Campbell G. Components-of-variance models and multiple-bootstrap experiments: an alternative method for random-effects, receiver operating characteristic analysis. Acad Radiol 2000;7:341-349.
7. Ishwaran H, Gatsonis CA. A general class of hierarchical ordinal regression models with applications to correlated ROC analysis. Can J Stat 2000;28:731-750.
8. Obuchowski NA, Beiden SV, Berbaum KS, et al. Multi-reader multi-case ROC analysis: an empirical comparison of live methods. Acad Radiol 2004;11:980-995.
9. LABMRMC. Kurt Rossmann Laboratories for Image Research. University of Chicago Web site. http://xray.bsd.uchicago.edu/krl/KRL_ROC/software_index.htm. Accessed February 16, 2007.
10. Schartz KM, Hillis SL, Berbaum KS, and Dorfman DD. MRMC2.0. Medical Image Perception Laboratory. University of Iowa Web site. http://perception. radiology.uiowa.edu. Accessed February 16, 2007.
11. OBUMRM. Cleveland Clinic Foundation Web site. http://www.bio.ri.ccf.org/ html/obumrm.html. Accessed February 16, 2007.
12. Gonen M, Panageas KS, Larson SM. Statistical issues in analysis of diagnostic imaging experiments with multiple observations per patient. Radiology 2001;221:763-767.
13. Rutter CM. Bootstrap estimation of diagnostic accuracy with patient-clustered data. Acad Radiol 2000;7:413-419.
14. Beam CA. Analysis of clustered data in receiver operating characteristics studies. Stat Methods Med Res 1998;7:324-336.
15. Obuchowski NA. Nonparametric analysis of clustered ROC curve data. Biometrics 1997;53:567-578.
16. Obuchowski NA, Lieber ML, Powell KA. Data analysis for detection and localization of multiple abnormalities with application to mammography. Acad Radiol 2000;7:516-525.
17. Zou KH, O'Malley AJ. A Bayesian hierarchical non-linear regression model in receiver operating characteristic analysis of clustered continuous diagnostic data. Biom J 2005;47:417-427.
18. Efron B, Tibshirani RJ. An introduction to the bootstrap. In: Monographs on statistics and applied probability 57. New York, NY: Chapman & Hall, 1993.
19. Hillis SL, Berbaum KS. Power estimation for the Dorfman-Berbaum-Metz method. Acad Radiol 2004;11:1260-1273.
20. Obuchowski NA. Sample size tables for receiver operating characteristic studies. AJR Am J Roentgenol 2000;175:603-608.
21. Swets JA, Pickett RM. Evaluation of diagnostic systems: methods from signal detection theory. New York, NY: Academic Press, 1982.