How Many Readers and Cases does One Need to Conduct an ROC Study?

Academic Radiology

Volumn 18, Issue 2, 2011, Pages 127-128

  Chakraborty, Dev P ^a  

^a UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DIAGNOSTIC IMAGING; EDITORIAL; HUMAN; PILOT STUDY; PRIORITY JOURNAL; RADIOLOGIST; RECEIVER OPERATING CHARACTERISTIC; SAMPLE SIZE;

DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, STATISTICAL; OBSERVER VARIATION; RADIOGRAPHY; ROC CURVE; SAMPLE SIZE;

EID: 78651084793     PISSN: 10766332     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.acra.2010.12.003     Document Type: Editorial

References (11)

1. Hillis S.L., Obuchowski N.A., Berbaum K.S. Power estimation for multireader ROC methods: an updated and unified approach. Acad Radiol 2011, 18:129-142.
2. Ioannidis J.P.A. Why Most Published Research Findings Are False. PLoS Med 2005, 2:e124.
3. Dorfman D.D., Berbaum K.S., Metz C.E. ROC characteristic rating analysis: generalization to the population of readers and patients with the jackknife method. Invest Radiol 1992, 27:723-731.
4. Obuchowski N.A., Rockette H.E. Hypothesis testing of the diagnostic accuracy for multiple diagnostic tests: an ANOVA approach with dependent observations. Commun Stat Simulation Computation 1995, 24:285-308.
5. Hillis S.L., Obuchowski N.A., Schartz K.M., et al. A comparison of the Dorfman-Berbaum-Metz and Obuchowski-Rockette methods for receiver operating characteristic (ROC) data. Stat Med 2005, 24:1579-1607.
6. Obuchowski N. Determining sample size for roc studies: what is reasonable for the expected difference in tests in ROC areas?. Acad Radiol 2003, 10:1327-1328.
7. Kreaemer H.C., Mintz J., Noda A., et al. Caution regarding the use of pilot studies to guide power calculations for study proposals. Arch Gen Psychiatry 2006, 63:484-489.
8. Berbaum KS, Metz CE, Pesce LL, et al. DBM MRMC User's Guide, DBM-MRMC 2.1 Beta Version 2. Available at: and from Accessed December 28, 2009. http://perception.radiology.uiowa.edu.
9. Roe C.A., Metz C.E. Dorfman-Berbaum-Metz method for statistical analysis of multireader, multimodality receiver operating characteristic data: validation with computer simulation. Acad Radiol 1997, 4:298-303.
10. Dorfman D.D., Berbaum K.S., Lenth R.V., et al. Monte Carlo validation of a multireader method for receiver operating characteristic discrete rating data: factorial experimental design. Acad Radiol 1998, 5:591-602.
11. Hillis S.L., Berbaum K.S. Monte Carlo validation of the Dorfman-Berbaum-Metz method using normalized pseudovalues and less data-based model simplification. Acad Radiol 2005, 12:1534-1541.