Components-of-variance models and multiple-bootstrap experiments: An alternative method for random-effects, receiver operating characteristic analysis

Academic Radiology

Volumn 7, Issue 5, 2000, Pages 341-349

  Beiden, Sergey V ^a   Wagner, Robert F ^a   Campbell, Gregory ^a  

^a CENTER FOR DRUG EVALUATION AND RESEARCH   (United States)

Author keywords

Bootstrap; Components of variance; Random effects; Receiver operating characteristic (ROC) analysis

Indexed keywords

ARTICLE; MULTIVARIATE ANALYSIS; PRIORITY JOURNAL; RECEIVER OPERATING CHARACTERISTIC; STATISTICAL MODEL; VARIANCE;

EID: 0034028155     PISSN: 10766332     EISSN: None     Source Type: Journal    
DOI: 10.1016/S1076-6332(00)80008-2     Document Type: Article

References (26)

1. Metz CE. ROC methodology in radiologic imaging. Invest Radiol 1986; 21:720-733.
2. Metz CE. Some practical issues of experimental design and data analysis in radiological ROC studies. Invest Radiol 1989; 24:234-245.
3. Dorfman DD, Berbaum KS, Metz CE. Receiver operating characteristic rating analysis: generalization to the population of readers and patients with the jackknife method. Invest Radiol 1992; 27:723-731.
4. Gatsonis CA, Begg CB, Wieand S. Advances in statistical methods for diagnostic radiology: a symposium. Acad Radiol 1995; 2(suppl 1):S1-S3.
5. Beam CA. Random-effects models in the receiver operating characteristic curve-based assessment of the effectiveness of diagnostic imaging technology: concepts, approaches, and issues. Acad Radiol 1995; 2(suppl 1):S4-S13.
6. Gatsonis CA. Random-effects models for diagnostic accuracy data. Acad Radiol 1995; 2(suppl 1):S14-S21.
7. Obuchowski NA. Multireader, multimodality receiver operating characteristic curve studies: hypothesis testing and sample size estimation using an analysis of variance approach with dependent observations. Acad Radiol 1995; 2(suppl 1):S22-S29.
8. Toledano A, Gatsonis CA. Regression analysis of correlated receiver operating characteristic data. Acad Radiol 1995; 2(suppl 1):S30-S36.
9. Toledano A, Gatsonis C. Ordinal regression methodology for ROC curves derived from correlated data. Stat Med 1996; 15:1807-1826.
10. Dorfman DD, Berbaum KS, Lenth RV. Multireader, multicase receiver operating characteristic methodology: a bootstrap analysis. Acad Radiol 1995; 2:626-633.
11. Swets JA, Pickett RM. Evaluation of diagnostic systems: methods from signal detection theory. New York, NY: Academic Press, 1982.
12. Web address for University of Iowa MRMC software: ftp://perception .radiology.uiowa.edu/PUBLIC.
13. Web address for University of Chicago LABMRMC software: http://www .radiology.uchicago.edu/krl/toppage 11.htm#software.
14. Roe CA, Metz CE. Variance-component modeling in the analysis of receiver operating characteristic index estimates. Acad Radiol 1997; 4: 587-600.
15. Metz CE. Statistical analysis of ROC data in evaluating diagnostic performance. In: Herbert DE, Myers RH, eds. Multiple regression analysis: applications in the health sciences. New York, NY: American Institute of Physics/American Association of Physicists in Medicine, 1986; 365-384.
16. Jiang Y, Metz CE, Nishikawa RM. A receiver operating characteristic partial area index for highly sensitive diagnostic tests. Radiology 1996; 201:745-750.
17. Roe CA, Metz CE. Dorfman-Berbaum-Metz method for statistical analysis of multireader, multimodality receiver operating characteristic data: validation with computer simulation. Acad Radiol 1997; 4:298-303.
18. Efron B. The jackknife, the bootstrap and other resampling plans. Philadelphia, Pa: Society for Industrial and Applied Mathematics, 1982.
19. Efron B, Tibshirani RJ. An introduction to the bootstrap. New York, NY: Chapman & Hall, 1993. Monographs on statistics and applied probability 57.
20. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988; 44:837-845.
21. Franken EA Jr, Berbaum KS, Marley SM, et al. Evaluation of a digital workstation for interpreting neonatal examinations: a receiver operating characteristic study. Invest Radiol 1992; 27:732-737.
22. Jiang Y, Nishikawa RM, Schmidt RA, Metz CE, Giger ML, Doi K. Improving breast cancer diagnosis with computer-aided diagnosis. Acad Radiol 1999; 6:22-33.
23. Obuchowski NA. Sample size calculations in studies of test accuracy. Stat Methods Med Res 1998; 7:371-392.
24. Rockette HE, Campbell WL, Britton CA, Holbert JM, King JL, Gur D. Empiric assessment of parameters that affect the design of multireader receiver operating characteristic studies. Acad Radiol 1999; 6:723-729.
25. Dorfman DD, Berbaum KS, Lenth RV, Chen YF. Monte Carlo validation of a multireader method for receiver operating characteristic discrete rating data: split plot experimental design. Proc SPIE 1999; 3663:91-99.
26. Dorfman DD, Berbaum KS, Lenth RV, Chen YF, Donaghy BA. Monte Carlo validation of a multireader method for receiver operating characteristic discrete rating data: factorial experimental design. Acad Radiol 1998;5:591-602.