Hypothesis Testing in Noninferiority and Equivalence MRMC ROC Studies

Academic Radiology

Volumn 19, Issue 9, 2012, Pages 1158-1165

  Chen, Weijie ^a   Petrick, Nicholas A ^a   Sahiner, Berkman ^a  

^a CENTER FOR DEVICES AND RADIOLOGICAL HEALTH   (United States)

Author keywords

Hypothesis testing; MRMC; Noninferiority; ROC

Indexed keywords

ARTICLE; BIOEQUIVALENCE; DIAGNOSTIC ACCURACY; DORFMAN BERBAUM METZ RECEIVER OPERATING CHARACTERISTIC; EFFECT SIZE; HUMAN; HYPOTHESIS; MULTIREADER MULTICASE RECEIVER OPERATING CHARACTERISTIC; OBUCHOWSKI ROCKETTE RECEIVER OPERATING CHARACTERISTIC; PRIORITY JOURNAL; RECEIVER OPERATING CHARACTERISTIC; SAMPLE SIZE; STATISTICAL ANALYSIS;

ANALYSIS OF VARIANCE; ANEURYSM, DISSECTING; AORTIC ANEURYSM; DIAGNOSTIC IMAGING; HUMANS; MAGNETIC RESONANCE IMAGING; MODELS, STATISTICAL; OBSERVER VARIATION; ROC CURVE;

EID: 84864796017     PISSN: 10766332     EISSN: 18784046     Source Type: Journal    
DOI: 10.1016/j.acra.2012.04.011     Document Type: Article

References (23)

1. Wagner R.F., Metz C.E., Campbell G. Assessment of medical imaging systems and computer aids: a tutorial review. Acad Radiol 2007, 14:723-748.
2. Dorfman D.D., Berbaum K.S., Metz C.E. Receiver operating characteristic rating analysis: generalization to the population of readers and patients with the jackknife method. Invest Radiol 1992, 27:723-731.
3. Hillis S.L., Berbaum K.S., Metz C.E. Recent developments in the Dorfman-Berbaum-Metz procedure for multireader ROC study analysis. Acad Radiol 2008, 15:647-661.
4. Obuchowski N.A., Rockette H.E. Hypothesis testing of the diagnostic accuracy for multiple diagnostic tests: an ANOVA approach with dependent observations. Commun Stat Simulation Comput 1995, 24:285-308.
5. Obuchowski NA. Multi-reader multi-modality ROC studies: hypothesis testing and sample size estimation using an ANOVA approach with dependent observations. With rejoinder. Acad Radiol 1995; 2(Suppl 1):S22-S29.
6. Hillis S.L., Obuchowski N.A., Schartz K.M., et al. A comparison of the Dorfman-Berbaum-Metz and Obuchowski-Rockette methods for receiver operating characteristic (ROC) data. Stat Med 2005, 24:1579-1607.
7. Hillis S.L. A comparison of denominator degrees of freedom methods for multiple observer ROC analysis. Stat Med 2007, 26:596-619.
8. Hills S.L., Berbaum K.S., Metz C.E. Recent developments in the Dorfman-Berbaum-Metz procedure for multireader ROC study analysis. Acad Radiol 2008, 15:647-661.
9. Hillis S.L., Obuchowski N.A., Berbaum K.S. Power estimation for multireader ROC methods: an updated and unified approach. Acad Radiol 2011, 18:129-142.
10. Blackwelder W.C. " Proving the null hypothesis" in clinical trials. Controlled Clin Trials 1982, 3:345-353.
11. Metz C.E. Quantification of failure to demonstrate statistical significance: the usefulness of confidence intervals. Invest Radiol 1993, 28:59-63.
12. Fisher R.A. The Design of Experiments 1935, Oliver and Boyd, London.
13. Liu J.-P., Ma M.-C., Wu C.-Y., et al. Tests of equivalence and non-inferiority for diagnostic accuracy based on the paired areas under ROC curves. Stat Med 2006, 25:1219-1238.
14. Li C.-R., Liao C.-T., Liu J.-P. A non-inferiority test for diagnostic accuracy based on the paired partial areas under ROC curves. Stat Med 2008, 27:1762-1776.
15. Lu Y., Jin H., Genant H.K. On the non-inferiority of a diagnostic test based on paired observations. Stat Med 2003, 22:3029-3044.
16. Lui K.J., Zhou X.H. Testing non-inferiority (and equivalence) between two diagnostic procedures in paired-sample ordinal data. Stat Med 2004, 23:545-559.
17. Van Dyke CW, White RD, Obuchowski NA, et al. Cine MRI in the diagnosis of thoracic aortic dissection. 79th RSNA Meetings, Chicago, IL; 1993.
18. Pan X.C., Metz C.E. The " proper" binormal model: parametric receiver operating characteristic curve estimation with degenerate data. Acad Radiol 1997, 4:380-389.
19. Metz C.E., Pan X.C. " Proper" binormal ROC curves: theory and maximum likelihood estimation. J Math Psychol 1999, 43:1-33.
20. Gennaro G., Toledano A., di Maggio C., et al. Digital breast tomosynthesis versus digital mammography: a clinical performance study. Eur Radiol 2010, 20:1545-1553.
21. Hanley J.A., McNeil B.J. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982, 143:29-36.
22. Gallas B.D., Brown D.G. Reader studies for validation of CAD systems. Neural Networks 2008, 21:387-397.
23. Obuchowski N.A. Reducing the number of reader interpretations in MRMC studies. Acad Radiol 2009, 16:209-217.