Fundamentals of clinical research for radiologists

American Journal of Roentgenology

Volumn 184, Issue 2, 2005, Pages 364-372

  Obuchowski, Nancy A ^a   Blackmore, C Craig ^b   Karlik, Steven ^b   Reinhold, Caroline ^b  

^a LERNER RESEARCH INSTITUTE   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CANCER DIAGNOSIS; CANCER STAGING; COMPUTER AIDED DESIGN; COMPUTER ASSISTED RADIOGRAPHY; COMPUTER PROGRAM; DIAGNOSTIC ACCURACY; HUMAN; LUNG HYPOPLASIA; MAMMOGRAPHY; NUCLEAR MAGNETIC RESONANCE IMAGING; PRIORITY JOURNAL; PROBABILITY; RECEIVER OPERATING CHARACTERISTIC; RECTUM CANCER; SCREENING; SENSITIVITY AND SPECIFICITY; STATISTICAL ANALYSIS; RADIOLOGY; ROC CURVE;

HUMANS; RADIOLOGY; ROC CURVE;

EID: 15944429010     PISSN: 0361803X     EISSN: None     Source Type: Journal    
DOI: 10.2214/ajr.184.2.01840364     Document Type: Article

References (52)

1. Weinstein S, Obuchowski NA, Lieber ML. Clinical evaluation of diagnostic tests. AJR 2005;184:14-19
2. Zhou XH, Obuchowski NA, McClish DK. Statistical methods in diagnostic medicine. New York, NY: Wiley-Interscience, 2002
3. Metz CE. Some practical issues of experimental design and data analysis in radiologic ROC studies. Invest Radiol 1989;24:234-245
4. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982;143:29-36
5. McClish DK. Analyzing a portion of the ROC curve. Med Decis Making 1989;9:190-195
6. Hilden J. The area under the ROC curve and its competitors. Med Decis Making 1991;11:95-101
7. Hilden J. Prevalence-free utility-respecting summary indices of diagnostic power do not exist. Stat Med 2000;19:431-440
8. Wagner RF, Beiden SV, Metz CE. Continuous versus categorical data for ROC analysis: some quantitative considerations. Acad Radiol 2001;8:328-334
9. Beam CA, Baker ME, Paine SS, Sostman HD, Sullivan DC. Answering unanswered questions: proposal for a shared resource in clinical diagnostic radiology research. Radiology 1992;183:619-620
10. Obuchowski NA, Beiden SV, Berbaum KS, et al. Multireader multicase receiver operating characteristic analysis: an empirical comparison of five methods. Acad Radiol 2004;11:980-995
11. Obuchowski NA. Multi-reader ROC studies: a comparison of study designs. Acad Radiol 1995;2:709-716
12. Roe CA, Metz CE. Variance-component modeling in the analysis of receiver operating characteristic index estimates. Acad Radiol 1997;4:587-600
13. Dorfman DD, Berbaum KS, Metz CE. Receiver operating characteristic rating analysis: generalization to the population of readers and patients with the jackknife method. Invest Radiol 1992;27:723-731
14. Obuchowski NA. Multi-reader multi-modality ROC studies: hypothesis testing and sample size estimation using an ANOVA approach with dependent observations, with rejoinder. Acad Radiol 1995;2:S22-S29
15. Toledano AY, Gatsonis C. Ordinal regression methodology for ROC curves derived from correlated data. Stat Med 1996;15:1807-1826
16. Song HH. Analysis of correlated ROC areas in diagnostic testing. Biometrics 1997;53:370-382
17. Beiden SV, Wagner RF, Campbell G. Components-of-variance models and multiple-bootstrap experiments: an alternative method for random-effects, receiver operating characteristic analysis. Acad Radiol 2000;7:341-349
18. Beiden SV, Wagner RF, Campbell G, Metz CE, Jiang Y. Components-of- variance models for random-effects ROC analysis: the case of unequal variance structure across modalities. Acad Radiol 2001;8:605-615
19. Beiden SV, Wagner RF, Campbell G, Chan HP. Analysis of uncertainties in estimates of components of variance in multivariate ROC analysis. Acad Radiol 2001;8:616-622
20. Ishwaran H, Gatsonis CA. A general class of hierarchical ordinal regression models with applications to correlated ROC analysis. Can J Stat 2000;28:731-750
21. Beam CA, Layde PM, Sullivan DC. Variability in the interpretation of screening mammograms by US radiologists: findings from a national sample. Arch Intern Med 1996;156:209-213
22. Kim MJ, Lim JS, Oh YT, et al. Preoperative MRI of rectal cancer with and without rectal water filling: an intraindividual comparison. AJR 2004;182:1469-1476
23. Osada H, Kaku K, Masuda K, Iitsuka Y, Seki K, Sekiya S. Quantitative and qualitative evaluations of fetal lung with MR imaging. Radiology 2004;231:887-892
24. Pepe MS, Thompson ML. Combining diagnostic test results to increase accuracy. Biostatistics 2000;1:123-140
25. Zheng B, Leader JK, Abrams G, et al. Computer-aided detection schemes: the effect of limiting the number of cued regions in each case. AJR 2004;182:579-583
26. Chakraborty DP, Winter LHL. Free-response methodology: alternative analysis and a new observer-performance experiment. Radiology 1990;174:873-881
27. Chakraborty DP. Maximum likelihood analysis of free-response receiver operating characteristic (FROC) data. Med Phys 1989;16:561-568
28. Swensson RG. Unified measurement of observer performance in detecting and localizing target objects on images. Med Phys 1996;23:1709-1725
29. Obuchowski NA, Lieber ML, Powell KA. Data analysis for detection and localization of multiple abnormalities with application to mammography. Acad Radiol 2000;7:516-525
30. Dorfman DD, Alf E. Maximum likelihood estimation of parameters of signal detection theory: a direct solution. Psychometrika 1968;33:117-124
31. Dorfman DD, Alf E. Maximum-likelihood estimation of parameters of signal detection theory and determination of confidence intervals: rating method data. J Math Psychol 1969;6:487-496
32. ROCKIT and LABMRMC. Available at: xray.bsd.uchicago.edu/krl/KRL_ROC software_index.htm. Accessed December 13, 2004
33. Swets JA. Empirical RO. Cs in discrimination and diagnostic tasks: implications for theory and measurement of performance. Psychol Bull 1986;99:181-198
34. Hanley JA. The robustness of the binormal assumption used in fitting ROC curves. Med Decis Making 1988;8:197-203
35. Goddard MJ, Hinberg I. Receiver operating characteristic (ROC) curves and non-normal data: an empirical study. Stat Med 1990;9:325-337
36. Zou KH, Tempany CM, Fielding JR, Silverman SG. Original smooth receiver operating characteristic curve estimation from continuous data: statistical methods for analyzing the predictive value of spiral CT of ureteral stones. Acad Radiol 1998;5:680-687
37. Pepe MS. A regression modeling framework for receiver operating characteristic curves in medical diagnostic testing. Biometrika 1997;84:595-608
38. Pepe MS. An interpretation for the ROC curve using GLM procedures. Biometrics 2000;56:352-359
39. Pepe MS. The statistical evaluation of medical tests for classification and prediction. New York, NY: Oxford University Press, 2003
40. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988;44:837-844
41. ROC analysis. Available at: www.bio.ri.ccf.org/Research/ROC/index.html. Accessed December 13, 2004
42. OBUMRM. Available at: www.bio.ri.ccf.org/OBUMRM/OBUMRM.html. Accessed December 13, 2004
43. The University of Iowa Department of Radiology: The Medical Image Perception Laboratory. MRMC 2.0. Available at: perception.radiology.uiowa.edu. Accessed December 13, 2004
44. Hillis SL, Berbaum KS. Power estimation for the Dorfman-Berbaum-Metz method. Acad Radiol (in press)
45. Obuchowski NA. Sample size tables for receiver operating characteristic studies. AJR 2000;175:603-608
46. Metz CE. Basic principles of ROC analysis. Semin Nucl Med 1978;8:283-298
47. Zweig MH, Campbell G. Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem 1993;39:561-577
48. Somoza E, Mossman D. "Biological markers" and psychiatric diagnosis: risk-benefit balancing using ROC analysis. Biol Psychiatry 1991;29:811-826
49. Greenhouse SW, Mantel N. The evaluation of diagnostic tests. Biometrics 1950;6:399-412
50. Linnet K. Comparison of quantitative diagnostic tests: type I error, power, and sample size. Stat Med 1987;6:147-158
51. Stephan C, Wesseling S, Schink T, Jung K. Comparison of eight computer programs for receiver-operating characteristic analysis. Clin Chem 2003;49:433-439
52. Ma G, Hall WJ. Confidence bands for receiver operating characteristic curves. Med Decis Making 1993;13:191-197