Some practical issues of experimental design and data analysis in radiological ROC studies

Investigative Radiology

Volumn 24, Issue 3, 1989, Pages 234-245

  Metz, Charles E ^a  

^a UNIVERSITY OF CHICAGO   (United States)

Author keywords

Diagnostic radiology; Efficacy studies; Images; Observer performance; Quality; Radionuclide imaging; Receiver operating characteristic curves (ROC)

Indexed keywords

RADIOISOTOPE;

COMPUTER ANALYSIS; HUMAN; IMAGE ANALYSIS; METHODOLOGY; PRIORITY JOURNAL; PSYCHOLOGICAL ASPECT; RADIOGRAPHY; RECEIVER OPERATING CHARACTERISTIC; SCINTISCANNING; SHORT SURVEY;

RADIOLOGY; RESEARCH DESIGN; ROC CURVE; SUPPORT, U.S. GOV'T, NON-P.H.S.;

EID: 0024511244     PISSN: 00209996     EISSN: 15360210     Source Type: Journal    
DOI: 10.1097/00004424-198903000-00012     Document Type: Article

References (24)

1. Metz CE. ROC methodology in radiologic imaging. Invest Radiol 1986;21:720-733.
2. Metz CE. Basic principles of ROC analysis. Semin Nucl Med 1978;8:283-298.
3. Swets JA. ROC analysis applied to the evaluation of medical imaging techniques. Invest Radiol 1979;14:109-121.
4. Swets JA, Pickett RM. Evaluation of diagnostic systems: methods from signal detection theory. New York: Academic Press, 1982.
5. Begg CB, McNeil BJ. Assessment of radiologic tests: control of bias and other design considerations. Radiology 1988;167:565-569.
6. Ransohoff DF, Feinstein AR. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. N Engl J Med 1978; 299:926-930.
7. Dorfman DD, Alf E. Maximum likelihood estimation of parameters of signal detection theory and determination of confidence intervals-rating method data. J Math Psych 1969;6:487-496.
8. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982; 143:29-36.
9. Metz CE. Statistical analysis of ROC data in evaluating diagnostic performance. In: Herbert D. Myers R, eds. Multiple regression analysis: applications in the health sciences. New York: American Institute of Physics, 1986:365-384.
10. McNeil BJ, Hanley JA. Statistical approaches to the analysis of receiver operating characteristic (ROC) curves. Med Decis Making 1984;4:137-150.
11. Hanley JA, McNeil BJ. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology 1983;148:839-843.
12. Metz CE, Wang P-L, Kronman HB. A new approach for testing the significance of differences between ROC curves measured from correlated data. In: Deconinck F, ed. Information processing in medical imaging. The Hague: Nijhoff, 1984:432-445.
13. Kendall M, Stuart A. The advanced theory of statistics, vol. 3. ed. 3. New York, Hafner, 1976:182-243.
14. Link RF. Election night on television. In: Tanur JM, Mosteller F, Kruskal WH, Link RF, Pieters RS, Rising GR, eds. Statistics: a guide to the unknown. San Francisco: Holden-Day. 1972:137-145.
15. Neter J. How accountants save money by sampling. In: Tanur JM, Mosteller F, Kruskal WH, Link RF, Pieters RS, Rising GR, eds. Statistics: a guide to the unknown. San Francisco: Holden-Day 1972:203-211.
16. McCarthy PJ. The Consumer Price Index. In: Tanur JM, Mosteller F, Kruskal WH, Link RF, Pieters RS, Rising GR, eds. Statistics: a guide to the unknown. San Francisco: Holden-Day. 1972:266-275.
17. Swets JA. Form of empirical ROCs in discrimination and diagnostic tasks: implications for theory and measurement of performance. Psychol Bull 1986;99:181-198.
18. Green DM, Swets JA. Signal detection theory and psychophysics. Huntington, NY: Krieger, 1974:53-64.
19. Macmillan NA, Kaplan HL. Detection theory analysis of group data: estimating sensitivity from average hit and false alarm rates. Psychol Bull 1985;98:185-199.
20. Kendall M, Stuart A. The advanced theory of statistics, Vol. 2, ed. 4. New York: MacMillan, 1979:52-56.
21. Starr SJ, Metz CE, Lusted LB, Goodenough DJ. Visual detection and localization of radiographic images. Radiology 1975;116: 533-538.
22. Bunch PC, Hamilton JF, Sanderson GK, Simmons AH. A free response approach to the measurement and characterization of radiographic observer performance. ProcSPIE 1977;127:124-135.
23. Cochran WG. Some methods for strengthening the common X2 tests. Biometrika 1954;10:417-451.
24. Metz CE, Kronman HB. Statistical significance tests for binormal ROC curves. J Math Psych 1980;22:218-243.