Jackknife free-response ROC methodology

Progress in Biomedical Optics and Imaging - Proceedings of SPIE

Volumn 5, Issue 26, 2004, Pages 144-153

  Chakraborty, Dev P ^a   Berbaum, Kevin S ^b  

^a UNIVERSITY OF PITTSBURGH   (United States)

^b UNIVERSITY OF IOWA   (United States)

Author keywords

DBM method; Free response ROC; Jackknife AFROC; Modality evaluation; MRMC; Statistical power

Indexed keywords

AFROC; DBM METHODS; FREE-RESPONSE ROC; JACKNIFE; MODALITY EVALUATION; MRMC; STATISTICAL POWER;

COMPUTER SIMULATION; DATA REDUCTION; EYE MOVEMENTS; MATHEMATICAL MODELS; MODAL ANALYSIS; STATISTICAL METHODS;

IMAGING SYSTEMS;

EID: 12144278767     PISSN: 16057422     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.533319     Document Type: Conference Paper

References (25)

1. Swensson, R.G., Unified Measurement of Observer Performance in Detecting and Localizing Target Objects on Images. Medical Physics, 1996. 23(10): p. 1709-1725.
2. Obuchowski, N.A., M.L. Lieber, and K.A. Powell, Data Analysis for Detection and Localization of Multiple Abnormalities with Application to Mammography. Acad Radiol, 2000. 7(7): p. 516-525.
3. Chakraborty, D.P., Maximum Likelihood Analysis of Free-Response Receiver Operating Characteristic (Froc) Data. Medical Physics, 1989. 16(4): p. 561-568.
4. Chakraborty, D.P. and L. Winter, Free-Response Methodology: Alternate Analysis and a New Observer-Performance Experiment. Radiology, 1990. 174: p. 873-881.
5. Metz, C.E., Evaluation of Digital Mammography by Roc Analysis, in Digital Mammography '96, K. Doi, M. Giger, R. Nishikawa, and R. Schmidt, Editors. 1996, Elsevier Science.
6. Chakraborty, D.P., Data Analysis for Detection and Localization of Multiple Abnormalities with Application to Mammography. [Letter; Comment]. Academic Radiology, 2000. 7(7): p. 553-4; discussion 554-6.
7. Krupinski, E.A., Visual Scanning Patterns of Radiologists Searching Mammograms. Academic Radiology, 1996. 3: p. 137-144.
8. Kundel, H.L. and P.S.J. La Follette, Visual Search Patterns and Experience with Radiological Images. Radiology, 1972. 103(3): p. 523-528.
9. Hillstrom, A., Repetition Effects in Visual Search. Perception and Psychophysics, 2000. 2: p. 800-817.
10. Hanley, J.A., The Robustness of the "Binormal" Assumptions Used in Fitting Roc Curves. Medical Decision Making, 1988. 8(3): p. 197-203.
11. Roe, C. and C.E. Metz, Dorfman-Berbaum-Metz Method for Statistical Analysis of Multireader, Multimodality Receiver Operating Characteristic Data: Validation with Computer Simulation. Academic Radiology, 1997. 4: p. 298-303.
12. Dorfman, D.D., K.S. Berbaum, R.V. Lenth, Y.-F. Chen, and B.A. Donaghy, Monte Carlo Validation of a Multireader Method for Receiver Operating Characteristic Discrete Rating Data: Factorial Experimental Design. Academic Radiology, 1998. 5: p. 591-602.
13. Dorfman, D.D., K.S. Berbaum, R.V. Lenth, and Y.-F. Chen. Monte Carlo Validation of a Multireader Method for Receiver Operating Characteristic Discrete Rating Data: Split Plot Experimental Design, in Proceedings of SPIE, Medical Imaging, Image Perception and Performance. 1999.
14. Hendrick, R.E., L. Bassett, M.A. Botsco, and e. al., Mammography Quality Control Manual. 4 ed. 1999: American College of Radiology, Committee on Quality Assurance in Mammography.
15. Beam, C.A. and H.L. Kundel. A Perceptual Segmentation Model for Froc Analysis. in Medical Image Perception Conference, MIPS X:. 2003. Durham, NC.
16. Chakraborty, D.P., Statistical Power in Observer Performance Studies: A Comparison of the Roc and Free-Response Methods in Tasks Involving Localization. Academic Radiology, 2002. 9(2): p. 147-156.
17. Chakraborty, D.P., Proposed Solution to the Froc Problem and an Invitation to Collaborate. SPIE Proc, Medical Imaging, 2003. 5034: p. 204-212.
18. Dorfman, D.D., K.S. Berbaum, and C.E. Metz, Roc Characteristic Rating Analysis: Generalization to the Population of Readers and Patients with the Jackknife Method. Investigative Radiology, 1992. 27(9): p. 723-731.
19. Press, W.H., B.P. Flannery, S.A. Teulosky, and W.T. Vetterling, Numerical Recipes in C: The Art of Scientific Computing. 1988, Cambridge: Cambridge University Press. 735.
20. Dorfman, D. and E.J. Alf, Maximum Likelihood Estimation of Parameters of Signal-Detection Theory and Determination of Confidence Intervals - Rating Method Data. Journal of Mathematical Psychology, 1969. 6: p. 487-496.
21. Burgess, A.E., Comparison of Receiver Operating Characteristic and Forced Choice Observer Performance Measurement Methods. Medical Physics, 1995. 22(5): p. 643-655.
22. Bunch, P.C., J.F. Hamilton, G.K. Sanderson, and A.H. Simmons, A Free-Response Approach to the Measurement and Characterization of Radiographic-Observer Performance. J of Appl Photographic Engineering, 1978. 4(4): p. 166-171.
23. Obuchowski, N.A., M.L. Lieber, and K.A. Powell, Data Analysis for Detection and Localization of Multiple Abnormalities with Application to Mammography. [See Comments]. Academic Radiology, 2000. 7(7): p. 516-25.
24. Rutter, C.M., Bootstrap Estimation of Diagnostic Accuracy with Patient-Clustered Data. Acad Radiol, 2000. 7(6): p. 413-9.
25. Zhou, X.-H., D.K. McClish, and N.A. Obuchowski, Statistical Methods in Diagnostic Medicine. 2002: Wiley-Interscience.