Recent advances in observer performance methodology: Jackknife free-response ROC (JAFROC)

Radiation Protection Dosimetry

Volumn 114, Issue 1-3, 2005, Pages 26-31

  Chakraborty, Dev P ^a  

^a UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BINOMIAL DISTRIBUTION; CONTROLLED STUDY; DATA ANALYSIS; IMAGE ANALYSIS; INTERMETHOD COMPARISON; MAXIMUM LIKELIHOOD METHOD; OBSERVER VARIATION; QUANTITATIVE ANALYSIS; RADIOGRAPHY; RECEIVER OPERATING CHARACTERISTIC; SIGNAL NOISE RATIO; SIMULATION; STATISTICAL MODEL; VALIDATION PROCESS;

ALGORITHMS; HUMANS; LIKELIHOOD FUNCTIONS; MODELS, THEORETICAL; OBSERVER VARIATION; RADIOGRAPHIC IMAGE ENHANCEMENT; RADIOLOGY; ROC CURVE; SOFTWARE;

EID: 21244466397     PISSN: 01448420     EISSN: None     Source Type: Journal    
DOI: 10.1093/rpd/nch512     Document Type: Article

References (21)

1. Metz, C. E. Basic principles of ROC analysis. Semin. Nucl. Med. VIII(4), 283-298 (1978).
2. Metz, C. E. ROC methodology in radiologic imaging. Invest. Radiol. 21(9), 720-733 (1986).
3. Metz, C. E. Some practical issues of experimental design and data analysis in radiological ROC studies. Invest. Radiol. 24, 234-245 (1989).
4. Burgess, A. E. Comparison of receiver operating characteristic and forced choice observer performance measurement methods. Med. Phys. 22(5), 643-655 (1995).
5. Abbey, C. K. and Eckstein, M. P. Classification image analysis: estimation and statistical inference for two-alternative forced-choice experiments. J. Vision 2(1), 66-78 (2002).
6. Swensson, R. G. Unified measurement of observer performance in detecting and localizing target objects on images. Med. Phys. 23(10), 1709-1725 (1996).
7. Obuchowski, N. A., Lieber, M. L. and Powell, K. A. Data analysis for detection and localization of multiple abnormalities with application to mammography. Acad. Radiol. 7(7), 516-525 (2000).
8. Dorfman, D. D., Berbaum, K. S. and Metz, C. E. ROC characteristic rating analysis: generalization to the population of readers and patients with the jackknife method. Invest. Radiol. 27(9), 723-731 (1992).
9. Park, S., Kupinski, M. A., Clarkson, E. and Barrett, H. H. Ideal-observer performance under signal and background uncertainty. Inf. Process Med. Imaging 18, 342-353 (2003).
10. Chakraborty, D. P. Statistical power in observer performance studies: a comparison of the ROC and free-response methods in tasks involving localization. Acad. Radiol. 9(2), 147-156 (2002).
11. Chakraborty, D. P. Maximum likelihood analysis of free-response receiver operating characteristic (FROC) data. Med. Phys. 16(4), 561-568 (1989).
12. Chakraborty, D. P. and Winter, L. Free-response methodology: alternate analysis and a new observer-performance experiment. Radiology 174, 873-881 (1990).
13. Bunch, P. F., Hamilton, J. F., Sanderson, G. K. and Simmons, A. H. A free-response approach to the measurement and characterization of radiographic-observer performance. J. Appl. Photographic Eng. 4(4), 166-171 (1978).
14. Metz, C. E. (1996) Evaluation of digital mammography by ROC analysis. In Digital Mammography, Elsevier Science, 96, Dol, K., Geiger, M. L., Nishikawa, R. M. and Schmidt, R. A. Eds.
15. Chakraborty, D. P. Jackknife free-response ROC methodology. In: Proceedings of the SPIE, Medical Imaging 2004: Image Perception, Observer Performance and Technology Assessment, Chakraborty, D. P. and Eckstein, M. P., Eds., Vol. 5372 (2004).
16. Chakraborty, D. P. and Berbaum, K. S. Methodologies for observer studies involving detection and localization: modeling, analysis and validation. Med. Phys. 31, 2313-2330 (2004) (accepted for publication).
17. Roe, C. and Metz, C. E. Dorfman-Berbaum-Metz method for statistical analysis of multireader, multimodality receiver operating characteristic data: validation with computer simulation. Acad. Radiol. 4, 298-303 (1997).
18. Nodine, C. F. and Kundel, H. L. Using eye movements to study visual search and to improve tumor detection. Radiographics 7(6), 1241-1250 (1987).
19. Roe, C. and Metz, C. E. Variance-component modeling in the analysis of receiver operating characteristic index estimates. Acad. Radiol. 4(8), 587-600 (1997).
20. Dorfman, D. and Alf, E. J. Maximum likelihood estimation of parameters of signal-detection theory and determination of confidence intervals - rating method data. J. Math. Psychol. 6, 487-496 (1969).
21. Chakraborty, D. P. Proposed solution to the FROC problem and an invitation to collaborate. In: Proceedings of the SPIE, Medical Imaging: Image Perception, Observer Performance, and Technology Assessment, Chakraborty, D. P. and Krupinski, E. A., Eds., Vol. 5034 pp. 204-212 (2003).