Performance Assessments of Diagnostic Systems Under the FROC Paradigm. Experimental, Analytical, and Results Interpretation Issues

Academic Radiology

Volumn 15, Issue 10, 2008, Pages 1312-1315

  Gur, David ^a   Rockette, Howard E ^b  

^a UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF PITTSBURGH GRADUATE SCHOOL OF PUBLIC HEALTH   (United States)

Author keywords

Detection; diagnosis; FROC; observer performance; technology assessment

Indexed keywords

ARTICLE; BIOMEDICAL TECHNOLOGY ASSESSMENT; DIAGNOSTIC TEST; PRIORITY JOURNAL; RECEIVER OPERATING CHARACTERISTIC;

EID: 51249084582     PISSN: 10766332     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.acra.2008.05.006     Document Type: Note

References (18)

1. Wagner R.F., Metz C.E., and Campbell G. Assessment of medical imaging systems and computer aids: a tutorial review [review]. Acad Radiol 14 (2007) 723-748
2. Krupinski E.A., and Jiang Y. Anniversary paper: evaluation of medical imaging systems. Med Phys 35 (2008) 645-659
3. Hillis S.L., and Berbaum K.S. Power estimation for the Dorfman-Berbaum-Metz method. Acad Radiol 11 (2004) 1260-1273
4. Obuchowski N.A. Multireader receiver operating characteristic studies: a comparison of study designs. Acad Radiol 2 (1995) 709-716
5. Chakraborty D.P., and Berbaum K.S. Observer studies involving detection and localization: modeling, analysis, and validation. Med Phys 31 (2004) 2313-2330
6. Chakraborty D.P. A search model and figure of merit for observer data acquired according to the free-response paradigm. Phys Med Biol 51 (2006) 3449-3462
7. Zheng B., Chakraborty D.P., Rockette H.E., et al. A comparison of two data analyses from two observer performance studies using Jackknife ROC and JAFROC. Med Phys 32 (2005) 1031-1034
8. Edwards D.C., Kupinski M.A., Metz C.E., et al. Maximum likelihood fitting of FROC curves under an initial-detection-and-candidate-analysis model. Med Phys 29 (2002) 2861-2870
9. Yoon H.J., Zheng B., Sahiner B., et al. Evaluating computer-aided detection algorithms. Med Phys 34 (2007) 2024-2038
10. Bandos A.L., Rockette H.E., Song T., et al. Area under the free-response ROC curve (FROC) and a related summary index. Biometrics (2008) epub ahead of print
11. Samuelson FW, Petrick N. Comparing image detection algorithms using resampling. Biomedical imaging: macro to nano, 3rd IEEE International Symposium: Arlington, VA: April 6-9, 2006, 1312-1315.
12. Chakraborty D., Yoon H.J., and Mello-Thoms C. Spatial localization accuracy of radiologists in free-response studies: Inferring perceptual FROC curves from mark-rating data. Acad Radiol 14 (2007) 4-18
13. Chakraborty D.P. ROC curves predicted by a model of visual search. Phys Med Biol 51 (2006) 3463-3482
14. Song T., Bandos A.I., Rockette H.E., and Gur D. On comparing methods for discriminating between actually negative and actually positive subjects with FROC type data. Med Phys 35 (2008) 1547-1558
15. van Engeland S., and Karssemeijer N. Combining two mammographic projections in a computer aided mass detection method. Med Phys 34 (2007) 898-905
16. Wei J., Chan H.P., Sahiner B., et al. Dual system approach to computer-aided detection of breast masses on mammograms. Med Phys 33 (2006) 4157-4168
17. Wagner R.F., Beam C.A., and Beiden S.V. Reader variability in mammography and its implications for expected utility over the population of readers and cases. Med Decis Making 24 (2004) 561-572
18. Gur D, Bandos AI, Cohen CS, et al. The "laboratory" effect: comparing radiologists' performance and variability during clinical prospective and laboratory mammography interpretations. Radiology. In press.