Evaluating computer-aided detection algorithms

Medical Physics

Volumn 34, Issue 6, 2007, Pages 2024-2038

  Jun Yoon, Hong ^a   Zheng, Bin ^a   Sahiner, Berkman ^b   Chakraborty, Dev P ^a  

^a UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF MICHIGAN MEDICAL SCHOOL   (United States)

Author keywords

CAD evaluation; Figure of merit; Free response; FROC curves; Imaging system optimization; Lesion localization; Maximum likelihood; Search model

Indexed keywords

CURVE FITTING; MAMMOGRAPHY; MAXIMUM LIKELIHOOD; MEDICAL IMAGING; SIGNAL DETECTION;

FIGURE OF MERITS; FREE RESPONSE; FROC CURVES; LESION LOCALIZATION; SEARCH MODELS; SYSTEM OPTIMIZATIONS;

COMPUTER AIDED DIAGNOSIS;

ARTICLE; COMPUTER ASSISTED RADIOGRAPHY; COMPUTER PROGRAM; DIAGNOSTIC IMAGING; FOLLOW UP; MAMMOGRAPHY; PRIORITY JOURNAL; RADIODIAGNOSIS; RADIOLOGIST;

EID: 34447314778     PISSN: 00942405     EISSN: None     Source Type: Journal    
DOI: 10.1118/1.2736289     Document Type: Article

References (55)

1. G. M. Brake, N. Karssemeijer, and J. H. Hendriks, " Automated detection of breast carcinomas not detected in a screening program., " Radiology 207, 465-471 (1998).
2. R. L. Birdwell, " Mammographic characteristics of 115 missed cancers later detected with screening mammography and the potential utility of computer-aided detection., " Radiology 219, 192-202 (2001).
3. C. S. White, " Primary carcinoma of the lung overlooked at CT: Analysis of findings in 14 patients., " Radiology 199, 109-115 (1996).
4. R. Kakinuma, " Detection failures in spiral CT screening for lung cancer: Analysis of CT findings., " Radiology 212, 61-66 (1999).
5. J. V. Forrest and P. J. Friedman, " Radiologic errors in patients with lung cancer., " West. J. Med. 134, 485-490 (1981).
6. J. R. Muhm, " Lung cancer detected during a screening program using four-month chest radiographs., " Radiology 148, 609-615 (1983).
7. J. G. Fletcher, " Optimization of CT colonography technique: Prospective trial in 180 patients., " Radiology 216, 704-711 (2000).
8. E. L. Thurfjell, K. A. Lernevall, and A. A. S. Taube, " Benefit of independent double reading in a population-based mammography screening program Radiology 1994; 191:241-244., " Radiology 191, 241-244 (1994).
9. D. Wormanns, " Detection of pulmonary nodules at multirow-detector CT: Effectiveness of double reading to improve sensitivity at standard-dose and low-dose chest CT., " Eur. Radiol. 15, 14-22 (2005).
10. D. Gur, " Changes in breast cancer detection and mammography recall rates after the introduction of a computer-aided detection system., " J. Natl. Cancer Inst. 96, 85-190 (2004).
11. L. A. Khoo, P. Taylor, and R. M. Given-Wilson, " Computer-aided detection in the United Kingdom National Breast Screening Programme: Prospective study., " Radiology 237, 444-449 (2005).
12. R. M. Summers, " Colonic polyps: Complementary role of computer-aided detection in CT Colonography., " Radiology 225, 391-399 (2002).
13. K. Awai, " Pulmonary nodules at chest CT: Effect of computer-aided diagnosis on radiologists' detection performance., " Radiology 230, 347-352 (2004).
14. C. E. Metz, " Receiver operating characteristic analysis: A tool for the quantitative evaluation of observer performance and imaging systems., " J. Am. Coll. Radiol. 3, 413-422 (2006).
15. P. C. Bunch, " A free-response approach to the measurement characterization of radiographic-observer performance., " J. Appl. Photogr. Eng. 4, 166-171 (1978).
16. D. P. Chakraborty, " Digital and conventional chest imaging: A modified ROC study of observer performance using simulated nodules., " Radiology 158, 35-39 (1986).
17. D. P. Chakraborty, " Maximum likelihood analysis of free-response receiver operating characteristic (FROC) data., " Med. Phys. 16, 561-568 (1989).
18. D. P. Chakraborty and K. S. Berbaum, " Observer studies involving detection and localization: Modeling, analysis and validation., " Med. Phys. 31, 2313-2330 (2004).
19. B. Sahiner, " Joint two-view information for computerized detection of microcalcifications on mammograms., " Med. Phys. 33, 2574-2585 (2006).
20. B. Zheng, " A multiview based computer aided detection scheme for breast masses., " Med. Phys. 33, 3135-3143 (2006).
21. R. Bellotti, " A completely automated CAD system for mass detection in a large mammographic database., " Med. Phys. 33, 3066-3075 (2006).
22. D. P. Chakraborty, " Statistical power in observer performance studies: A comparison of the ROC and free-response methods in tasks involving localization., " Acad. Radiol. 9, 147-156 (2002).
23. N. Petrick, " Breast cancer detection: Evaluation of a mass-detection algorithm for computer-aided diagnosis-Experience in 263 patients., " Radiology 224, 217-224 (2002).
24. M. Penedo, " Free-response receiver operating characteristic evaluation of lossy JPEG2000 and object-based set partitioning in hierarchical trees compression of digitized mammograms., " Radiology 237, 450-457 (2005).
25. H. Bornefalk, " Estimation and comparison of CAD system performance in clinical settings., " Acad. Radiol. 12, 687-694 (2005).
26. M. N. Gurcan, " Optimal neural network architecture selection: Improvement in computerized detection of microcalcifications., " Acad. Radiol. 9, 420-429 (2002).
27. H. Bornefalk and A. B. Hermansson, " On the comparison of FROC curves in mammography CAD systems., " Med. Phys. 32, 412-417 (2005).
28. F. W. Samuelson and N. Petrick, 2006 IEEE International Symposium on Biomedical Imaging: From Nano to Micro., Arlington, VA, 2006 (unpublished).
29. D. C. Edwards, " Maximum likelihood fitting of FROC curves under an initial-detection-and-candidate-analysis model., " Med. Phys. 29, 2861-2870 (2002).
30. B. Zheng, " A comparison of two data analyses from two observer performance studies using jackknife ROC and JAFROC., " Med. Phys. 32, 1031-1034 (2005).
31. B. Zheng, " Computer-aided detection in mammography: An assessment of performance on current and prior images., " Acad. Radiol. 9, 1245-1250 (2002).
32. H. L. Kundel and C. F. Nodine, " A visual concept shapes image perception., " Radiology 146, 363-368 (1983).
33. H. L. Kundel and C. F. Nodine, " Modeling visual search during mammogram viewing., " Proc. SPIE 5372, 110-115 (2004).
34. C. F. Nodine and H. L. Kundel, " Using eye movements to study visual search and to improve tumor detection., " Radiographics 7, 1241-1250 (1987).
35. D. D. Dorfman and E. Alf, " Maximum likelihood estimation of parameters of signal-detection theory and determination of confidence intervals-Rating method data., " J. Math. Psychol. 6, 487-496 (1969).
36. X. Pan and C. E. Metz, " The proper binormal model: Parametric receiver operating characteristic curve estimation with degenerate data., " Acad. Radiol. 4, 380-389 (1997).
37. D. D. Dorfman, " Proper receiving operating characteristic analysis: The Bigamma model., " Acad. Radiol. 4, 138-149 (1997).
38. C. E. Metz and X. Pan, " Proper binormal ROC curves: Theory and maximum-likelihood estimation., " J. Math. Psychol. 43, 1-33 (1999).
39. D. D. Dorfman and K. S. Berbaum, " A contaminated binormal model for ROC data: Part II. A formal model., " Acad. Radiol. 7, 427-437 (2000).
40. D. P. Chakraborty, " A search model and figure of merit for observer data acquired according to the free-response paradigm., " Phys. Med. Biol. 51, 3449-3462 (2006).
41. D. P. Chakraborty, " ROC curves predicted by a model of visual search., " Phys. Med. Biol. 51, 3463-3482 (2006).
42. R. J. Larsen and M. L. Marx, An Introduction to Mathematical Statistics and Its Applications, 3rd ed. (Prentice-Hall, Upper Saddle River, NJ, 2001).
43. A. Stuart, K. Ord, and S. Arnold, Kendall's Advance Theory of Statistics: Classical Inference and the Linear Model, 6th ed. (Oxford University Press, New York, 2004), Vol. 2A.
44. W. H. Press, Numerical Recipes in C: The Art of Scientific Computing (Cambridge University Press, Cambridge, 1988).
45. M. Galassi, GNU Scientific Library Reference Manual, 1.6 ed. (Network Theory, Bristol, 2005).
46. R. Yuan, P. Vos, and P. L. Cooperberg, " Computer-aided detection in screening CT for pulmonary nodules., " Am. J. Roentgenol. 186, 1280-1287 (2005).
47. C. E. Metz, B. A. Herman, and J. H. Shen, " Maximum-likelihood estimation of ROC curves from continuously-distributed data., " Stat. Med. 17, 1033 (1998).
48. D. P. Chakraborty, SPIE Medical Imaging, Image Perception, Observer Performance, and Technology Assessment, San Diego, 2007 (unpublished).
49. D. P. Chakraborty, H. J. Yoon, and C. Mello-Thoms, " Spatial localization accuracy of radiologists in free-response studies: Inferring perceptual FROC curves from mark-rating data., " Acad. Radiol. 14, 4-18 (2007).
50. J. A. Hanley, " The robustness of the 'binormal' assumptions used in fitting ROC curves., " Med. Decis Making 8, 197-203 (1988).
51. B. Efron, The Jackknife, the Bootstrap and Other Resampling Plans (Capital City, Montpelier, 1982).
52. D. D. Dorfman, K. S. Berbaum, and C. E. Metz, " ROC characteristic rating analysis: Generalization to the population of readers and patients with the jackknife method., " Invest. Radiol. 27, 723-731 (1992).
53. S. V. Beiden, R. F. Wagner, and G. Campbell, " Components-of variance models and multiple-bootstrap experiments: An alternative method for random-effects, receiver operating characteristic analysis., " Acad. Radiol. 7, 341-349 (2000).
54. E. L. Lehmann and G. Casella, Theory of Point Estimation, 2nd ed. (Springer, New York, 1998).
55. S. Brandt, Data Analysis: Statistical and Computational Methods for Scientists and Engineers, 3rd ed. (Springer, New York, 1999).