Estimation and comparison of CAD system performance in clinical settings

Academic Radiology

Volumn 12, Issue 6, 2005, Pages 687-694

  Bornefalk, Hans ^a  

^a ALBANOVA UNIVERSITY CENTER   (Sweden)

Author keywords

CAD; Confidence interval; Mammography; Operating point estimation; Performance evaluation; Sampling error

Indexed keywords

ANALYTIC METHOD; ANALYTICAL ERROR; ARTICLE; COMPUTER ASSISTED DIAGNOSIS; CONFIDENCE INTERVAL; EVALUATION; IMAGE ANALYSIS; INTERMETHOD COMPARISON; MAMMOGRAPHY; MATHEMATICAL MODEL; PRIORITY JOURNAL; PROBABILITY; SAMPLING; SENSITIVITY ANALYSIS; TRAINING;

ALGORITHMS; BREAST NEOPLASMS; FALSE POSITIVE REACTIONS; HUMANS; MAMMOGRAPHY; PATTERN RECOGNITION, AUTOMATED; RADIOGRAPHIC IMAGE INTERPRETATION, COMPUTER-ASSISTED; ROC CURVE; SENSITIVITY AND SPECIFICITY;

EID: 20344405978     PISSN: 10766332     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.acra.2005.02.005     Document Type: Article

References (22)

1. J.P. Egan, G.Z. Greenberg, A.I. Schulman Operating characteristics, signal detectability and the method of free response J Acoust Soc Am 33 1961 993 1007
2. P.C. Bunch, J.F. Hamilton, G.K. Sanderson, A.H. Simmons A free-response approach to the measurement and characterization of radiographic-observer performance J Appl Photogr Eng 4 1978 166 171
3. M.L. Giger Current issues in CAD for mammography K. Doi M.L. Giger R.M. Nishikawa R.A. Schmidt Digital Mammography '96 1996 Elsevier Science Philadelphia, Pa 53 59
4. C.E. Metz Evaluation of CAD methods K. Doi H. MacMahon M.L. Giger K.R. Hoffmann Computer-Aided Diagnosis in Medical Imaging 1999 Elsevier Science B.V Amsterdam 543 554
5. D.P. Chakraborty The FROC, AFROC and DFROC Variants of the ROC Analysis J. Beutel H.L. Kundel R.L. Van Matter Handbook of medical imaging. Vol. 1: Physics and psychophysics 2000 SPIE Press Bellingham, Wa 786 788
6. D.P. Chakraborty Maximum likelihood analysis of free-response receiver operating characteristic (FROC) data Med Phys 16 1989 561 568
7. D.P. Chakraborty, H.L. Winter Free-response methodology alternate analysis and a new observer-performance experiment Radiology 174 1990 873 881
8. D.P. Chakraborty Statistical power in observer-performance studies comparison of the receiver operating characteristic and free-response methods in tasks involving localization Acad Radiol 9 2002 147 156
9. D.P. Chakraborty, K. Berbaum Observer studies involving detection and localization modeling, analysis and validation Med Phys 31 2004 2313 2330
10. K.W. Bowyer Validation of Medical Image Analysis Techniques M. Sonka J.M. Fitzpatrick Handbook of Medical Imaging. Vol 2: Medical Image Processing and Analysis 2000 SPIE Press Bellingham, Wa 574
11. K. Wood, K.W. Bowyer Generating ROC Curves for Artificial Neural Networks IEEE Trans Med Imag 16 1997 329 337
12. M.A. Anastasio, M.A. Kupinski, R.M. Nishikawa Optimization and FROC analysis of rule-based detection schemes using a multiobjective approach IEEE Trans Medical Imaging 17 1998 1089 1093
13. C. Beam, P.M. Layde, D.C. Sullivan Variability in the interpretation of screening mammograms by US radiologists Arch Intern Med 156 1996 209 213
14. H. Bornefalk, A. Heronannson On the comparison of FROC curves in mammography CAD systems Med Phys 32 2005 412 417
15. G. te Brake, N. Karssemeijer Detection criteria for evaluation of computer diagnosis systems Proc IEEE 3 1996 1157 1158
16. R.M. Nishikawa, L.M. Yarusso Variations in measured performance of CAD schemes due to database composition and scoring protocol Proc SPIE 3338 1998 840 844
17. C.E. Metz Evaluation of digital mammography by ROC analysis K. Doi M.L. Giger R.M. Nishikawa R.A. Schmidt Digital mammography '96 1996 Elsevier Science B-V Amsterdam 61 68
18. R.G. Swensson Unified measurement of observer performance in detecting and localizing target objects on images Med Phys 23 1996 1709 1725
19. D.C. Edwards, M.A. Kupinski, C.E. Metz, R.M. Nishikawa Maximum likelihood fitting of FROC curves under an initial-detection-and-candidate-analysis model Med Phys 29 2002 2861 2870
20. H. Yoshida, M.A. Anastasio, R.H. Nagel, R.M. Nishikawa, K. Doi Computer-aided diagnosis for detection of clustered microcalcifications in mammograms Automated optimization of performance based on genetic algorithm K. Doi H. MacMahon M.L. Giger K.R. Hoffmann Computer-Aided Diagnosis in Medical Imaging 1999 Elsevier Science B.V Amsterdam 247 252
21. Ries LAG, Eisner MP, Kosary CL, et al (eds). SEER Cancer Statistics Review, 1975-2001, National Cancer Institute. Bethesda, MD, http://seer.cancer. gov/csr/1975_2001/, 2004.
22. D.P. Chakraborty Proposed solution to the FROC problem and an invitation to collaborate Proc SPIE Medical Imaging 5034 2003 204 212