Assessing operating characteristics of CAD algorithms in the absence of a gold standard

Medical Physics

Volumn 37, Issue 4, 2010, Pages 1788-1795

  Roy Choudhury, Kingshuk ^a   Paik, David S ^b   Yi, Chin A ^c   Napel, Sandy ^b   Roos, Justus ^b   Rubin, Geoffrey D ^b  

^a UNIVERSITY COLLEGE CORK   (Ireland)

^b STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c Samsung Medical Center   (South Korea)

Author keywords

Computer aided detection; Latent class analysis; Operating characteristics; Reference panel

Indexed keywords

COMPUTER AIDED ANALYSIS; COMPUTERIZED TOMOGRAPHY; LIFE CYCLE; MAXIMUM LIKELIHOOD; STATISTICAL METHODS;

COMPUTED TOMOGRAPHY DATA; COMPUTER AIDED DETECTION; CONDITIONAL INDEPENDENCES; DIAGNOSTIC ACCURACY; DIAGNOSTIC PROTOCOLS; LATENT CLASS ANALYSIS; OPERATING CHARACTERISTICS; REFERENCE PANEL;

COMPUTER AIDED DIAGNOSIS;

EID: 77950586777     PISSN: 00942405     EISSN: None     Source Type: Journal    
DOI: 10.1118/1.3352687     Document Type: Article

References (25)

1. M. S. Brown, " Computer-aided lung nodule detection in CT: Results of large-scale observer test.," Acad. Radiol. 1076-6332 12 (6), 681-686 (2005). 10.1016/j.acra.2005.02.041 (Pubitemid 40791084)
2. J. J. Fenton, " Influence of computer-aided detection on performance of screening mammography.," N. Engl. J. Med. 0028-4793 356 (14), 1399-1409 (2007). 10.1056/NEJMoa066099 (Pubitemid 46556325)
3. N. Petrick, " CT colonography with computer-aided detection as a second reader: Observer performance study.," Radiology 0033-8419 246 (1), 148-156 (2008). 10.1148/radiol.2453062161 (Pubitemid 350305038)
4. C. S. White, " Lung nodule CAD software as a second reader: A multicenter study.," Acad. Radiol. 1076-6332 15 (3), 326-333 (2008). 10.1016/j.acra.2007.09.027 (Pubitemid 351232248)
5. F. Beyer, " Comparison of sensitivity and reading time for the use of computer-aided detection (CAD) of pulmonary nodules at MDCT as concurrent or second reader.," Eur. Radiol. 0938-7994 17 (11), 2941-2947 (2007). 10.1007/s00330-007-0667-1 (Pubitemid 47603991)
6. M. Das, " Small pulmonary nodules: Effect of two computer-aided detection systems on radiologist performance.," Radiology 0033-8419 241 (2), 564-571 (2006). 10.1148/radiol.2412051139 (Pubitemid 44632904)
7. G. D. Rubin, " Pulmonary nodules on multi-detector row CT scans: Performance comparison of radiologists and computer-aided detection.," Radiology 0033-8419 234 (1), 274-283 (2005). 10.1148/radiol.2341040589 (Pubitemid 39658396)
8. L. Saba, G. Caddeo, and G. Mallarini, " Computer-aided detection of pulmonary nodules in computed tomography: Analysis and review of the literature.," J. Comput. Assist. Tomogr. 0363-8715 31 (4), 611-619 (2007). 10.1097/rct.0b013e31802e29bf (Pubitemid 47457681)
9. L. E. Dodd, " Assessment methodologies and statistical issues for computer-aided diagnosis of lung nodules in computed tomography: Contemporary research topics relevant to the lung image database consortium.," Acad. Radiol. 1076-6332 11 (4), 462-475 (2004). 10.1016/S1076-6332(03)00814-6 (Pubitemid 38405374)
10. S. G. Armato III, " The Lung Image Database Consortium (LIDC): An evaluation of radiologist variability in the identification of lung nodules on CT scans.," Acad. Radiol. 1076-6332 14 (11), 1409-1421 (2007). 10.1016/j.acra.2007.07.008 (Pubitemid 47615519)
11. S. G. Armato III, " The Lung Image Database Consortium (LIDC): Ensuring the integrity of expert-defined truth'," Acad. Radiol. 1076-6332 14 (12), 1455-1463 (2007). 10.1016/j.acra.2007.08.006 (Pubitemid 350116642)
12. K. Roy Choudhury, Proceedings of the Annual Conference of Radiological Society of North America, Chicago, IL, 2008 (unpublished).
13. Y. Qu and A. Hadgu, " A model for evaluating sensitivity and specificity for correlated diagnostic tests in efficacy studies with an imperfect reference test.," J. Am. Stat. Assoc. 0162-1459 93, 920-928 (1998). 10.2307/2669830 (Pubitemid 128136886)
14. S. D. Walter and L. M. Irwig, " Estimation of test error rates, disease prevalence and relative risk from misclassified data: A review.," J. Clin. Epidemiol. 0895-4356 41 (9), 923-937 (1988). 10.1016/0895-4356(88) 90110-2
15. J. Zar, Biostatistical Analysis, 4th ed. (Prentice Hall, Englewood Cliffs, 2000).
16. C. Rao, Linear Statistical Inference and Its Application, 2nd ed. (Wiley, New York, 2002).
17. M. F. McNitt-Gray, " The Lung Image Database Consortium (LIDC) data collection process for nodule detection and annotation.," Acad. Radiol. 1076-6332 14 (12), 1464-1474 (2007). 10.1016/j.acra.2007.07.021 (Pubitemid 350116641)
18. D. S. Paik, " Surface normal overlap: A computer-aided detection algorithm with application to colonic polyps and lung nodules in helical CT.," IEEE Trans. Med. Imaging 0278-0062 23 (6), 661-675 (2004). 10.1109/TMI.2004.826362
19. M. S. Pepe and H. Janes, " Insights into latent class analysis of diagnostic test performance.," Biostatistics 8 (2), 474-484 (2007). 10.1093/biostatistics/kxl038 1465-4644 (Pubitemid 46569606)
20. B. Efron and R. Tibshirani, An Introduction to the Bootstrap (Chapman & Hall, London, 1993).
21. E. Edgington and P. Onghena, Randomization Tests, 4th ed. (CRC, Boca Raton, 2007).
22. C. A. Roe and C. E. Metz, " Dorfman-Berbaum-Metz method for statistical analysis of multireader, multimodality receiver operating characteristic data: Validation with computer simulation.," Acad. Radiol. 1076-6332 4 (4), 298-303 (1997). 10.1016/S1076-6332(97)80032-3
23. D. C. Edwards, " Maximum likelihood fitting of FROC curves under an initial-detection-and-candidate-analysis model.," Med. Phys. 0094-2405 29 (12), 2861-2870 (2002). 10.1118/1.1524631 (Pubitemid 36008482)
24. W. Feller, An Introduction to Probability Theory and Its Applications, 3rd ed. (Wiley, New York, 1968).
25. A. Dempster, N. Laird, and D. Rubin, " Maximum likelihood from incomplete data via the EM algorithm.," J. R. Stat. Soc. Ser. B (Methodol.) 0035-9246 39, 1-38 (1977).