Forming a reference standard from LIDC data: Impact of reader agreement on reported CAD performance

Progress in Biomedical Optics and Imaging - Proceedings of SPIE

Volumn 6514, Issue PART 2, 2007, Pages

  Ochs, Robert ^a,b   Kim, Hyun J ^a,b   Angel, Erin ^a,b   Panknin, Christoph ^b,c   McNitt Gray, Michael ^a,b   Brown, Matthew ^a,b  

^a Department of Biomedical Physics ^*  (Germany)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c SIEMENS AG   (Germany)

Author keywords

Computer aided detection (CAD); Evaluation and validation; LIDC; Nodule detection; Reference standard; X ray CT

Indexed keywords

COMPUTER-AIDED DETECTION (CAD); LUNG IMAGE DATABASE CONSORTIUM (LIDC); NODULE DETECTION; REFERENCE STANDARDS;

COMPUTER AIDED DIAGNOSIS; COMPUTERIZED TOMOGRAPHY; DATABASE SYSTEMS; RADIOLOGY; RESPIRATORY SYSTEM; X RAY OPTICS;

MEDICAL IMAGING;

EID: 35248873514     PISSN: 16057422     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.707916     Document Type: Conference Paper

References (10)

1. S.G. Armato III, G. McLennan, M.F. McNitt-Gray, C. R. Meyer, D.Y. Yankelevitz, D.R. Aberle, C.I. Henschke, E.A. Hoffman, E.A. Kazerooni, H. MacMahon, A.P. Reeves, B.Y. Croft, L.P. Clarke. "Lung Image Database Consortium: developing a resource for the medical imaging research community." Radiology 232, 739-748 (2004).
2. S. G. Armato III, R. Y. Roberts, G. McLennan, M. F. McNitt-Gray, D. F. Yankelevitz, E. A. Kazerooni, E. J. R. van Beek, H. MacMahon, D. R. Aberle, C. R. Meyer, A. P. Reeves, C. I. Henschke, E. A. Hoffman, B. Y. Croft, and L. P. Clarke. "The Lung Image Database Consortium (LIDC): a quality assurance model for the collection of expert-defined "truth" in lung-nodule-based image analysis studies." Proc. SPIE 6514-81 (2007).
3. M. F. McNitt-Gray, S. G. Armato III, C. R. Meyer, A. P. Reeves, G. McLennan, R. Pais, J. Freymann, M. S. Brown, R. M. Engelmann, P. H. Bland, G. E. Laderach, C. Piker, J. Guo, D. P. Qing, D. F. Yankelevitz, D. R. Aberle, E. J. R. Van Beek, H. MacMahon, E. A. Kazerooni, B. Y. Croft, and L. Clarke. "The Lung Image Database Consortium (LIDC) data collection process for nodule detection and annotation" Proc. SPIE 6514-19 (2007).
4. L.E. Dodd, R.F. Wagner, S.G. Armato III, M.F. McNitt-Gray, S. Beiden, H.P. Chan, D. Gur, G. McLennan, C.E. Metz, N. Petrick, B. Sahiner, J. Sayre; Lung Image Database Consortium Research Group. "Assessment methodologies and statistical issues for computer-aided diagnosis of lung nodules in computed tomography: contemporary research topics relevant to the lung image database consortium." Acad Radiol. Review. 11(4), 462-75 (2004).
5. S.G. Armato III, R. Roberts, D. Aberle, E. Kazerooni, E. Van Beek, and D. Yankelevitz. "The Lung Image Database Consortium (LIDC): Radiologist Agreement in the Identification of Lung Nodules in CT Scans." RSNA SSK04-07 (2006).
6. C.R. Meyer, T.D. Johnson, G. McLennan, D.R. Aberle, E.A. Kazerooni, H. MacMahon, B.F. Mullan, D.F. Yankelevitz, E.J. van Beek, S.G. Armato III, M.F. McNitt-Gray, A.P. Reeves, D. Gur, C.I. Henschke, E.A. Hoffman, P.H. Bland, G. Laderach, R. Pais, D. Qing, C. Piker, J. Guo, A. Starkey, D. Max, B. Y. Croft, L.P. Clarke. "Evaluation of Lung MDCT Nodule Annotation Across Radiologists and Methods." Acad Radiol. 13(10), 1254-65 (2006).
7. R.M. Nishikawa, L.M. Yarusso. "Variations in measured performance of CAD schemes due to database composition and scoring protocol." Proc. SPIE 3338, 840 (1998).
8. National Cancer Imaging Archive, https://imaging.nci.nih.gov/ncia/ LIDC Collection as downloaded August 14, 2006.
9. M.S. Brown, J.G. Goldin, R.D. Suh, M.F. McNitt-Gray, J.W. Sayre, D.R. Aberle, "Lung micronodules: Automated method for detection at thin-section CT - Initial experience," Radiology 226, 256-262 (2003).
10. M.S. Brown, S.R. Rogers, J.G. Goldin, H.J. Kim, R.D. Suh, M.F. McNitt-Gray, K. Brown, D.W. Gjertson, J.W. Sayre, P. Batra, D.R. Aberle. "Computer-Aided Lung Nodule Detection in CT: Results of Large-Scale Observer Test." Acad Radiol 12(6), 681-686 (2005).