Development and Validation of a Deep Learning-based Automatic Detection Algorithm for Active Pulmonary Tuberculosis on Chest Radiographs

Clinical Infectious Diseases

Volumn 69, Issue 5, 2019, Pages 739-747

  Hwang, Eui Jin ^a   Park, Sunggyun ^b   Jin, Kwang Nam ^b   Kim, Jung Im ^c   Choi, So Young ^d   Lee, Jong Hyuk ^a   Goo, Jin Mo ^a   Aum, Jaehong ^b   Yim, Jae Joon ^a   Park, Chang Min ^a   Kim, Dong Hyeon ^e   Woo, Woo ^e   Choi, Choi ^e   Hwang, In Pyung ^e   Song, Yong Sub ^e   Lim, Lim ^e   Kim, Kim ^e   Wi, Jae Yeon ^e   Oh, Su Suk ^e   Kang, Mi Jin ^e  

^a Seoul National University College of Medicine   (South Korea)

^b Seoul National University Boramae Hospital   (South Korea)

^c Kyung Hee University College of Medicine   (South Korea)

^d Eulji University   (South Korea)

^e Seoul National University College of Medicine ^*

Author keywords

chest radiograph; computer aided detection; deep learning; tuberculosis

Indexed keywords

ADOLESCENT; ADULT; AGED; ARTICLE; CERTIFICATION; COMPUTER ASSISTED TOMOGRAPHY; DEEP LEARNING; DEEP LEARNING BASED AUTOMATIC DETECTION ALGORITHM; FEMALE; HUMAN; LEARNING ALGORITHM; LUNG TUBERCULOSIS; MAJOR CLINICAL STUDY; MALE; MULTICENTER STUDY; PRIORITY JOURNAL; RADIOLOGIST; SENSITIVITY AND SPECIFICITY; TASK PERFORMANCE; THORAX RADIOGRAPHY; VALIDATION STUDY; ALGORITHM; AUTOMATION; DIAGNOSTIC IMAGING; MIDDLE AGED; RADIOGRAPHY; RECEIVER OPERATING CHARACTERISTIC; THORAX;

ADULT; AGED; ALGORITHMS; AUTOMATION; DEEP LEARNING; FEMALE; HUMANS; MALE; MIDDLE AGED; RADIOGRAPHY; ROC CURVE; SENSITIVITY AND SPECIFICITY; THORAX; TUBERCULOSIS, PULMONARY;

EID: 85065571234     PISSN: 10584838     EISSN: 15376591     Source Type: Journal    
DOI: 10.1093/cid/ciy967     Document Type: Article

References (32)

1. World Health Organization. Global tuberculosis report 2017. Geneva, Switzerland: WHO; 2017.
2. World Health Organization. Systematic screening for active tuberculosis: Principles and recommendations. Geneva, Switzerland: WHO; 2013.
3. den Boon S, White NW, van Lill SW, et al. An evaluation of symptom and chest radiographic screening in tuberculosis prevalence surveys. Int J Tuberc Lung Dis 2006; 10: 876-82.
4. van't Hoog AH, Meme HK, Laserson KF, et al. Screening strategies for tuberculosis prevalence surveys: The value of chest radiography and symptoms. PLoS One 2012; 7: E38691.
5. Melendez J, Sanchez CI, Philipsen RH, et al. An automated tuberculosis screening strategy combining X-ray-based computer-aided detection and clinical information. Sci Rep 2016; 6: 25265.
6. Hoog AH, Meme HK, van Deutekom H, et al. High sensitivity of chest radiograph reading by clinical officers in a tuberculosis prevalence survey. Int J Tuberc Lung Dis 2011; 15: 1308-14.
7. Jaeger S, Karargyris A, Candemir S, et al. Automatic screening for tuberculosis in chest radiographs: A survey. Quant Imaging Med Surg 2013; 3: 89-99.
8. Jaeger S, Karargyris A, Candemir S, et al. Automatic tuberculosis screening using chest radiographs. IEEE Trans Med Imaging 2014; 33: 233-45.
9. Hogeweg L, Mol C, de Jong PA, Dawson R, Ayles H, van Ginneken B. Fusion of local and global detection systems to detect tuberculosis in chest radiographs. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 2010: 650-7.
10. Rahman MT, Codlin AJ, Rahman MM, et al. An evaluation of automated chest radiography reading software for tuberculosis screening among public-and private-sector patients. Eur Respir J 2017; 49: 1602159.
11. Pande T, Cohen C, Pai M, Ahmad Khan F. Computer-aided detection of pulmonary tuberculosis on digital chest radiographs: A systematic review. Int J Tuberc Lung Dis 2016; 20: 1226-30.
12. Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems. 2012: 1097-105.
13. Esteva A, Kuprel B, Novoa RA, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 2017; 542: 115-8.
14. Gulshan V, Peng L, Coram M, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 2016; 316: 2402-10.
15. Lakhani P, Sundaram B. Deep learning at chest radiography: Automated classification of pulmonary tuberculosis by using convolutional neural networks. Radiology 2017; 284: 574-82.
16. Nam JG, Park S, Hwang EJ, et al. Development and validation of deep learning-based automatic detection algorithm for malignant pulmonary nodules on chest radiographs. Radiology 2018 doi: 10.1148/radiol.2018180237. [Epub ahead of print].
17. Jaeger S, Candemir S, Antani S, Wang YX, Lu PX, Thoma G. Two public chest X-ray datasets for computer-aided screening of pulmonary diseases. Quant Imaging Med Surg 2014; 4: 475-7.
18. Schalekamp S, van Ginneken B, Koedam E, et al. Computer-aided detection improves detection of pulmonary nodules in chest radiographs beyond the support by bone-suppressed images. Radiology 2014; 272: 252-61.
19. Team RC. R: A language and environment for statistical computing. 3.4.3th ed. Vienna, Austria: R Foundation for Statistical Computing, 2017.
20. Zhai X, Chakraborty D. RJafroc: Analysis of data acquired using the receiver operating characteristic paradigm and its extensions. Available at: Http://cran.r-project.org/web/packagees/RJafroc/index.html. Accessed 28 November 2018.
21. Chakraborty DP, Zai X. Analysis of data acquired using ROC paradigm and its extension. Available at: Http://www.et.bs.ehu.es. Accessed 28 November 2018.
22. Dorfman DD, Berbaum KS, Metz CE. Receiver operating characteristic rating analysis. Generalization to the population of readers and patients with the jackknife method. Invest Radiol 1992; 27: 723-31.
23. Fletcher JG, Yu L, Li Z, et al. Observer performance in the detection and classification of malignant hepatic nodules and masses with CT image-space denoising and iterative reconstruction. Radiology 2015; 276: 465-78.
24. Holm S. A simple sequentially rejective multiple test procedure. Scand J Stat 1979: 65-70.
25. Breuninger M, van Ginneken B, Philipsen RH, et al. Diagnostic accuracy of computer-aided detection of pulmonary tuberculosis in chest radiographs: A validation study from sub-Saharan Africa. PLoS One 2014; 9: E106381.
26. Maduskar P, Muyoyeta M, Ayles H, Hogeweg L, Peters-Bax L, van Ginneken B. Detection of tuberculosis using digital chest radiography: Automated reading vs. interpretation by clinical officers. Int J Tuberc Lung Dis 2013; 17: 1613-20.
27. Steiner A, Mangu C, Van Den Hombergh J, et al. Screening for pulmonary tuberculosis in a Tanzanian prison and computer-aided interpretation of chest X-rays. Public Health Action 2015; 5: 249-54.
28. Gilbert FJ, Astley SM, Gillan MG, et al.; CADET II Group. Single reading with computer-aided detection for screening mammography. N Engl J Med 2008; 359: 1675-84.
29. Petrick N, Haider M, Summers RM, et al. CT colonography with computer-aided detection as a second reader: Observer performance study. Radiology 2008; 246: 148-56.
30. Regge D, Della Monica P, Galatola G, et al. Efficacy of computer-aided detection as a second reader for 6-9-mm lesions at CT colonography: Multicenter prospective trial. Radiology 2013; 266: 168-76.
31. Goo JM. A computer-aided diagnosis for evaluating lung nodules on chest CT: The current status and perspective. Korean J Radiol 2011; 12: 145-55.
32. Samek W, Wiegand T, Muller K-R. Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. arXiv preprint arXiv: 170808296 2017.