Disease staging and prognosis in smokers using deep learning in chest computed tomography

American Journal of Respiratory and Critical Care Medicine

Volumn 197, Issue 2, 2018, Pages 193-203

  Gonzalez, German ^a,b   Ash, Samuel Y ^b   Vegas Sánchez Ferrero, Gonzalo ^b   Onieva, Jorge Onieva ^b   Rahaghi, Farbod N ^b   Ross, James C ^b   Dáz, Alejandro ^b   Estépar, Raul San José ^b   Washko, George R ^b  

^a Sierra Research   (Spain)

^b BRIGHAM AND WOMEN S HOSPITAL   (United States)

Author keywords

Artificial intelligence (computer vision systems); Chronic obstructive pulmonary disease; Neural networks; X ray computed tomography

Indexed keywords

ACUTE RESPIRATORY TRACT DISEASE; ADULT; CHRONIC OBSTRUCTIVE LUNG DISEASE; COHORT ANALYSIS; FEMALE; FOLLOW UP; HUMAN; LEARNING; LONGITUDINAL STUDY; MAJOR CLINICAL STUDY; MALE; MIDDLE AGED; MORTALITY; PREDICTION; PRIORITY JOURNAL; PROBABILITY; PROGNOSIS; REVIEW; RISK ASSESSMENT; SMOKING; STAGING; THORAX RADIOGRAPHY; X-RAY COMPUTED TOMOGRAPHY; ADULT RESPIRATORY DISTRESS SYNDROME; AGED; COMPARATIVE STUDY; DIAGNOSTIC IMAGING; FACTUAL DATABASE; GENETICS; LUNG FUNCTION TEST; PREDICTIVE VALUE; PROCEDURES; SEVERITY OF ILLNESS INDEX; STATISTICAL MODEL; SURVIVAL RATE;

AGED; DATABASES, FACTUAL; DEEP LEARNING; FEMALE; HUMANS; LOGISTIC MODELS; MALE; MIDDLE AGED; PREDICTIVE VALUE OF TESTS; PROGNOSIS; PULMONARY DISEASE, CHRONIC OBSTRUCTIVE; RESPIRATORY DISTRESS SYNDROME, ADULT; RESPIRATORY FUNCTION TESTS; RISK ASSESSMENT; SEVERITY OF ILLNESS INDEX; SMOKING; SURVIVAL RATE; TOMOGRAPHY, X-RAY COMPUTED;

EID: 85045121335     PISSN: 1073449X     EISSN: 15354970     Source Type: Journal    
DOI: 10.1164/rccm.201705-0860OC     Document Type: Review

References (52)

1. Hayhurst MD, MacNee W, Flenley DC, Wright D, McLean A, Lamb D, et al. Diagnosis of pulmonary emphysema by computerised tomography. Lancet 1984; 2:320-322.
2. Muller NL, Staples CA, Miller RR, Abboud RT. "Density mask": an objective method to quantitate emphysema using computed tomography. Chest 1988; 94:782-787.
3. Nakano Y, Muro S, Sakai H, Hirai T, Chin K, Tsukino M, et al. Computed tomographic measurements of airway dimensions and emphysema in smokers. Correlation with lung function. Am J Respir Crit Care Med 2000; 162:1102-1108.
4. Estépar RS, Kinney GL, Black-Shinn JL, Bowler RP, Kindlmann GL, Ross JC, et al. COPDGene Study. Computed tomographic measures of pulmonary vascular morphology in smokers and their clinical implications. Am J Respir Crit Care Med 2013; 188:231-239.
5. McDonald ML, Diaz AA, Ross JC, San Jose Estepar R, Zhou L, Regan EA, et al. Quantitative computed tomography measures of pectoralis muscle area and disease severity in chronic obstructive pulmonary disease: a cross-sectional study. Ann Am Thorac Soc 2014; 11:326-334.
6. Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. In: Pereira F, Burges CJC, Bottou L, Weinberger KQ, editors. Advances in neural information processing systems 25 (NIPS 2012). New York: Curran Associates, Inc.; 2012. pp. 1097-1105.
7. Ren S, He K, Girshick R, Sun J. Faster R-CNN: towards real-time object detection with region proposal networks. In: Cortes C, Lawrence ND, Lee DD, Sugiyama M, Garnett R, editors. Advances in neural information processing systems 28 (NIPS 2015). New York: Curran Associates, Inc.; 2015. pp. 91-99.
8. Lecun Y. Gradient-based learning applied to document recognition. Proc IEEE 1998; 86:2278-2324.
9. LeCun Y, Boser B, Denker JS, Henderson D, Howard RE, Hubbard W, et al. Backpropagation applied to handwritten zip code recognition. Neural Comput 1989; 1:541-551.
10. Shelhamer E, Long J, Darrell T. Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 2017; 39:640-651.
11. Xu K, Ba J, Kiros R, Cho K, Courville AC, Salakhutdinov R, et al. Show, attend and tell: neural image caption generation with visual attention. arXiv:1502.03044.
12. Graves A, Mohamed A-r, Hinton GE. Speech recognition with deep recurrent neural networks. Presented at the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). May 26-31, 2013, Vancouver, BC, Canada. pp. 6645-6649.
13. Hinton GE, Deng L, Yu D, Dahl GE, Mohamed A-R, Jaitly N, et al. Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Process Mag 2012; 29:82-97.
14. Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 2016; 316:2402-2410.
15. Setio AA, Ciompi F, Litjens G, Gerke P, Jacobs C, van Riel SJ, et al. Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging 2016; 35:1160-1169.
16. Roth HR, Lu L, Liu J, Yao J, Seff A, Cherry K, et al. Improving computer-aided detection using convolutional neural networks and random view aggregation. IEEE Trans Med Imaging 2016; 35: 1170-1181.
17. Pereira S, Pinto A, Alves V, Silva CA. Brain tumor segmentation using convolutional neural networks in MRI images. IEEE Trans Med Imaging 2016; 35:1240-1251.
18. Ciresan D, Giusti A, Gambardella LM, Schmidhuber J. Deep neural networks segment neuronal membranes in electron microscopy images. In: Pereira F, Burges CJC, Bottou L, Weinberger KQ, editors. Advances in neural information processing systems 25 (NIPS 2012). New York: Curran Associates, Inc.; 2012. pp. 2843-2851.
19. Miao S, Wang ZJ, Rui L. A CNN regression approach for real-time 2D/3D registration. IEEE Trans Med Imaging 2016; 35: 1352-1363.
20. Sirinukunwattana K, Ahmed Raza SE, Yee-Wah Tsang, Snead DR, Cree IA, Rajpoot NM. Locality sensitive deep learning for detection and classification of nuclei in routine colon cancer histology images. IEEE Trans Med Imaging 2016; 35:1196-1206.
21. Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 2017; 542:115-118.
22. Regan EA, Hokanson JE, Murphy JR, Make B, Lynch DA, Beaty TH, et al. Genetic epidemiology of COPD (COPDGene) study design. COPD 2010; 7:32-43.
23. Vestbo J, Anderson W, Coxson HO, Crim C, Dawber F, Edwards L, et al.; ECLIPSE investigators. Evaluation of COPD Longitudinally to Identify Predictive Surrogate End-points (ECLIPSE). Eur Respir J 2008; 31:869-873.
24. Bowler RP, Kim V, Regan E, Williams AAA, Santorico SA, Make BJ, et al. Prediction of acute respiratory disease in current and former smokers with and without COPD. Chest 2014; 146:941-950.
25. Wells JM, Washko GR, Han MK, Abbas N, Nath H, Mamary AJ, et al.; COPDGene Investigators. ECLIPSE Study Investigators. Pulmonary arterial enlargement and acute exacerbations of COPD. N Engl J Med 2012; 367:913-921.
26. Gonzalez G, Washko G, San Jose Estepar R. Automated Agatston score computation in a large dataset of non ECG-gated chest computed tomography. In: 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI). Prague, Czech Republic: IEEE; 2016. pp. 53-57.
27. Vestbo J, Hurd SS, Agustí AG, Jones PW, Vogelmeier C, Anzueto A, et al. Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease: GOLD executive summary. Am J Respir Crit Care Med 2013; 187:347-365.
28. Lemeshow S, Hosmer DW Jr A review of goodness of fit statistics for use in the development of logistic regression models. Am J Epidemiol 1982; 115:92-106.
29. Holmberg L, Vickers A. Evaluation of prediction models for decision-making: beyond calibration and discrimination. PLoS Med 2013; 10: e1001491.
30. Ash SY, Washko GR. The value of CT scanning. In: Anzueto A, Heijdra Y, Hurst JR, editors. Controversies in COPD. European Respiratory Society: 2015. pp. 121-133.
31. Washko GR, Parraga G, Coxson HO. Quantitative pulmonary imaging using computed tomography and magnetic resonance imaging. Respirology 2012; 17:432-444.
32. Lin DY, Wei LJ, Ying Z. Checking the Cox model with cumulative sums of martingale-based residuals. Biometrika 1993; 80:557-572.
33. Cook NR C-statistics for survival data [accessed 2016 Sept 9]. Available from: http://ncook.bwh.harvard.edu/assets/survcmacs.v1.sas.
34. Pencina MJ, D'Agostino RB. Overall C as a measure of discrimination in survival analysis: model specific population value and confidence interval estimation. Stat Med 2004; 23:2109-2123.
35. Demler OV, Paynter NP, Cook NR. Tests of calibration and goodness-of-fit in the survival setting. Stat Med 2015; 34:1659-1680.
36. Celli BR, Cote CG, Marin JM, Casanova C, Montes de Oca M, Mendez RA, et al. The body-mass index, airflow obstruction, dyspnea, and exercise capacity index in chronic obstructive pulmonary disease. N Engl J Med 2004; 350:1005-1012.
37. Hasegawa M, Nasuhara Y, Onodera Y, Makita H, Nagai K, Fuke S, et al. Airflow limitation and airway dimensions in chronic obstructive pulmonary disease. Am J Respir Crit Care Med 2006; 173:1309-1315.
38. Coxson HO, Quiney B, Sin DD, Xing L, McWilliams AM, Mayo JR, et al. Airway wall thickness assessed using computed tomography and optical coherence tomography. Am J Respir Crit Care Med 2008; 177:1201-1206.
39. Coxson HO, Dirksen A, Edwards LD, Yates JC, Agusti A, Bakke P, et al.; Evaluation of COPD Longitudinally to Identify Predictive Surrogate Endpoints (ECLIPSE) Investigators. The presence and progression of emphysema in COPD as determined by CT scanning and biomarker expression: a prospective analysis from the ECLIPSE study. Lancet Respir Med 2013; 1:129-136.
40. Coxson HO, Hogg JC, Mayo JR, Behzad H, Whittall KP, Schwartz DA, et al. Quantification of idiopathic pulmonary fibrosis using computed tomography and histology. Am J Respir Crit Care Med 1997; 155: 1649-1656.
41. Patel IS, Vlahos I, Wilkinson TM, Lloyd-Owen SJ, Donaldson GC, Wilks M, et al. Bronchiectasis, exacerbation indices, and inflammation in chronic obstructive pulmonary disease. Am J Respir Crit Care Med 2004; 170:400-407.
42. Martínez-Garćia MA, de la Rosa Carrillo D, Soler-Cataluña JJ, Donat-Sanz Y, Serra PC, Lerma MA, et al. Prognostic value of bronchiectasis in patients with moderate-to-severe chronic obstructive pulmonary disease. Am J Respir Crit Care Med 2013; 187:823-831.
43. Putman RK, Hatabu H, Araki T, Gudmundsson G, Gao W, Nishino M, et al.; Evaluation of COPD Longitudinally to Identify Predictive Surrogate Endpoints (ECLIPSE) Investigators. COPDGene Investigators. Association between interstitial lung abnormalities and all-cause mortality. JAMA 2016; 315:672-681.
44. Lakhani P, Sundaram B. Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks. Radiology 2017; 162326.
45. Sørensen L, Nielsen M, Lo P, Ashraf H, Pedersen JH, de Bruijne M. Texture-based analysis of COPD: a data-driven approach. IEEE Trans Med Imaging 2012; 31:70-78.
46. Mets OM, Buckens CF, Zanen P, Isgum I, van Ginneken B, Prokop M, et al. Identification of chronic obstructive pulmonary disease in lung cancer screening computed tomographic scans. JAMA 2011; 306:1775-1781.
47. Sauer BC, Jones BE, Globe G, Leng J, Lu CC, He T, et al. Performance of a natural language processing (NLP) tool to extract pulmonary function test (PFT) reports from structured and semistructured Veteran Affairs (VA) data. EGEMS (Wash DC) 2016; 4:1217.
48. Hinchcliff M, Just E, Podlusky S, Varga J, Chang RW, Kibbe WA. Text data extraction for a prospective, research-focused data mart: implementation and validation. BMC Med Inform Decis Mak 2012; 12:106.
49. Bernd L, Joan BS, Michael S, Bernhard K, Lowie EV, Louisa G, et al.; BOLD Collaborative Research Group. the EPI-SCAN Team, the PLATINO Team, and the PREPOCOL Study Group. Determinants of underdiagnosis of COPD in national and international surveys. Chest 2015; 148:971-985.
50. Miller MR, Levy ML. Chronic obstructive pulmonary disease: missed diagnosis versus misdiagnosis. BMJ 2015; 351:h3021.
51. Berrington de González A, Mahesh M, Kim KP, Bhargavan M, Lewis R, Mettler F, et al. Projected cancer risks from computed tomographic scans performed in the United States in 2007. Arch Intern Med 2009; 169:2071-2077.
52. Sharma S, Lucas CD. Increasing use of CTPA for the investigation of suspected pulmonary embolism. Postgrad Med 2017; 129: 193-197.