Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks

IEEE Transactions on Medical Imaging

Volumn 35, Issue 5, 2016, Pages 1160-1169

  Setio, Arnaud Arindra Adiyoso ^a   Ciompi, Francesco ^a   Litjens, Geert ^a   Gerke, Paul ^a   Jacobs, Colin ^a   Van Riel, Sarah J ^a   Wille, Mathilde Marie Winkler ^b   Naqibullah, Matiullah ^b   Sanchez, Clara I ^a   Van Ginneken, Bram ^a,c  

^a RADBOUD UNIVERSITY MEDICAL CENTER   (Netherlands)

^b UNIVERSITY OF COPENHAGEN   (Denmark)

^c FRAUNHOFER MEVIS   (Germany)

Author keywords

Computed tomography; computer aided detection; convolutional networks; deep learning; lung cancer; pulmonary nodule

Indexed keywords

COMPUTER AIDED INSTRUCTION; COMPUTER NETWORKS; CONVOLUTION; POSITRON EMISSION TOMOGRAPHY;

COMPUTER AIDED DETECTION; CONVOLUTIONAL NETWORKS; DEEP LEARNING; LUNG CANCER; PULMONARY NODULES;

COMPUTERIZED TOMOGRAPHY;

ARTICLE; COMPUTER AIDED DETECTION; COMPUTER ASSISTED TOMOGRAPHY; EVALUATION STUDY; LUNG NODULE; MACHINE LEARNING; MULTI VIEW CONVOLUTIONAL NETWORK; TRAINING; ALGORITHM; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; DIAGNOSTIC IMAGING; HUMAN; LUNG TUMOR; PROCEDURES; X-RAY COMPUTED TOMOGRAPHY;

ALGORITHMS; HUMANS; LUNG NEOPLASMS; MACHINE LEARNING; PATTERN RECOGNITION, AUTOMATED; RADIOGRAPHIC IMAGE INTERPRETATION, COMPUTER-ASSISTED; SOLITARY PULMONARY NODULE; TOMOGRAPHY, X-RAY COMPUTED;

EID: 84968638584     PISSN: 02780062     EISSN: 1558254X     Source Type: Journal    
DOI: 10.1109/TMI.2016.2536809     Document Type: Article

References (47)

1. Cancer Facts and Figures 2014 Am. Cancer Soc., 2014 [Online]. Available: http://www.cancer.org/acs/groups/cid/documents/webcontent/003115-pdf.pdf
2. D. R. Aberle et al., "Reduced lung-cancer mortality with low-dose computed tomographic screening," N. Eng. J. Med., vol. 365, pp. 395-409, 2011.
3. K. Murphy, B. van Ginneken, A. M. R. Schilham, B. J. de Hoop, H. A. Gietema, and M. Prokop, "A large scale evaluation of automatic pulmonary nodule detection in chest CT using local image features and k-nearest-neighbour classification," Med. Image Anal., vol. 13, pp. 757-770, 2009.
4. T. Messay, R. C. Hardie, and S. K. Rogers, "A new computationally efficient CAD system for pulmonary nodule detection in CT imagery," Med. Image Anal., vol. 14, pp. 390-406, 2010.
5. C. Jacobs et al., "Automatic detection of subsolid pulmonary nodules in thoracic computed tomography images," Med. Image Anal., vol. 18, pp. 374-384, 2014.
6. B. van Ginneken et al., "Comparing and combining algorithms for computer-aided detection of pulmonary nodules in computed tomography scans: The ANODE09 study," Med. Image Anal., vol. 14, pp. 707-722, 2010.
7. M. Firmino et al., "Computer-aided detection system for lung cancer in computed tomography scans: Review and future prospects," Biomed. Eng. Online, vol. 13, p. 41, 2014.
8. Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
9. Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning," Nature, vol. 521, pp. 436-444, 2015.
10. D. Cireşan, U. Meier, J. Masci, and J. Schmidhuber, "Multi-column deep neural network for traffic sign classification," Neural Netw., vol. 32, pp. 333-338, 2012.
11. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," Adv. Neural Inf. Process. Syst., pp. 1097-1105, 2012.
12. K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman, "Return of the devil in the details: Delving deep into convolutional nets," in Br. Mach. Vis. Conf., 2014.
13. K. Simonyan and A. Zisserman, Very Deep Convolutional Networks for Large-Scale Image Recognition ArXiv, 2014 [Online]. Available: arXiv:14091556
14. A. Prasoon, K. Petersen, C. Igel, F. Lauze, E. Dam, and M. Nielsen, "Deep feature learning for knee cartilage segmentation using a tri-planar convolutional neural network," in Medical Image Computing and Computer-Assisted Intervention. New York: Springer, 2013, vol. 8150, LNCS, pp. 246-253.
15. A. A. Cruz-Roa, J. E. A. Ovalle, A. Madabhushi, and F. A. G. Osorio, "A deep learning architecture for image representation, visual interpretability and automated basal-cell carcinoma cancer detection," in Medical Image Computing and Computer-Assisted Intervention. New York: Springer, 2013, vol. 8150, LNCS, pp. 403-410.
16. R. Li, W. Zhang, H.-I. Suk, L. Wang, J. Li, D. Shen, and S. Ji, "Deep learning based imaging data completion for improved brain disease diagnosis," in Medical Image Computing and Computer-Assisted Intervention. New York: Springer, 2014, vol. 8675, LNCS, pp. 305-312.
17. H. R. Roth, L. Lu, A. Seff, K. M. Cherry, J. Hoffman, S. Wang, J. Liu, E. Turkbey, and R. M. Summers, "A new 2.5D representation for lymph node detection using random sets of deep convolutional neural network observations," in Medical Image Computing and Computer-Assisted Intervention. New York: Springer, 2014, vol. 8673, LNCS, pp. 520-527.
18. T. Brosch, Y. Yoo, D. K. B. Li, A. Traboulsee, and R. Tam, "Modeling the variability in brain morphology and lesion distribution in multiple sclerosis by deep learning," in Medical Image Computing and Computer-Assisted Intervention. New York: Springer, 2014, vol. 8674, LNCS, pp. 462-469.
19. S.-C. Lo et al., "Artificial convolution neural network for medical image pattern recognition," Neural Netw., vol. 8, pp. 1201-1214, 1995.
20. B. van Ginneken, A. A. A. Setio, C. Jacobs, and F. Ciompi, "Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans," in Proc. IEEE Int. Symp. Biomed. Imag., 2015, pp. 286-289.
21. S. G. Armato et al., "The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): A completed reference database of lung nodules on CT scans," Med. Phys., vol. 38, pp. 915-931, 2011.
22. D. P. Naidich et al., "Recommendations for the management of subsolid pulmonary nodules detected at CT: A statement from the Fleischner society," Radiology, vol. 266, pp. 304-317, 2013.
23. D. Manos et al., "The lung reporting and data system (LU-RADS): A proposal for computed tomography screening," Can. Assoc. Radiol. Journ., vol. 65, pp. 121-134, 2014.
24. D. M. Xu et al., "Nodule management protocol of the NELSON randomised lung cancer screening trial," Lung Cancer, vol. 54, pp. 177-184, 2006.
25. J. H. Pedersen et al., "The Danish randomized lung cancer CT screening trial-overall design and results of the prevalence round," J. Thoracic Oncol., vol. 4, pp. 608-614, 2009.
26. M. M. W. Wille et al., "Predictive accuracy of the pancan lung cancer risk prediction model -external validation based on CT from the Danish lung cancer screening trial," Eur. Radiol., 2015.
27. A. A. A. Setio, C. Jacobs, J. Gelderblom, and B. van Ginneken, "Automatic detection of large pulmonary solid nodules in thoracic CT images," Med. Phys., vol. 42, no. 10, pp. 5642-5653, 2015.
28. M. Niemeijer et al., "On combining computer-aided detection systems," IEEE Trans. Med. Imag., vol. 30, no. 2, pp. 215-223, Feb. 2011.
29. J. M. Kuhnigk et al., "Morphological segmentation and partial volume analysis for volumetry of solid pulmonary lesions in thoracic CT scans," IEEE Trans. Med. Imag., vol. 25, no. 4, pp. 417-434, Apr. 2006.
30. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei, "Large-scale video classification with convolutional neural networks," in IEEE Conf. Comput. Vis. Pattern Recognit., 2014, pp. 1725-1732.
31. T. Tieleman and G. Hinton, "Lecture 6.5 - RmsProp: Divide the gradient by a running average of its recent magnitude," COURSERA: Neural Networks for Machine Learning, 2012.
32. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: A simple way to prevent neural networks from overfitting," J. Mach. Learn. Res., vol. 15, pp. 1929-1958, 2014.
33. X. Glorot and Y. Bengio, "Understanding the difficulty of training deep feedforward neural networks," in Proc. Int. Conf. Artif. Intell. Stat., 2010, pp. 249-256.
34. B. Efron and R. J. Tibshirani, An Introduction to the Bootstrap. Boca Raton, FL: CRC Press, 1994, vol. 57.
35. E. L. Torres et al., "Large scale validation of the M5L lung CAD on heterogeneous CT datasets," Med. Phys., vol. 42, pp. 1477-1489, 2015.
36. A. Retico et al., "A voxel-based neural approach (VBNA) to identify lung nodules in the ANODE09 study," Proc. SPIE, vol. 7260, pp. 72601S-1-72601S-8, 2009.
37. M. S. Brown et al., "Toward clinically usable CAD for lung cancer screening with computed tomography," Eur. Radiol., pp. 2719-2728, 2014.
38. W.-J. Choi and T.-S. Choi, "Automated pulmonary nodule detection system in computed tomography images: A hierarchical block classification approach," Entropy, vol. 15, pp. 507-523, 2013.
39. M. Tan, R. Deklerck, J. Cornelis, and B. Jansen, "Phased searching with neat in a time-scaled framework: Experiments on a computer-aided detection system for lung nodules," Artif. Intell. Med., 2013.
40. A. Teramoto and H. Fujita, "Fast lung nodule detection in chest CT images using cylindrical nodule-enhancement filter," Int. J. Comput. Assist. Radiol. Surg., pp. 1-13, 2013.
41. D. Cascio, R. Magro, F. Fauci, M. Iacomi, and G. Raso, "Automatic detection of lung nodules in CT datasets based on stable 3D mass-spring models," Comput. Biol. Med., pp. 1098-1109, 2012.
42. W. Guo and Q. Li, "High performance lung nodule detection schemes in CT using local and global information," Med. Phys., vol. 39, pp. 5157-5168, 2012.
43. Y. Zhao et al., "Performance of computer-aided detection of pulmonary nodules in low-dose CT: Comparison with double reading by nodule volume," Eur. Radiol., pp. 2076-2084, 2012.
44. B. Golosio et al., "A novel multithreshold method for nodule detection in lung CT," Med. Phys., vol. 36, pp. 3607-3618, 2009.
45. A. A. Enquobahrie, A. P. Reeves, D. F. Yankelevitz, and C. I. Henschke, "Automated detection of small pulmonary nodules in whole lung CT scans," Acad. Radiol., vol. 14, pp. 579-593, 2007.
46. F. Bastien et al., "Theano: New features and speed improvements," in Deep Learning and Unsupervised Feature Learning NIPS 2012 Workshop, 2012, pp. 1-10.
47. J. Bergstra et al., "Theano: A CPU and GPU math expression compiler," in Proc. Python Sci. Comput. Conf., Jun. 2010, pp. 1-7.