Pulmonary nodule classification in lung cancer screening with three-dimensional convolutional neural networks

Journal of Medical Imaging

Volumn 4, Issue 4, 2017, Pages

  Liu, Shuang ^a   Xie, Yiting ^a   Jirapatnakul, Artit ^b   Reeves, Anthony P ^a  

^a School of Operations Research and Industrial Engineering   (United States)

^b MOUNT SINAI SCHOOL OF MEDICINE   (United States)

Author keywords

low dose chest CT; lung cancer screening; pulmonary nodule classification; three dimensional convolutional neural network

Indexed keywords

ARTICLE; BAYESIAN LEARNING; CANCER CLASSIFICATION; CANCER SCREENING; CARCINOGENESIS; CLASSIFIER; DECISION TREE; FOLLOW UP; KERNEL METHOD; LOW ENERGY RADIATION; LUNG CANCER; LUNG NODULE; MACHINE LEARNING; RADIOLOGICAL PARAMETERS; RANDOM FOREST; SUPPORT VECTOR MACHINE; THREE DIMENSIONAL CONVOLUTIONAL NEURAL NETWORK; UNITED STATES; X-RAY COMPUTED TOMOGRAPHY;

EID: 85034861165     PISSN: 23294302     EISSN: 23294310     Source Type: Journal    
DOI: 10.1117/1.JMI.4.4.041308     Document Type: Article

References (60)

1. V. P. D. Rose et al., "Use of lung cancer screening tests in the United States: results from the 2010 National Health Interview Survey, " Cancer Epidemiol. Prev. Biomarkers 21(7), 1049-1059 (2012).
2. S. G. Armato et al., "LUNGx challenge for computerized lung nodule classification, " J. Med. Imaging 3(4), 044506 (2016).
3. M. Aoyama et al., "Computerized scheme for determination of the likelihood measure of malignancy for pulmonary nodules on low?dose CT images, " Med. Phys. 30(3), 387-394 (2003).
4. S. G. Armato et al., "Automated lung nodule classification following automated nodule detection on CT: a serial approach, " Med. Phys. 30(6), 1188-1197 (2003).
5. F. Han et al., "Texture feature analysis for computer-aided diagnosis on pulmonary nodules, " J Digit Imaging 28(1), 99-115 (2015).
6. A. P. Reeves, Y. Xie, and A. Jirapatnakul, "Automated pulmonary nodule CT image characterization in lung cancer screening, " Int. J. Comput. Assisted Radiol. Surg. 11(1), 73-88 (2016).
7. K. Suzuki et al., "Computer-aided diagnostic scheme for distinction between benign and malignant nodules in thoracic low-dose CT by use of massive training artificial neural network, " IEEE Trans. Med. Imaging 24(9), 1138-1150 (2005).
8. A. C. Jirapatnakul et al., "Pulmonary nodule classification: size distribution issues, " in 4th IEEE Int. Symp. on Biomedical Imaging: From Nano to Macro (SBI 2007), pp. 1248-1251, IEEE (2007).
9. A. P. Reeves et al., "On measuring the change in size of pulmonary nodules, " IEEE Trans. Med. Imaging 25(4), 435-450 (2006).
10. Y. LeCun et al., "Backpropagation applied to handwritten zip code recognition, " Neural Comput. 1(4), 541-551 (1989).
11. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks, " in Advances in Neural Information Processing Systems, pp. 1097-1105 (2012).
12. J. Deng et al., "ImageNet: a large-scale hierarchical image database, " in IEEE Conf. on Computer Vision and Pattern Recognition (CVPR 2009), pp. 248-255, IEEE (2009).
13. A. A. A. Setio et al., "Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks, " IEEE Trans. Med. Imaging 35(5), 1160-1169 (2016).
14. P. Sermanet et al., "Overfeat: integrated recognition, localization and detection using convolutional networks, " arXiv:1312. 6229 (2013).
15. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition, " arXiv:1409. 1556 (2014).
16. C. Szegedy et al., "Going deeper with convolutions, " in Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1-9 (2015).
17. K. He et al., "Deep residual learning for image recognition, " in Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, pp. 770-778 (2016).
18. G. Litjens et al., "A survey on deep learning in medical image analysis, " arXiv:1702. 05747 (2017).
19. H. C. Shin et al., "Deep convolutional neural networks for computeraided detection: CNN architectures, dataset characteristics and transfer learning, " IEEE Trans. Med. Imaging 35(5), 1285-1298 (2016).
20. B. van Ginneken et al., "Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans, " in IEEE 12th Int. Symp. on Biomedical Imaging (ISBI 2015), pp. 286-289, IEEE (2015).
21. B. Q. Huynh, H. Li, and M. L. Giger, "Digital mammographic tumor classification using transfer learning from deep convolutional neural networks, " J. Med. Imaging 3(3), 034501 (2016).
22. N. Antropova, B. Huynh, and M. Giger, "Performance comparison of deep learning and segmentation-based radiomic methods in the task of distinguishing benign and malignant breast lesions on DCE-MRI, " Proc. SPIE 10134, 101341G (2017).
23. F. Ciompi et al., "Automatic classification of pulmonary peri-fissural nodules in computed tomography using an ensemble of 2D views and a convolutional neural network out-of-the-box, " Med. Image Anal. 26(1), 195-202 (2015).
24. M. Buty et al., "Characterization of lung nodule malignancy using hybrid shape and appearance features, " in Int. Conf. on Medical Image Computing and Computer-Assisted Intervention, pp. 662-670, Springer International Publishing (2016).
25. H. R. Roth et al., "A new 2. 5 D representation for lymph node detection using random sets of deep convolutional neural network observations, " in Int. Conf. on Medical Image Computing and Computer-Assisted Intervention, pp. 520-527, Springer International Publishing, Vancouver (2014).
26. W. Shen et al., "Multi-scale convolutional neural networks for lung nodule classification, " in Int. Conf. on Information Processing in Medical Imaging, pp. 588-599, Springer International Publishing (2015).
27. W. Shen et al., "Multi-crop convolutional neural networks for lung nodule malignancy suspiciousness classification, " Pattern Recognit. 61, 663-673 (2017).
28. S. Hamidian et al., "3D convolutional neural network for automatic detection of lung nodules in chest CT, " Proc. SPIE 10134, 1013409 (2017).
29. Q. Dou et al., "Automatic detection of cerebral microbleeds from MR images via 3D convolutional neural networks, " IEEE Trans. Med. Imaging 35(5), 1182-1195 (2016).
30. A. Mehrtash et al., "Classification of clinical significance of MRI prostate findings using 3D convolutional neural networks, " Proc. SPIE 10134, 101342A (2017).
31. J. Li et al., "Discriminating between benign and malignant breast tumors using 3D convolutional neural network in dynamic contrast enhanced-MR images, " Proc. SPIE 10138, 1013808 (2017).
32. Ö. Çiçek et al., "3D u-net: learning dense volumetric segmentation from sparse annotation, " in Int. Conf. on Medical Image Computing and Computer-Assisted Intervention, pp. 424-432, Springer International Publishing (2016).
33. J. Kleesiek et al., "Deep MRI brain extraction: a 3D convolutional neural network for skull stripping, " NeuroImage 129, 460-469 (2016).
34. A. Patel et al., "Automatic cerebrospinal fluid segmentation in noncontrast CT images using a 3D convolutional network, " Proc. SPIE 10134, 1013420 (2017).
35. D. Kumar et al., "Lung nodule classification using deep features in CT images, " in 12th Conf. on Computer and Robot Vision (CRV 2015), pp. 133-138, IEEE (2015).
36. R. Korez et al., "Intervertebral disc segmentation in MR images with 3D convolutional networks, " Proc. SPIE 10133, 1013306 (2017).
37. R. Korez et al., "Model-based segmentation of vertebral bodies from MR images with 3D CNNs, " in Int. Conf. on Medical Image Computing and Computer-Assisted Intervention, pp. 433-441, Springer International Publishing (2016).
38. Y. Zheng et al., "3D deep learning for efficient and robust landmark detection in volumetric data, " in Int. Conf. on Medical Image Computing and Computer-Assisted Intervention, pp. 565-572, Springer International Publishing (2015).
39. International Early Lung Cancer Action Program Investigators, "Survival of patients with stage I lung cancer detected on CT screening, " N. Engl. J. Med. 2006(355), 1763-1771 (2006).
40. National Lung Screening Trial Research Team, "Reduced lung-cancer mortality with low-dose computed tomographic screening, " N. Engl. J. Med. 2011(365), 395-409 (2011).
41. J. Davis and M. Goadrich, "The relationship between precision-recall and ROC curves, " in Proc. of the 23rd Int. Conf. on Machine Learning, pp. 233-240, ACM (2006).
42. B. van Ginneken et al., "Comparing and combining algorithms for computer-aided detection of pulmonary nodules in computed tomography scans: the ANODE09 study, " Med. Image Anal. 14(6), 707-722 (2010).
43. I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning, MIT Press, Cambridge, Massachusetts (2016).
44. J. Kittler et al., "On combining classifiers, " IEEE Trans. Pattern Anal. Mach. Intell. 20(3), 226-239 (1998).
45. L. I. Kuncheva and C. J. Whitaker, "Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy, " Mach. Learning 51(2), 181-207 (2003).
46. S. A. Dudani, "The distance-weighted k-nearest-neighbor rule, " IEEE Trans. Syst. Man Cybern. SMC-6(4), 325-327 (1976).
47. S. Le Cessie and J. C. Van Houwelingen, "Ridge estimators in logistic regression, " Appl. Stat. 41, 191-201 (1992).
48. J. A. Suykens and J. Vandewalle, "Least squares support vector machine classifiers, " Neural Process. Lett. 9(3), 293-300 (1999).
49. X. Glorot and Y. Bengio, "Understanding the difficulty of training deep feedforward neural networks, " in Proc. of the Thirteenth Int. Conf. on Artificial Intelligence and Statistics, Vol. 9, pp. 249-256 (2010).
50. Y. Jia et al., "Caffe: convolutional architecture for fast feature embedding, " in Proc. of the 22nd ACM Int. Conf. on Multimedia, pp. 675-678, ACM (2014).
51. C. Cortes and V. Vapnik, "Support-vector networks, " Mach. Learn. 20(3), 273-297 (1995).
52. T. K. Ho, "The random subspace method for constructing decision forests, " IEEE Trans. Pattern Anal. Mach. Intell. 20(8), 832-844 (1998).
53. Y. Freund et al., "An efficient boosting algorithm for combining preferences, " J. Mach. Learn. Res. 4(Nov), 933-969 (2003).
54. G. H. John and P. Langley, "Estimating continuous distributions in Bayesian classifiers, " in Proc. of the Eleventh Conf. on Uncertainty in Artificial Intelligence, pp. 338-345, Morgan Kaufmann Publishers Inc. (1995).
55. F. Pedregosa et al., "Scikit-learn: machine learning in python, " J. Mach. Learn. Res. 12(Oct), 2825-2830 (2011).
56. E. R. DeLong, D. M. DeLong, and D. L. Clarke-Pearson, "Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach, " Biometrics 44, 837-845 (1988).
57. A. Birnbaum, "Combining independent tests of significance, " J. Am. Stat. Assoc. 49(267), 559-574 (1954).
58. R. A. Fisher, Statistical Methods for Research Workers, 4th ed., Oliver and Boyd, Edinburgh and London (1932).
59. X. Robin et al., "pROC: an open-source package for R and S+ to analyze and compare ROC curves, " BMC Bioinf. 12(1), 77 (2011).
60. S. V. Fotin et al., "Detection of soft tissue densities from digital breast tomosynthesis: comparison of conventional and deep learning approaches, " Proc. SPIE 9785, 97850X (2016).