Multiscale Rotation-Invariant Convolutional Neural Networks for Lung Texture Classification

IEEE Journal of Biomedical and Health Informatics

Volumn 22, Issue 1, 2018, Pages 184-195

  Wang, Qiangchang ^a   Zheng, Yuanjie ^b   Yang, Gongping ^a   Jin, Weidong ^c   Chen, Xinjian ^d   Yin, Yilong ^a  

^a SHANDONG UNIVERSITY   (China)

^b SHANDONG NORMAL UNIVERSITY   (China)

^c University of Finance and Economics   (China)

^d SOOCHOW UNIVERSITY   (China)

Author keywords

Convolutional neural network (CNN); gabor filter; interstitial lung disease (ILD) classification; local binary pattern (LBP); lung classification

Indexed keywords

BIOLOGICAL ORGANS; COMPUTERIZED TOMOGRAPHY; CONVOLUTION; GABOR FILTERS; TEXTURES;

ADJACENT PATCHES; HIGH-RESOLUTION COMPUTED TOMOGRAPHY; INTERSTITIAL LUNG DISEASE; LOCAL BINARY PATTERNS; NUMBER OF SAMPLES; ROTATION INVARIANT; STATE OF THE ART; TEXTURE CLASSIFICATION;

CONVOLUTIONAL NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; BAYESIAN LEARNING; COMPARATIVE STUDY; CONCEPTUAL FRAMEWORK; DECISION TREE; DISCRIMINATION LEARNING; EMPHYSEMA; HIGH RESOLUTION COMPUTER TOMOGRAPHY; HISTOGRAM; HUMAN; IMAGE ANALYSIS; INTERSTITIAL LUNG DISEASE; K NEAREST NEIGHBOR; KERNEL METHOD; LUNG EXAMINATION; LUNG FIBROSIS; LUNG NODULE; LUNG PARENCHYMA; MACHINE LEARNING; MATHEMATICAL MODEL; MEASUREMENT ACCURACY; MEASUREMENT PRECISION; MULTISCALE ROTATION INVARIANT CONVOLUTIONAL NEURAL NETWORK MODEL; NERVE CELL NETWORK; RANDOM FOREST; SUPPORT VECTOR MACHINE; VISUAL CORTEX; ALGORITHM; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; DIAGNOSTIC IMAGING; LUNG; PROCEDURES;

ALGORITHMS; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; LUNG; LUNG DISEASES, INTERSTITIAL; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED;

EID: 85040364846     PISSN: 21682194     EISSN: 21682208     Source Type: Journal    
DOI: 10.1109/JBHI.2017.2685586     Document Type: Article

References (66)

1. W. R. Webb, N. L. Muller, and D. P. Naidich, High-Resolution CT of the Lung. Baltimore, MD: Williams & Wilkins, 2014.
2. R. F. Wagner, M. F. Insana, D. G. Brown, B. S. Garra, and R. J. Jennings, "Texture discrimination: Radiologist, machine and man, " Vis.: Coding Efficiency, vol. 558, pp. 310-318, 1990.
3. R. Kakinuma et al., "Detection failures in spiral CT screening for lung cancer: Analysis of CT findings 1, " Radiology, vol. 212, no. 1, pp. 61-66, 1999.
4. Y. Song, W. Cai, Y. Zhou, and D. D. Feng, "Feature-based image patch approximation for lung tissue classification, " IEEE Trans. Med. Imag., vol. 32, no. 4, pp. 797-808, Apr. 2013.
5. M. Asherov, I. Diamant, and H. Greenspan, "Lung texture classification using bag of visual words, " in Proc. SPIE, vol. 9035, 2014, Art. no. 90 352K.
6. A. Depeursinge, D. Van de Ville, A. Platon, A. Geissbuhler, P.-A. Poletti, and H. Müller, "Near-affine-invariant texture learning for lung tissue analysis using isotropic wavelet frames, " IEEE Trans. Inf. Technol. Biomed., vol. 16, no. 4, pp. 665-675, Jul. 2012.
7. M. Anthimopoulos, S. Christodoulidis, A. Christe, and S. Mougiakakou, "Classification of interstitial lung disease patterns using local DCT features and random forest, " in Proc. 2014 36th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., 2014, pp. 6040-6043.
8. Y. Xu, M. Sonka, G. McLennan, J. Guo, and E. A. Hoffman, "MDCTbased 3-D texture classification of emphysema and early smoking related lung pathologies, " IEEE Trans. Med. Imag., vol. 25, no. 4, pp. 464-475, Apr. 2006.
9. Y. Song et al., "Discriminative data transform for image feature extraction and classification, " in Proc. Med. Image Comput. Comput.-Assisted Intervention, Springer-Verlag, 2013, pp. 452-459.
10. A. Depeursinge et al., "Fusing visual and clinical information for lung tissue classification in high-resolution computed tomography, " Artif. Intell. Med., vol. 50, no. 1, pp. 13-21, 2010.
11. M. Kale, S. Mukhopadhyay, J. K. Dash, M. Garg, and N. Khandelwal, "Differentiation of several interstitial lung disease patterns in HRCT images using support vector machine: Role of databases on performance, " in Proc. SPIE, vol. 9785, 2016, Art. no. 97852Z.
12. V. A. Zavaletta, B. J. Bartholmai, and R. A. Robb, "Nonlinear histogram binning for quantitative analysis of lung tissue fibrosis in high-resolution CT data, " Proc. SPIE, vol. 6511, 2007, Art. no. 65111Q.
13. U. Bagci et al., "Automatic detection and quantification of tree-in-bud (TIB) opacities from CT scans, " IEEE Trans. Biomed. Eng., vol. 59, no. 6, pp. 1620-1632, Jun. 2012.
14. C. Jacobs, C. I. Sánchez, S. C. Saur, T. Twellmann, P. A. de Jong, andB. van Ginneken, "Computer-aided detection of ground glass nodules in thoracic CT images using shape, intensity and context features, " in Proc. Med. Image Comput. Comput.-Assisted Intervention, Springer-Verlag, 2011, pp. 207-214.
15. X. Liu, L. Ma, L. Song, Y. Zhao, X. Zhao, and C. Zhou, "Recognizing common CT imaging signs of lung diseases through a new feature selection method based on fisher criterion and genetic optimization, " IEEE J. Biomed. Health Informat., vol. 19, no. 2, pp. 635-647, Mar. 2015.
16. A. Depeursinge, A. Foncubierta-Rodriguez, D. Van de Ville, and H. Müller, "Lung texture classification using locally-oriented Riesz components, " in Proc. Med. Image Comput. Comput.-Assisted Intervention, Springer-Verlag, 2011, pp. 231-238.
17. A. Depeursinge, A. Foncubierta-Rodriguez, D. Van de Ville, and H. Müller, "Multiscale lung texture signature learning using the Riesz transform, " in Proc. Med. Image Comput. Comput.-Assisted Intervention, Springer-Verlag, 2012, pp. 517-524.
18. L. Sørensen, S. B. Shaker, and M. De Bruijne, "Quantitative analysis of pulmonary emphysema using local binary patterns, " IEEE Trans. Med. Imag., vol. 29, no. 2, pp. 559-569, Feb. 2010.
19. Y. Song, W. Cai, H. Huang, Y. Zhou, Y. Wang, and D. Feng, "Boosted multifold sparse representation with application to ILD classification, " in Proc. 11th Int. Symp. Biomed. Imag., 2014, pp. 1023-1026.
20. Y. Song, W. Cai, H. Huang, Y. Zhou, D. D. Feng, and M. Chen, "Large margin aggregation of local estimates for medical image classification, " in Proc. Med. Image Comput. Comput.-Assisted Intervention, Springer-Verlag, 2014, pp. 196-203.
21. Y. Song et al., "Large margin local estimate with applications to medical image classification, " IEEE Trans. Med. Imag., vol. 34, no. 6, pp. 1362-1377, Jun. 2015.
22. Y. Song, W. Cai, H. Huang, Y. Zhou, Y. Wang, and D. D. Feng, "Localityconstrained subcluster representation ensemble for lung image classification, " Med. Image Anal., vol. 22, no. 1, pp. 102-113, 2015.
23. R. Uppaluri, E. A. Hoffman, M. Sonka, P. G. Hartley, G. W. Hunninghake, and G. McLennan, "Computer recognition of regional lung disease patterns, " Amer. J. Respiratory Critical CareMed., vol. 160, no. 2, pp. 648-654, 1999.
24. B. Foster, U. Bagci, A. Mansoor, Z. Xu, and D. J. Mollura, "A review on segmentation of positron emission tomography images, " Comput. Biol. Med., vol. 50, pp. 76-96, 2014.
25. U. Bagci, K. Jaster-Miller, K. N. Olivier, J. Yao, and D. J. Mollura, "Synergistic combination of clinical and imaging features predicts abnormal imaging patterns of pulmonary infections, " Comput. Biol. Med., vol. 43, no. 9, pp. 1241-1251, 2013.
26. G. E. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithm for deep belief nets, " Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006.
27. H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng, "Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations, " in Proc. 26th Annu. Int. Conf. Mach. Learn., ACM, 2009, pp. 609-616.
28. H.-I. Suk et al., "Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis, " NeuroImage, vol. 101, pp. 569-582, 2014.
29. J. Xu et al., "Stacked sparse autoencoder (SSAE) for nuclei detection on breast cancer histopathology images, " IEEE Trans. Med. Imag., vol. 35, no. 1, pp. 119-130, Jan. 2016.
30. Q. Li, W. Cai, and D. D. Feng, "Lung image patch classification with automatic feature learning, " in Proc. 2013 35th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., 2013, pp. 6079-6082.
31. G. van Tulder and M. de Bruijne, "Learning features for tissue classification with the classification restricted Boltzmann machine, " in Proc. Med. Comput. Vis.: Algorithms Big Data, Springer, 2014, pp. 47-58.
32. G. van Tulder and M. de Bruijne, "Combining generative and discriminative representation learning for lung CT analysis with convolutional restricted Boltzmann machines, " IEEE Trans. Med. Imag., vol. 35, no. 5, pp. 1262-1272, May 2016.
33. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks, " in Adv. Neural Inf. Process. Syst., 2012, pp. 1097-1105.
34. C. Szegedy et al., "Going deeper with convolutions, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2015, pp. 1-9.
35. D. Ciresan, A. Giusti, L. M. Gambardella, and J. Schmidhuber, "Deep neural networks segment neuronal membranes in electron microscopy images, " in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 2843-2851.
36. D. C. Cireşan, A. Giusti, L. M. Gambardella, and J. Schmidhuber, "Mitosis detection in breast cancer histology images with deep neural networks, " in Proc. Med. Image Comput. Comput.-Assisted Intervention, Springer, 2013, pp. 411-418.
37. A. Prasoon, K. Petersen, C. Igel, F. Lauze, E. Dam, and M. Nielsen, "Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network, " in Proc. Med. Image Comput. Comput.-Assisted Intervention, Springer 2013, pp. 246-253.
38. W. Zhang et al., "Deep convolutional neural networks for multi-modality isointense infant brain image segmentation, " NeuroImage, vol. 108, pp. 214-224, 2015.
39. F. Li, L. Tran, K.-H. Thung, S. Ji, D. Shen, and J. Li, "A robust deep model for improved classification of AD/MCI patients, " IEEE J. Biomed. Health Informat., vol. 19, no. 5, pp. 1610-1616, Sep. 2015.
40. M. Buty, Z. Xu, M. Gao, U. Bagci, A. Wu, and D. J. Mollura, "Characterization of lung nodule malignancy using hybrid shape and appearance features, " in Proc. Int. Conf. Med. Image Comput. Comput.-Assisted Intervention, Springer, 2016, pp. 662-670.
41. Q. Li, W. Cai, X. Wang, Y. Zhou, D. D. Feng, and M. Chen, "Medical image classification with convolutional neural network, " in Proc. 2014 13th Int. Conf. Control Autom. Robot. Vis., 2014, pp. 844-848.
42. M. Gao et al., "Holistic classification of CT attenuation patterns for interstitial lung diseases via deep convolutional neural networks, " in Proc. Comput. Methods Biomech. Biomed. Eng.: Imag. Vis., 2016, pp. 1-6.
43. S. R. Tarando, C. Fetita, A. Faccinetto, and P. Yves, "Increasing cad system efficacy for lung texture analysis using a convolutional network, " Proc. SPIE, vol. 9785, 2016, Art. no. 97850Q.
44. M. Anthimopoulos, S. Christodoulidis, L. Ebner, A. Christe, and S. Mougiakakou, "Lung pattern classification for interstitial lung diseases using a deep convolutional neural network, " IEEE Trans. Med. Imag., vol. 35, no. 5, pp. 1207-1216, May 2016.
45. H.-C. Shin et al., "Deep convolutional neural networks for computeraided detection: CNN architectures, dataset characteristics and transfer learning, " IEEE Trans. Med. Imag., vol. 35, no. 5, pp. 1285-1298, May 2016.
46. T. S. Cohen and M. Welling, "Transformation properties of learned visual representations, " arXiv: 1412. 7659, 2014.
47. K. Lenc and A. Vedaldi, "Understanding image representations by measuring their equivariance and equivalence, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 991-999.
48. A. Depeursinge, A. Vargas, A. Platon, A. Geissbuhler, P.-A. Poletti, and H. Müller, "Building a reference multimedia database for interstitial lung diseases, " Comput. Med. Imag. Graph., vol. 36, no. 3, pp. 227-238, 2012.
49. N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, "Smote: Synthetic minority over-sampling technique, " J. Artif. Intell. Res., vol. 16, no. 1, pp. 321-357, 2011.
50. P. Cao, D. Zhao, and O. Zaiane, An Optimized Cost-Sensitive SVM for Imbalanced Data Learning. Berlin, Germany: Springer-Verlag, 2013.
51. B. Wang and N. Japkowicz, "Imbalanced data set learning with synthetic samples, " in Proc. IRIS Mach. Learn. Workshop, 2004, p. 19.
52. W. Zhang, S. Shan, W. Gao, X. Chen, and H. Zhang, "Local Gabor binary pattern histogram sequence (LGBPHS): A novel non-statistical model for face representation and recognition, " in Proc. 10th IEEE Int. Conf. Comput. Vis., 2005, vol. 1, 2005, pp. 786-791.
53. Z. Lei, S. Liao, R. He, M. Pietikainen, and S. Z. Li, "Gabor volume based local binary pattern for face representation and recognition, " in Proc. 8th IEEE Int. Conf. Autom. Face Gesture Recognit., 2008, 2008, pp. 1-6.
54. J. G. Daugman, "Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters, " J. Opt. Soc. Amer. A, vol. 2, no. 7, pp. 1160-1169, 1985.
55. M. S. Al-Tarawneh, "Lung cancer detection using image processing techniques, " Leonardo Electron. J. Practices Technol., vol. 11, no. 21, pp. 147-58, 2012.
56. M. Kakar and D. R. Olsen, "Automatic segmentation and recognition of lungs and lesion from CT scans of thorax, " Comput. Med. Imag. Graph., vol. 33, no. 1, pp. 72-82, 2009.
57. G. Coppini, S. Diciotti, M. Falchini, N. Villari, and G. Valli, "Neural networks for computer-aided diagnosis: Detection of lung nodules in chest radiograms, " IEEE Trans. Inf. Technol. Biomed., vol. 7, no. 4, pp. 344-357, Dec. 2003.
58. A. C. Bovik, M. Clark, and W. S. Geisler, "Multichannel texture analysis using localized spatial filters, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 1, pp. 55-73, Jan. 1990.
59. J. Han and K.-K. Ma, "Rotation-invariant and scale-invariant Gabor features for texture image retrieval, " Image Vis. Comput., vol. 25, no. 9, pp. 1474-1481, 2007.
60. T. Ojala, M. Pietikäinen, and T. Mäenpää, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002.
61. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition, " Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, 1998.
62. Y. Sun, X. Wang, and X. Tang, "Deeply learned face representations are sparse, selective, and robust, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2015, pp. 2892-2900.
63. R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation, " in Proc. 2014 IEEE Conf. Comput. Vis. Pattern Recognit., 2014, pp. 580-587.
64. J. Long, E. Shelhamer, and T. Darrell, "Fully convolutional networks for semantic segmentation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2015, pp. 3431-3440.
65. N. Srivastava, G. E. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: A simple way to prevent neural networks from overfitting, " J. Mach. Learn. Res., vol. 15, no. 1, pp. 1929-1958, 2014.
66. Y. Jia et al., "Caffe: Convolutional architecture for fast feature embedding, " in Proc. ACM Int. Conf. Multimedia, 2014, pp. 675-678.