A Deep Convolutional Neural Network for segmenting and classifying epithelial and stromal regions in histopathological images

Neurocomputing

Volumn 191, Issue , 2016, Pages 214-223

  Xu, Jun ^a   Luo, Xiaofei ^a   Wang, Guanhao ^a   Gilmore, Hannah ^b   Madabhushi, Anant ^c  

^a NANJING UNIVERSITY OF INFORMATION SCIENCE AND TECHNOLOGY   (China)

^b UNIVERSITY HOSPITALS OF CLEVELAND   (United States)

^c Case Western Reserve University   (United States)

Author keywords

Breast histopathology; Colorectal cancer; Deep Convolutional Neural Networks; Feature representation; Regions; The classification of epithelial and stromal

Indexed keywords

CONVOLUTION; DEEP NEURAL NETWORKS; DISEASES; EXTRACTION; FEATURE EXTRACTION; HISTOLOGY; IMAGE CLASSIFICATION; IMAGE SEGMENTATION; MACHINE LEARNING; MEDICAL IMAGING; TEXTURES; TUMORS;

BREAST HISTOPATHOLOGY; COLORECTAL CANCER; FEATURE REPRESENTATION; REGIONS; THE CLASSIFICATION OF EPITHELIAL AND STROMAL;

CONVOLUTIONAL NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; BREAST CANCER; CLASSIFIER; COLORECTAL CANCER; DEEP CONVOLUTIONAL NEURAL NETWORK; DIGITAL IMAGING; EPITHELIUM; HISTOPATHOLOGY; HUMAN; IMAGE CLASSIFICATION; IMAGE PROCESSING; IMAGE SEGMENTATION; IMMUNOHISTOCHEMISTRY; PRIORITY JOURNAL; STROMA; SUPPORT VECTOR MACHINE; TISSUE MICROARRAY;

EID: 84977845763     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2016.01.034     Document Type: Article

References (35)

1. R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, S. Susstrunk, SLIC superpixels compared to state-of-the-art superpixel methods, IEEE Trans. Pattern Anal. Mach. Intell. 34 (11) (2012) 2274-2282.
2. S. Ali, et al., Spatially aware cell clusters graphs: predicting outcome in HPV associated oropharyngeal tumors, in: Medical Image Computing and Computer-Assisted Intervention, vol. 8149, 2013, pp. 412-519.
3. T. Amaral, S. McKenna, K. Robertson, A. Thompson, Classification and immunohistochemical scoring of breast tissue microarray spots, IEEE Trans. Biomed. Eng. 60 (October (10)) (2013) 2806-2814.
4. A.H. Beck, et al., Systematic analysis of breast cancer morphology uncovers stromal features associated with survival, Sci. Transl. Med. 3 (2011) 108ra113.
5. Y. Bengio, P. Lamblin, D. Popovici, H. Larochelle, et al., Greedy layer-wise training of deep networks, Adv. Neural Inf. Process. Syst. 19 (2007) 153.
6. F. Bianconi, A. Lvarez Larrn, A. Fernndez, Discrimination between tumour epithelium and stroma via perception-based features, Neurocomputing 154 (0) (2015) 119-126.
7. C.-C. Chang, C.-J. Lin, LIBSVM: a library for support vector machines, ACM Trans. Intell. Syst. Technol. 2 (2011) 27:1-27:27, software available at URL .
8. H. Chang, Y. Zhou, A. Borowsky, K. Barner, P. Spellman, B. Parvin, Stacked predictive sparse decomposition for classification of histology sections, Int. J. Comput. Vis. 113 (1) (2015) 3-18, URL.
9. D.C. Ciresan, et al., Mitosis detection in breast cancer histology images with deep neural networks, in: Medical Image Computing and Computer-Assisted Intervention (MICCAI 2013), Lecture Notes in Computer Science, vol. 8150, Springer, Nagoya, Japan, 2013, pp. 411-418.
10. A. Cruz-Roa, et al., A deep learning architecture for image representation, visual interpretability and automated basal-cell carcinoma cancer detection, in: Medical Image Computing and Computer-Assisted Intervention (MICCAI 2013), vol. 8150, Springer, Nagoya, Japan, 2013, pp. 403-410.
11. O. De Wever, M. Mareel, Role of tissue stroma in cancer cell invasion, J. Pathol. 200 (4) (2003) 429-447.
12. C.L. Downey, S.A. Simpkins, J. White, D.L. Holliday, J.L. Jones, L.B. Jordan, J. Kulka, S. Pollock, S.S. Rajan, H.H. Thygesen, A.M. Hanby, V. Speirs, The prognostic significance of tumour-stroma ratio in oestrogen receptor-positive breast cancer, Br. J. Cancer 110 (April (7)) (2014) 1744-1747, URL.
13. M. Eramian, et al., Segmentation of epithelium in H&E stained odontogenic cysts, J. Microsc. 244 (3) (2011) 273-292.
14. H. Hiary, et al., Automated segmentation of stromal tissue in histology images using a voting Bayesian model, Signal Image Video Process. 7 (6) (2013) 1229-1237, URL.
15. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, T. Darrell, Caffe: convolutional architecture for fast feature embedding. 2014. arXiv preprintarxiv:1408.5093.
16. R. Keys, Cubic convolution interpolation for digital image processing, IEEE Trans. Acoust. Speech Signal Process. 29 (December (6)) (1981) 1153-1160.
17. B. Lahrmann, N. Halama, H.-P. Sinn, P. Schirmacher, D. Jaeger, N. Grabe, Automatic tumor-stroma separation influorescence TMAs enables the quantitative high-throughput analysis of multiple cancer biomarkers, PLoS One 6 (December (12)) (2011) e28048.
18. Y. LeCun, Y. Bengio, G. Hinton, Deep learning, Nature 521 (May (7553)) (2015) 436-444, URL.
19. N. Linder, et al., Identification of tumor epithelium and stroma in tissue microarrays using texture analysis, Diagn. Pathol. 7 (1) (2012) 22, URL.
20. A. Madabhushi, J. Shi, M. Rosen, J. Tomaszeweski, M. Feldman, Graph embedding to improve supervised classification and novel class detection: application to prostate cancer, in: J. Duncan, G. Gerig (Eds.), Medical Image Computing and Computer-Assisted Intervention? MICCAI 2005. Lecture Notes in Computer Science, vol. 3749, Springer, Berlin, Heidelberg, 2005, pp. 729-737.
21. A. Madabhushi, J. Shi, M. Rosen, J. Tomaszeweski, M. Feldman, Graph embedding to improve supervised classification and novel class detection: application to prostate cancer, in: J. Duncan, G. Gerig (Eds.), Medical Image Computing and Computer-Assisted Intervention? MICCAI 2005. Lecture Notes in Computer Science, vol. 3749, Springer, Berlin, Heidelberg, 2005, pp. 729-737.
22. T. Ojala, M. Pietikainen, T. Maenpaa, Multiresolution gray-scale and rotation invariant texture classification with local binary patterns, IEEE Trans. Pattern Anal. Mach. Intell. 24 (July (7)) (2002) 971-987.
23. D. Powers, Evaluation: from Precision, Recall and F-factor to ROC, Informedness, Markedness & Correlation, Technical Report, Adelaide, Australia, 2007.
24. X. Ren, J. Malik, Learning a classification model for segmentation, in: International Conference on Computer Vision (ICCV 2003), vol. 1, 2003, pp. 10-17.
25. J. Shi, J. Malik, Normalized cuts and image segmentation, IEEE Trans. Pattern Anal. Mach. Intell. 22 (8) (2000) 888-905.
26. H. Su, F. Xing, X. Kong, Y. Xie, S. Zhang, L. Yang, Robust cell detection and segmentation in histopathological images using sparse reconstruction and stacked denoising autoencoders, in: N. Navab, J. Hornegger, W. Wells, A. Frangi (Eds.), Medical Image Computing and Computer-Assisted Intervention: MICCAI 2015. Lecture Notes in Computer Science, vol. 9351, Springer International Publishing, Munich, Germany, 2015, pp. 383-390.
27. H. Wang, et al., Mitosis detection in breast cancer pathology images by combining handcrafted and convolutional neural network features, J. Med. Imaging 1 (3) (2014) 034003, URL.
28. D.S. Weller, S. Ramani, J.-F. Nielsen, J.A. Fessler, Monte carlo sure-based parameter selection for parallel magnetic resonance imaging reconstruction, Magn. Reson. Med. 71 (5) (2014) 1760-1770.
29. J. Xu, L. Xiang, R. Hang, J. Wu, Stacked sparse autoencoder (SSAE) based framework for nuclei patch classification on breast cancer histopathology, in: 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI), IEEE, Beijing, China, 2014, pp. 999-1002.
30. J. Xu, L. Xiang, Q. Liu, H. Gilmore, J. Wu, J. Tang, A. Madabhushi, Stacked sparse autoencoder (SSAE) for nuclei detection on breast cancer histopathology images, IEEE Trans. Med. Imaging 35 (January (1)) (2016) 119-130.
31. J. Xu, L. Xiang, G. Wang, S. Ganesan, M. Feldman, N.N. Shih, H. Gilmore, A. Madabhushi, Sparse non-negative matrix factorization (SNMF) based color unmixing for breast histopathological image analysis, Comput. Med. Imaging Graph. 46 (Part 1) (2015) 20-29, sparsity Techniques in Medical Imaging. URL .
32. Y. Yuan, et al., Quantitative image analysis of cellular heterogeneity in breast tumors complements genomic profiling, Sci. Transl. Med. 4 (157) (2012) 157ra143.
33. X. Zhang, W. Liu, M. Dundar, S. Badve, S. Zhang, Towards large-scale histopathological image analysis: hashing-based image retrieval, IEEE Trans. Med. Imaging 34 (February (2)) (2015) 496-506.
34. X. Zhang, W. Liu, S. Zhang, Mining histopathological images via hashing-based scalable image retrieval, in: 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI), April 2014, pp. 1111-1114.
35. X. Zhang, H. Su, L. Yang, S. Zhang, Fine-grained histopathological image analysis via robust segmentation and large-scale retrieval, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015