DCAN: Deep contour-aware networks for object instance segmentation from histology images

Medical Image Analysis

Volumn 36, Issue , 2017, Pages 135-146

  Chen, Hao ^a   Qi, Xiaojuan ^a   Yu, Lequan ^a   Dou, Qi ^a   Qin, Jing ^b   Heng, Pheng Ann ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Deep contour aware network; Deep learning; Histopathological image analysis; Instance segmentation; Object detection; Transfer learning

Indexed keywords

DEEP LEARNING; HISTOLOGY; OBJECT DETECTION;

AUTOMATED DETECTION; CONVOLUTIONAL NETWORKS; HISTOLOGICAL STRUCTURE; HISTOPATHOLOGICAL IMAGE ANALYSIS; QUANTITATIVE DIAGNOSIS; SEGMENTATION PERFORMANCE; SUPERVISION MECHANISMS; TRANSFER LEARNING;

IMAGE SEGMENTATION;

ACCURACY; ARTICLE; DEEP CONTOUR AWARE NETWORK; EVALUATION STUDY; FULLY CONVOLUTIONAL NETWORK; HISTOPATHOLOGY; HUMAN; IMAGE ANALYSIS; IMAGE PROCESSING; IMAGE SEGMENTATION; MORPHOMETRICS; PRIORITY JOURNAL; PROBABILITY; QUALITATIVE ANALYSIS; QUANTITATIVE ANALYSIS; COLORECTAL TUMOR; DIAGNOSTIC IMAGING; HISTOLOGY; MACHINE LEARNING; PATHOLOGY; PROCEDURES;

COLORECTAL NEOPLASMS; HISTOLOGICAL TECHNIQUES; HUMANS; MACHINE LEARNING;

EID: 84997796752     PISSN: 13618415     EISSN: 13618423     Source Type: Journal    
DOI: 10.1016/j.media.2016.11.004     Document Type: Article

References (78)

1. Al-Kofahi, Y., Lassoued, W., Lee, W., Roysam, B., Improved automatic detection and segmentation of cell nuclei in histopathology images. IEEE Trans. Biomed. Eng. 57:4 (2010), 841–852.
2. Altunbay, D., Cigir, C., Sokmensuer, C., Gunduz-Demir, C., Color graphs for automated cancer diagnosis and grading. IEEE Trans. Biomed. Eng. 57:3 (2010), 665–674.
3. Bartels, P., Thompson, D., Bibbo, M., Weber, J., Bayesian belief networks in quantitative histopathology. Anal. Quant. Cytol. Histol./Int. Acad. Cytol. Am. Soc. Cytol. 14:6 (1992), 459–473.
4. Bertasius, G., Shi, J., Torresani, L., High-for-low and low-for-high: efficient boundary detection from deep object features and its applications to high-level vision. Proceedings of the IEEE International Conference on Computer Vision, 2015, 504–512.
5. Bertasius, G., Shi, J., Torresani, L., Semantic segmentation with boundary neural fields. CoRR, 2015 arXiv preprint arXiv: 1511.02674.
6. Chen, H., Dou, Q., Ni, D., Cheng, J.-Z., Qin, J., Li, S., Heng, P.-A., Automatic fetal ultrasound standard plane detection using knowledge transferred recurrent neural networks. Proceedings of Medical Image Computing and Computer Assisted Intervention, MICCAI, 2015, Springer, 507–514.
7. Chen, H., Dou, Q., Wang, X., Qin, J., Heng, P.A., Mitosis detection in breast cancer histology images via deep cascaded networks. Proceedings of thirtieth AAAI Conference on Artificial Intelligence, 2016.
8. Chen, H., Qi, X., Cheng, J.-Z., Heng, P.-A., Deep contextual networks for neuronal structure segmentation. Proceedings of thirtieth AAAI Conference on Artificial Intelligence, 2016.
9. Chen, H., Qi, X., Yu, L., Heng, P.-A., Dcan: deep contour-aware networks for accurate gland segmentation. Proceedings of Computer Vision and Pattern Recognition, CVPR, 2016.
10. Chen, H., Shen, C., Qin, J., Ni, D., Shi, L., Cheng, J.C., Heng, P.-A., Automatic localization and identification of vertebrae in spine CT via a joint learning model with deep neural networks. Proceedings of Medical Image Computing and Computer Assisted Intervention, MICCAI, 2015, Springer, 515–522.
11. Chen, H., Zheng, Y., Park, J.-H., Heng, P.-A., Zhou, S.K., Iterative multi-domain regularized deep learning for anatomical structure detection and segmentation from ultrasound images. Proceedings of International Conference on Medical Image Computing and Computer-Assisted Intervention, 2016, Springer, 487–495.
12. Chen, L.-C., Barron, J.T., Papandreou, G., Murphy, K., Yuille, A.L., Semantic image segmentation with task-specific edge detection using cnns and a discriminatively trained domain transform. CoRR, 2015 arXiv preprint arXiv: 1511.03328.
13. Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L., Semantic image segmentation with deep convolutional nets and fully connected CRFs. Proceedings of International Conference on Learning Representations, ICLR, 2015.
14. Cheng, J., Rajapakse, J.C., Segmentation of clustered nuclei with shape markers and marking function. IEEE Trans. Biomed. Eng. 56:3 (2009), 741–748.
15. Ciresan, D., Giusti, A., Gambardella, L.M., Schmidhuber, J., Deep neural networks segment neuronal membranes in electron microscopy images. Proceedings of Neural Information Processing Systems, NIPS, 2012, 2843–2851.
16. Cireşan, D.C., Giusti, A., Gambardella, L.M., Schmidhuber, J., Mitosis detection in breast cancer histology images with deep neural networks. Proceedings of Medical Image Computing and Computer-Assisted Intervention, MICCAI 2013, 2013, Springer, 411–418.
17. Cruz-Roa, A.A., Ovalle, J.E.A., Madabhushi, A., Osorio, F.A.G., A deep learning architecture for image representation, visual interpretability and automated basal-cell carcinoma cancer detection. Proceedings of Medical Image Computing and Computer-Assisted Intervention, MICCAI 2013, 2013, Springer, 403–410.
18. Dhungel, N., Carneiro, G., Bradley, A.P., Deep learning and structured prediction for the segmentation of mass in mammograms. Proceedings of Medical Image Computing and Computer Assisted Intervention, MICCAI, 2015, Springer, 605–612.
19. Diamond, J., Anderson, N.H., Bartels, P.H., Montironi, R., Hamilton, P.W., The use of morphological characteristics and texture analysis in the identification of tissue composition in prostatic neoplasia. Hum. Pathol. 35:9 (2004), 1121–1131.
20. Dou, Q., Chen, H., Jin, Y., Yu, L., Qin, J., Heng, P.-A., 3d deeply supervised network for automatic liver segmentation from ct volumes. Proceedings of International Conference on Medical Image Computing and Computer-Assisted Intervention, 2016, Springer, 149–157.
21. Dou, Q., Chen, H., Lequan, Y., Zhao, L., Qin, J., Defeng, W., Vincent, M., Shi, L., Heng, P.A., Automatic detection of cerebral microbleeds from MR images via 3D convolutional neural networks. IEEE Trans. Med. Imaging 35:5 (2016), 1182–1195.
22. Doyle, S., Madabhushi, A., Feldman, M., Tomaszeweski, J., A boosting cascade for automated detection of prostate cancer from digitized histology. Proceedings of Medical Image Computing and Computer Assisted Intervention, MICCAI, 2006, Springer, 504–511.
23. Dunne, B., Going, J., Scoring nuclear pleomorphism in breast cancer. Histopathology 39:3 (2001), 259–265.
24. Elston, C.W., Ellis, I.O., et al. Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up. Histopathology 19:5 (1991), 403–410.
25. Everingham, M., Van Gool, L., Williams, C.K., Winn, J., Zisserman, A., The pascal visual object classes (voc) challenge. Int. J. Comput. Vis. 88:2 (2010), 303–338.
26. Fakhrzadeh, A., Sporndly-Nees, E., Holm, L., Hendriks, C.L.L., Analyzing tubular tissue in histopathological thin sections. Proceedings of 2012 International Conference on Digital Image Computing Techniques and Applications, DICTA, 2012, IEEE, 1–6.
27. Farjam, R., Soltanian-Zadeh, H., Jafari-Khouzani, K., Zoroofi, R.A., An image analysis approach for automatic malignancy determination of prostate pathological images. Cytometry Part B: Clin. Cytom. 72:4 (2007), 227–240.
28. Fleming, M., Ravula, S., Tatishchev, S.F., Wang, H.L., Colorectal carcinoma: pathologic aspects. J. Gastrointest. Oncol. 3:3 (2012), 153–173.
29. Fu, H., Qiu, G., Shu, J., Ilyas, M., A novel polar space random field model for the detection of glandular structures. IEEE Trans. Med. Imaging 33:3 (2014), 764–776.
30. Gleason, D.F., Histologic grading of prostate cancer: a perspective. Hum. Pathol. 23:3 (1992), 273–279.
31. Greenspan, H., van Ginneken, B., Summers, R.M., Guest editorial deep learning in medical imaging: overview and future promise of an exciting new technique. IEEE Trans. Med. Imaging 35:5 (2016), 1153–1159.
32. Gunduz-Demir, C., Kandemir, M., Tosun, A.B., Sokmensuer, C., Automatic segmentation of colon glands using object-graphs. Med. Image Anal. 14:1 (2010), 1–12.
33. Gurcan, M.N., Boucheron, L.E., Can, A., Madabhushi, A., Rajpoot, N.M., Yener, B., Histopathological image analysis: a review. IEEE Rev. Biomed. Eng. 2 (2009), 147–171.
34. Hamilton, P., Anderson, N., Bartels, P., Thompson, D., Expert system support using bayesian belief networks in the diagnosis of fine needle aspiration biopsy specimens of the breast. J. Clin. Pathol. 47:4 (1994), 329–336.
35. Hariharan, B., Arbeláez, P., Girshick, R., Malik, J., Simultaneous detection and segmentation. Proceedings of European Conference on Computer Vision, ECCV, 2014, Springer, 297–312.
36. Hinton, G.E., Srivastava, N., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.R., Improving neural networks by preventing co-adaptation of feature detectors. CoRR, 2012 arXiv preprint arXiv: 1207.0580.
37. Irshad, H., Veillard, A., Roux, L., Racoceanu, D., Methods for nuclei detection, segmentation, and classification in digital histopathology: a reviewcurrent status and future potential. IEEE Rev. Biomed. Eng. 7 (2014), 97–114.
38. Irshad, H., et al. Automated mitosis detection in histopathology using morphological and multi-channel statistics features. J. Pathol. Inform., 4(1), 2013, 10.
39. Isabella, N., Lu, L., Xiaosong, W., Roth, H.R., Nathan, L., Jianbo, S., Y., T., Summers, R.M., Automatic lymph node cluster segmentation using holistically-nested networks and structured optimization. Proceedings of Medical Image Computing and Computer-Assisted Intervention, MICCAI 2016, 2016.
40. Jacobs, J.G., Panagiotaki, E., Alexander, D.C., Gleason grading of prostate tumours with max-margin conditional random fields. Machine Learning in Medical Imaging, 2014, Springer, 85–92.
41. Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T., Caffe: convolutional architecture for fast feature embedding. Proceedings of the 22nd ACM international conference on Multimedia, 2014, ACM, 675–678.
42. Jung, C., Kim, C., Segmenting clustered nuclei using h-minima transform-based marker extraction and contour parameterization. IEEE Trans. Biomed. Eng. 57:10 (2010), 2600–2604.
43. Kainz, P., Pfeiffer, M., Urschler, M., Semantic segmentation of colon glands with deep convolutional neural networks and total variation segmentation. CoRR, 2015 arXiv preprint arXiv: 1511.06919.
44. Khan, A.M., Rajpoot, N., Treanor, D., Magee, D., A nonlinear mapping approach to stain normalization in digital histopathology images using image-specific color deconvolution. IEEE Trans. Biomed. Eng. 61:6 (2014), 1729–1738.
45. Krizhevsky, A., Sutskever, I., Hinton, G.E., Imagenet classification with deep convolutional neural networks. Proceedings of Neural Information Processing Systems, NIPS, 2012, 1097–1105.
46. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P., Gradient-based learning applied to document recognition. Proc. IEEE 86:11 (1998), 2278–2324.
47. Lee, C., Xie, S., Gallagher, P., Zhang, Z., Tu, Z., Deeply-supervised nets. Proceedings of International Conference on Artificial Intelligence and Statistics, AISTATS, 2015.
48. Long, J., Shelhamer, E., Darrell, T., Fully convolutional networks for semantic segmentation. Proceedings of Computer Vision and Pattern Recognition, CVPR, 2015, 3431–3440.
49. Meijering, E., Cell segmentation: 50 years down the road [life sciences]. IEEE Signal Process. Mag. 29:5 (2012), 140–145.
50. Naik, S., Doyle, S., Agner, S., Madabhushi, A., Feldman, M., Tomaszewski, J., Automated gland and nuclei segmentation for grading of prostate and breast cancer histopathology. Proceedings of 5th IEEE International Symposium on Biomedical Imaging, 2008, IEEE, 284–287.
51. Nguyen, K., Jain, A.K., Sabata, B., et al. Prostate cancer detection: fusion of cytological and textural features. J. Pathol. Inform., 2(2), 2011, 3.
52. Nguyen, K., Sarkar, A., Jain, A.K., Structure and context in prostatic gland segmentation and classification. Proceedings of Medical Image Computing and Computer Assisted Intervention, MICCAI, 2012, Springer, 115–123.
53. Plissiti, M.E., Nikou, C., Overlapping cell nuclei segmentation using a spatially adaptive active physical model. IEEE Trans. Image Process. 21:11 (2012), 4568–4580.
54. Ronneberger, O., Fischer, P., Brox, T., U-net: convolutional networks for biomedical image segmentation. Proceedings of Medical Image Computing and Computer Assisted Intervention, MICCAI, 2015, Springer, 234–241.
55. Roth, H.R., Lu, L., Farag, A., Shin, H.-C., Liu, J., Turkbey, E.B., Summers, R.M., Deeporgan: multi-level deep convolutional networks for automated pancreas segmentation. Proceedings of Medical Image Computing and Computer Assisted Intervention, MICCAI, 2015, Springer, 556–564.
56. Roth, H.R., Lu, L., Farag, A., Sohn, A., Summers, R.M., Spatial aggregation of holistically-nested networks for automated pancreas segmentation. Proceedings of Medical Image Computing and Computer-Assisted Intervention, MICCAI 2016, 2016.
57. Roux, L., Racoceanu, D., Loménie, N., Kulikova, M., Irshad, H., Klossa, J., Capron, F., Genestie, C., Le Naour, G., Gurcan, M.N., Mitosis detection in breast cancer histological images an icpr 2012 contest. J. Pathol. Inform. 4 (2013), 1–4.
58. Sabata, B., Babenko, B., Monroe, R., Srinivas, C., Automated analysis of pin-4 stained prostate needle biopsies. Prostate Cancer Imaging, 2010, Springer, 89–100.
59. Shin, H.-C., Roth, H.R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., Summers, R.M., Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans. Med. Imaging 35:5 (2016), 1285–1298.
60. Sirinukunwattana, K., Pluim, J.P.W., Chen, H., Qi, X., Heng, P.-A., Guo, Y.B., Wang, L.Y., Matuszewski, B.J., Bruni, E., Sanchez, U.,andothers, Gland segmentation in colon histology images: the GlaS challenge contest, 2016. arXiv preprint arXiv: 1603.00275.
61. Sirinukunwattana, K., Raza, S.E.A., Tsang, Y.-W., Snead, D.R.J., Cree, I.A., Rajpoot, N.M., Locality sensitive deep learning for detection and classification of nuclei in routine colon cancer histology images. IEEE Trans. Med. Imaging 35:5 (2016), 1196–1206.
62. Sirinukunwattana, K., Snead, D., Rajpoot, N., A stochastic polygons model for glandular structures in colon histology images. IEEE Trans. Med. Imaging 34:11 (2015), 2366–2378.
63. Sirinukunwattana, K., Snead, D.R., Rajpoot, N.M., A novel texture descriptor for detection of glandular structures in colon histology images. SPIE Medical Imaging, 2015, International Society for Optics and Photonics 94200S-94200S.
64. Stierer, M., Rosen, H., Weber, R., Nuclear pleomorphism, a strong prognostic factor in axillary node-negative small invasive breast cancer. Breast Cancer Res. Treat. 20:2 (1991), 109–116.
65. Tabesh, A., Teverovskiy, M., Pang, H.-Y., Kumar, V.P., Verbel, D., Kotsianti, A., Saidi, O., Multifeature prostate cancer diagnosis and gleason grading of histological images. IEEE Trans. Med. Imaging 26:10 (2007), 1366–1378.
66. Tajbakhsh, N., Shin, J.Y., Gurudu, S.R., Hurst, R.T., Kendall, C.B., Gotway, M.B., Liang, J., Convolutional neural networks for medical image analysis: full training or fine tuning?. IEEE Tran. Med. Imaging 35:5 (2016), 1299–1312.
67. Veta, M., Huisman, A., Viergever, M.A., van Diest, P.J., Pluim, J.P., Marker-controlled watershed segmentation of nuclei in h&e stained breast cancer biopsy images. Proceedings of 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro, 2011, IEEE, 618–621.
68. Veta, M., Van Diest, P.J., Willems, S.M., Wang, H., Madabhushi, A., Cruz-Roa, A., Gonzalez, F., Larsen, A.B., Vestergaard, J.S., Dahl, A.B., et al. Assessment of algorithms for mitosis detection in breast cancer histopathology images. Med. Image Anal. 20:1 (2015), 237–248.
69. Weind, K.L., Maier, C.F., Rutt, B.K., Moussa, M., Invasive carcinomas and fibroadenomas of the breast: comparison of microvessel distributions–implications for imaging modalities. Radiology 208:2 (1998), 477–483.
70. Wienert, S., Heim, D., Saeger, K., Stenzinger, A., Beil, M., Hufnagl, P., Dietel, M., Denkert, C., Klauschen, F., Detection and segmentation of cell nuclei in virtual microscopy images: a minimum-model approach. Sci. Rep. 2 (2012), 503–510.
71. Williams, D.R.G.H.R., Hinton, G., Learning representations by back-propagating errors. Nature 323 (1986), 533–536.
72. WU, H.-S., Xu, R., Harpaz, N., Burstein, D., Gil, J., Segmentation of intestinal gland images with iterative region growing. J. Microsc. 220:3 (2005), 190–204.
73. Xie, S., Tu, Z., Holistically-nested edge detection. Proceedings of International Conference on Computer Vision, ICCV, 2015, 1395–1403.
74. Xu, J., Xiang, L., Liu, Q., Gilmore, H., Wu, J., Tang, J., Madabhushi, A., Stacked sparse autoencoder (SSAE) for nuclei detection on breast cancer histopathology images. IEEE Trans. Med. Imaging 35:1 (2016), 119–130.
75. Xu, Y., Li, Y., Liu, M., Wang, Y., Lai, M., Chang, E.I., et al. Gland instance segmentation by deep multichannel side supervision. Proceedings of Medical Image Computing and Computer-Assisted Intervention, MICCAI 2016, 2016.
76. Yosinski, J., Clune, J., Bengio, Y., Lipson, H., How transferable are features in deep neural networks?. Proceedings of Neural Information Processing Systems, NIPS, 2014, 3320–3328.
77. Zhang, Z., Luo, P., Loy, C.C., Tang, X., Facial landmark detection by deep multi-task learning. Proceedings of European Conference on Computer Vision, ECCV, 2014, Springer, 94–108.
78. Zheng, Y., Liu, D., Georgescu, B., Nguyen, H., Comaniciu, D., 3d deep learning for efficient and robust landmark detection in volumetric data. Proceedings of Medical Image Computing and Computer-Assisted Intervention, MICCAI 2015, 2015, Springer, 565–572.