Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images

IEEE Transactions on Medical Imaging

Volumn 35, Issue 5, 2016, Pages 1196-1206

  Sirinukunwattana, Korsuk ^a   Raza, Shan E Ahmed ^a   Tsang, Yee Wah ^b   Snead, David R J ^b   Cree, Ian A ^b   Rajpoot, Nasir M ^a,c  

^a UNIVERSITY OF WARWICK   (United Kingdom)

^b UNIVERSITY HOSPITALS COVENTRY AND WARWICKSHIRE NHS TRUST   (United Kingdom)

^c QATAR UNIVERSITY   (Qatar)

Author keywords

Convolutional neural network; deep learning; histology image analysis; nucleus detection

Indexed keywords

CONVOLUTION; DISEASES; HISTOLOGY; NEURAL NETWORKS; TISSUE;

CANCEROUS TISSUES; COLORECTAL ADENOCARCINOMA; CONVOLUTIONAL NEURAL NETWORK; DEEP LEARNING; HIGH PROBABILITY; HISTOLOGY IMAGES; LOCALITY SENSITIVES; WHOLE SLIDE IMAGES;

IMAGE ANALYSIS;

ARTICLE; BASAL CELL CARCINOMA; BREAST CANCER; CANCER CLASSIFICATION; CELL NUCLEUS; COLORECTAL CARCINOMA; EOSINOPHIL; FIBROBLAST; HISTOPATHOLOGY; HUMAN; IMAGE ANALYSIS; IMMUNOHISTOCHEMISTRY; LYMPHOCYTE; MACHINE LEARNING; NEUTROPHIL; PROSTATE CANCER; REGRESSION ANALYSIS; SPATIALLY CONSTRAINED CONVOLUTIONAL NEURAL NETWORK; SUPPORT VECTOR MACHINE; ARTIFICIAL NEURAL NETWORK; CELL PROLIFERATION; COLON; COLON TUMOR; COMPUTER ASSISTED DIAGNOSIS; CYTOCHEMISTRY; CYTOLOGY; DIAGNOSTIC IMAGING; PHYSIOLOGY; PROCEDURES;

CELL NUCLEUS; CELL PROLIFERATION; COLON; COLONIC NEOPLASMS; HISTOCYTOCHEMISTRY; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MACHINE LEARNING; NEURAL NETWORKS (COMPUTER);

EID: 84968542311     PISSN: 02780062     EISSN: 1558254X     Source Type: Journal    
DOI: 10.1109/TMI.2016.2525803     Document Type: Article

References (38)

1. P. Dalerba et al., "Single-cell dissection of transcriptional heterogeneity in human colon tumors," Nature Biotechnol., vol. 29, no. 12, pp. 1120-1127, 2011.
2. C. A. O'Brien, A. Pollett, S. Gallinger, and J. E. Dick, "A human colon cancer cell capable of initiating tumour growth in immunodeficient mice," Nature, vol. 445, no. 7123, pp. 106-110, 2007.
3. A. Basavanhally et al., "Multi-field-of-view strategy for image-based outcome prediction of multi-parametric estrogen receptor-positive breast cancer histopathology: Comparison to oncotype dx," J. Pathol. Informat., vol. 2, 2011.
4. J. S. Lewis, Jr., S. Ali, J. Luo, W. L. Thorstad, and A. Madabhushi, "A quantitative histomorphometric classifier (QuHbIC) identifies aggressive versus indolent-positive oropharyngeal squamous cell carcinoma," Am. J. Surg. Pathol., vol. 38, no. 1, pp. 128-137, 2014.
5. G. N. van Muijen et al., "Cell type heterogeneity of cytokeratin expression in complex epithelia and carcinomas as demonstrated by monoclonal antibodies specific for cytokeratins nos. 4 and 13," Exp. Cell Res., vol. 162, no. 1, pp. 97-113, 1986.
6. H. Irshad, A. Veillard, L. Roux, and D. Racoceanu, "Methods for nuclei detection, segmentation, and classification in digital histopathology: A review. current status and future potential," IEEE Rev. Biomed. Eng., vol. 7, pp. 97-114, 2014.
7. J. Xu et al., "Stacked sparse autoencoder (SSAE) for nuclei detection on breast cancer histopathology images," IEEE Trans. Med. Imag., vol. 35, no. 1, pp. 119-130, Jan. 2016.
8. D. C. Cireşan, A. Giusti, L. M. Gambardella, and J. Schmidhuber, "Mitosis detection in breast cancer histology images with deep neural networks," in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2013. New York: Springer, 2013, pp. 411-418.
9. Y. Yuan et al., "Quantitative image analysis of cellular heterogeneity in breast tumors complements genomic profiling," Sci. Translat. Med., vol. 4, no. 157, p. 157ra143, 2012.
10. D. Ciresan, A. Giusti, L. M. Gambardella, and J. Schmidhuber, "Deep neural networks segment neuronal membranes in electron microscopy images," in Adv. Neural Inf. Process. Syst., 2012, pp. 2843-2851.
11. O. Ronneberger, P. Fischer, and T. Brox, "U-Net: Convolutional networks for biomedical image segmentation," in Medical Image Computing and Computer-Assisted Intervention - MICCAI. New York: Springer, 2015, pp. 234-241.
12. M. Veta, J. Pluim, P. v. Diest, and M. Viergever, "Breast cancer histopathology image analysis: A review," IEEE Trans. Biomed. Eng., vol. 61, no. 5, pp. 1400-1411, May 2014.
13. E. Cosatto, M. Miller, H. P. Graf, and J. S. Meyer, "Grading nuclear pleomorphism on histological micrographs," in Proc. 19th Int. Conf. IEEE Pattern Recognit., 2008, pp. 1-4.
14. Y. Al-Kofahi, W. Lassoued, W. Lee, and B. Roysam, "Improved automatic detection and segmentation of cell nuclei in histopathology images," IEEE Trans. Biomed. Eng., vol. 57, no. 4, pp. 841-852, Apr. 2010.
15. M. Kuse, Y.-F. Wang, V. Kalasannavar, M. Khan, and N. Rajpoot, "Local isotropic phase symmetry measure for detection of beta cells and lymphocytes," J. Pathol. Informat., vol. 2, no. 2, p. 2, 2011.
16. M. Veta et al., "Automatic nuclei segmentation in H&E stained breast cancer histopathology images," PLoS ONE, vol. 8, no. 7, p. E70221, 2013.
17. C. Arteta, V. Lempitsky, J. A. Noble, and A. Zisserman, "Learning to detect cells using non-overlapping extremal regions," in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2012. New York: Springer, 2012, pp. 348-356.
18. S. Ali and A. Madabhushi, "An integrated region-, boundary-, shape-based active contour for multiple object overlap resolution in histological imagery," IEEE Trans. Med. Imag., vol. 31, no. 7, pp. 1448-1460, Jul. 2012.
19. J. P. Vink, M. V. Leeuwen, C. V. Deurzen, and G. D. Haan, "Efficient nucleus detector in histopathology images," J. Microsc., vol. 249, no. 2, pp. 124-135, 2013.
20. J.-R. Dalle, H. Li, C.-H. Huang, W. K. Leow, D. Racoceanu, and T. C. Putti, "Nuclear pleomorphism scoring by selective cell nuclei detection," in WACV, 2009.
21. C. D. Malon and E. Cosatto, "Classification of mitotic figures with convolutional neural networks and seeded blob features," J. Pathol. Informat., vol. 4, 2013.
22. K. Nguyen, A. K. Jain, and B. Sabata, "Prostate cancer detection: Fusion of cytological and textural features," J. Pathol. Informat., vol. 2, 2011.
23. M. Arif and N. Rajpoot, "Classification of potential nuclei in prostate histology images using shape manifold learning," in Proc. IEEE Int. Conf. Mach. Vis., 2007, pp. 113-118.
24. H. Sharma et al., "A multi-resolution approach for combining visual information using nuclei segmentation and classification in histopathological images," in Proc. 10th Int. Conf. Comput. Vis. Theory Appl., 2015, pp. 37-46.
25. H. Wang et al., "Cascaded ensemble of convolutional neural networks and handcrafted features for mitosis detection," in Proc. SPIE Med. Imag., 2014, pp. 90410B-90410B-10.
26. A. A. Cruz-Roa, J. E. A. Ovalle, A. Madabhushi, and F. A. G. Osorio, "A deep learning architecture for image representation, visual interpretability and automated basal-cell carcinoma cancer detection," in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2013. New York: Springer, 2013, pp. 403-410.
27. Y. Xie, F. Xing, X. Kong, H. Su, and L. Yang, "Beyond classification: Structured regression for robust cell detection using convolutional neural network," in Medical Image Computing and Computer-Assisted Intervention - MICCAI 2015. New York: Springer, 2015, pp. 358-365.
28. Y. Xie, X. Kong, F. Xing, F. Liu, H. Su, and L. Yang, "Deep voting: A robust approach toward nucleus localization in microscopy images," in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015. New York: Springer, 2015, pp. 374-382.
29. C. M. Bishop, Pattern Recognition and Machine Learning. New York: Springer, 2006.
30. K. P. Murphy, Machine Learning: A Probabilistic Perspective. Cambridge, MA: MIT Press, 2012.
31. H. Larochelle, Y. Bengio, J. Louradour, and P. Lamblin, "Exploring strategies for training deep neural networks," J. Mach. Learn. Res., vol. 10, pp. 1-40, 2009.
32. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Adv. Neural Inf. Process. Syst., 2012, pp. 1097-1105.
33. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: A simple way to prevent neural networks from overfitting," J. Mach. Learn. Res. vol. 15, pp. 1929-1958, 2014.
34. A. Vedaldi and K. Lenc, "Matconvnet - Convolutional neural networks for matlab," CoRR, vol. Abs/1412.4564, 2014.
35. A. M. Khan, N. Rajpoot, D. Treanor, and D. Magee, "A nonlinear mapping approach to stain normalization in digital histopathology images using image-specific color deconvolution," IEEE Trans. Biomed. Eng., vol. 61, no. 6, pp. 1729-1738, Jun. 2014.
36. D. J. Hand and R. J. Till, "A simple generalisation of the area under the ROC curve for multiple class classification problems," Mach. Learn., vol. 45, no. 2, pp. 171-186, 2001.
37. K. Sirinukunwattana, D. R. Snead, and N. M. Rajpoot, "A novel texture descriptor for detection of glandular structures in colon histology images," in SPIE Med. Imag. Int. Soc. Opt. Photon., 2015, p. 94200S.
38. B. Mitrovic, D. F. Schaeffer, R. H. Riddell, and R. Kirsch, "Tumor budding in colorectal carcinoma: time to take notice," Modern Pathol., vol. 25, no. 10, pp. 1315-1325, 2012.