A deeply supervised residual network for HEp-2 cell classification via cross-modal transfer learning

Pattern Recognition

Volumn 79, Issue , 2018, Pages 290-302

  Lei, Haijun ^a   Han, Tao ^a   Zhou, Feng ^b   Yu, Zhen ^c   Qin, Jing ^c,d   Elazab, Ahmed ^c,e   Lei, Baiying ^c  

^a SHENZHEN UNIVERSITY   (China)

^b UNIVERSITY OF MICHIGAN DEARBORN   (United States)

^c Shenzhen University School of Medicine   (China)

^d HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

^e Misr Higher Institute for Commerce and Computers   (Egypt)

Author keywords

Cross modal transfer learning; Deeply supervised ResNet; HEp 2 cell classification; Residual network

Indexed keywords

CELLS; COMPUTER AIDED DIAGNOSIS; CYTOLOGY; DEEP NEURAL NETWORKS; IMAGE CLASSIFICATION; NETWORK LAYERS; NEURAL NETWORKS;

CLASSIFICATION PERFORMANCE; DEEP CONVOLUTIONAL NEURAL NETWORKS; DEEPLY SUPERVISED RESNET; DISCRIMINATIVE FEATURES; HEP-2 CELLS; INTRA-CLASS VARIATION; STATE-OF-THE-ART PERFORMANCE; TRANSFER LEARNING;

CLASSIFICATION (OF INFORMATION);

EID: 85044647278     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2018.02.006     Document Type: Article

References (60)

1. Foggia, P., Percannella, G., Soda, P., Vento, M., Benchmarking HEp-2 cells classification methods. IEEE Trans. Med. Imaging 32 (2013), 1878–1889.
2. Nosaka, R., Fukui, K., HEp-2 cell classification using rotation invariant co-occurrence among local binary patterns. Pattern Recognit. 47 (2014), 2428–2436.
3. Larsen, A.B., Vestergaard, J.S., Larsen, R., HEp-2 cell classification using shape index histograms with donut-shaped spatial pooling. IEEE Trans. Med. Imaging 33 (2014), 1573–1580.
4. Foggia, P., Percannella, G., Saggese, A., Vento, M., Pattern recognition in stained HEp-2 cells: where are we now?. Pattern Recognit. 47 (2014), 2305–2314.
5. Cheng, C.C., Taur, J.S., Hsieh, T.Y., Tao, C.W., Segmentation of anti-nuclear antibody images based on the watershed approach. Ind. Electron. Appl., 2010, 1695–1700.
6. Zhu, X., Suk, H.I., Lee, S.W., Shen, D., Subspace regularized sparse multitask learning for multiclass neurodegenerative disease identification. IEEE Trans. Biomed. Eng. 63 (2016), 607–618.
7. Zhu, X., Suk, H.I., Lee, S.W., Shen, D., Canonical feature selection for joint regression and multi-class identification in Alzheimer's disease diagnosis. Brain Imaging Behav. 10 (2016), 1–11.
8. Zhu, X., Suk, H.I., Shen, D., A novel matrix-similarity based loss function for joint regression and classification in AD diagnosis. NeuroImage 100 (2014), 91–105.
9. Zhu, X., Li, X., Zhang, S., Block-row sparse multiview multilabel learning for image classification. IEEE Trans. Cybern. 46 (2016), 450–461.
10. Liu, F., Wee, C.-Y., Chen, H., Shen, D., Inter-modality relationship constrained multi-modality multi-task feature selection for Alzheimer's Disease and mild cognitive impairment identification. NeuroImage 84 (2014), 466–475.
11. Ying, S., Wen, Z., Shi, J., Peng, Y., Peng, J., Qiao, H., Manifold preserving: an intrinsic approach for semisupervised distance metric Learning. IEEE Trans. Neural Netw. Learn. Syst. PP (2018), 1–12.
12. Shi, J., Zheng, X., Li, Y., Zhang, Q., Ying, S., Multimodal neuroimaging feature learning with multimodal stacked deep polynomial networks for diagnosis of Alzheimer's disease. IEEE J. Biomed. Health Inf. 22 (2018), 173–183.
13. Jin, Y., Shi, Y., Zhan, L., Gutman, B.A., de Zubicaray, G.I., McMahon, K.L., et al. Automatic clustering of white matter fibers in brain diffusion MRI with an application to genetics. NeuroImage 100 (2014), 75–90.
14. Liu, F., Guo, W., Fouche, J.-P., Wang, Y., Wang, W., Ding, J., et al. Multivariate classification of social anxiety disorder using whole brain functional connectivity. Brain Struct. Funct. 220 (2015), 101–115.
15. Jin, Y., Wee, C.Y., Shi, F., Thung, K.H., Ni, D., Yap, P.T., et al. Identification of infants at high-risk for autism spectrum disorder using multiparameter multiscale white matter connectivity networks. Hum. Brain Mapp. 36 (2015), 4880–4896.
16. Wang, L., Zhou, L., Shen, C., Liu, L., Liu, H., A hierarchical word-merging algorithm with class separability measure. IEEE Trans. Pattern Anal. Mach. Intell. 36 (2014), 417–435.
17. Liu, F., Zhou, L., Shen, C., Yin, J., Multiple kernel learning in the primal for multimodal Alzheimer's disease classification. IEEE J. Biomed. Health Inf. 18 (2014), 984–990.
18. Li, Y., Wang, Y., Wu, G., Shi, F., Zhou, L., Lin, W., et al. Discriminant analysis of longitudinal cortical thickness changes in Alzheimer's disease using dynamic and network features. Neurobiol. Aging 33 (2012), 427.e15–427.e30.
19. Zhang, D., Wang, Y., Zhou, L., Yuan, H., Shen, D., Multimodal classification of Alzheimer's disease and mild cognitive impairment. NeuroImage 55 (2011), 856–867.
20. Zhou, L., Wang, L., Liu, L., Ogunbona, P., Shen, D., Learning discriminative bayesian networks from high-dimensional continuous neuroimaging data. IEEE Trans. Pattern Anal. Mach. Intell. 38 (2016), 2269–2283.
21. Hao, X., Li, C., Yan, J., Yao, X., Risacher, S.L., Saykin, A.J., et al. Identification of associations between genotypes and longitudinal phenotypes via temporally-constrained group sparse canonical correlation analysis. Bioinformatics 33 (2017), i341–i349.
22. Zhang, D., Shen, D., Multi-modal multi-task learning for joint prediction of multiple regression and classification variables in Alzheimer's disease. NeuroImage 59 (2012), 895–907.
23. Zhu, X., Suk, H.-I., Wang, L., Lee, S.-W., Shen, D., A novel relational regularization feature selection method for joint regression and classification in AD diagnosis. Med. Image Anal. 75 (2015), 570–577.
24. Zhu, X., Li, X., Zhang, S., Ju, C., Wu, X., Robust joint graph sparse coding for unsupervised spectral feature selection. IEEE Trans. Neural Netw. Learn. Syst. 28 (2017), 1263–1275.
25. Zhu, X., Suk, H.I., Huang, H., Shen, D., Low-rank graph-regularized structured sparse regression for identifying genetic biomarkers. IEEE Trans. Big Data 3 (2017), 405–414.
26. Zhu, X., Zhang, S., Hu, R., Zhu, Y., S.J, Local and global structure preservation for robust unsupervised spectral feature selection. IEEE Trans. Knowl. Data Eng. 30 (2018), 517–529.
27. Deng, J., Dong, W., Socher, R., Li, L.J., Kai, L., Li, F.-F., ImageNet: a large-scale hierarchical image database. 2009 IEEE Conference on Computer Vision and Pattern Recognition, 2009, 248–255.
28. Yu, Z., Tan, E.L., Ni, D., Qin, J., Chen, S., Li, S., et al. A deep convolutional neural network based framework for automatic fetal facial standard plane recognition. IEEE J. Biomed. Health Inf., 2017, 10.1109/JBHI.2017.2705031.
29. Krizhevsky, A., Sutskever, I., Hinton, G.E., ImageNet classification with deep convolutional neural networks. International Conference on Neural Information Processing Systems, 2012, 1097–1105.
30. Phan, H.T.H., Kumar, A., Kim, J., Feng, D., Transfer learning of a convolutional neural network for HEp-2 cell image classification. 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI), 2016, 1208–1211.
31. Gao, Z., Zhang, J., Zhou, L., Wang, L., HEp-2 cell image classification with convolutional neural networks. 2014 1st Workshop on Pattern Recognition Techniques for Indirect Immunofluorescence Images, 2014, 24–28.
32. Zhao, Z.H., Yang, S.P., Ma, Z.Q., License plate character recognition based on convolutional neural network LeNet-5. J. Syst. Simul. 22 (2010), 638–641.
33. Fu Jie, H., LeCun, Y., Large-scale learning with SVM and convolutional for generic object categorization. 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06), 2006, 284–291.
34. M.D. Zeiler, R. Fergus, Visualizing and Understanding Convolutional Networks, arXiv: 1311.2901, 2013.
35. C.Y. Lee, S. Xie, P. Gallagher, Z. Zhang, and Z. Tu, ``Deeply-supervised nets,” Eprint Arxiv, pp. 562–570, 2014.
36. Simonyan, K., Zisserman, A., Very deep convolutional networks for large-scale image recognition. Comput. Sci., 2014.
37. Ioffe, S., Szegedy, C., Batch normalization: accelerating deep network training by reducing internal covariate shift. Comput. Sci., 2015.
38. He, K., Zhang, X., Ren, S., Sun, J., Deep residual learning for image recognition. Computer Vision and Pattern Recognition, 2015, 770–778.
39. Li, Y., Shen, L., Yu, S., HEp-2 specimen image segmentation and classification using very deep fully convolutional network. IEEE Trans. Med. Imaging, 2017, 10.1109/TMI.2017.2672702.
40. Bengio, Y., Deep learning of representations for unsupervised and transfer learning. presented at the Proc. ICML Workshop Unsupervised Transfer Learn., 2012.
41. Shen, L., Lin, J., Wu, S., Yu, S., HEp-2 image classification using intensity order pooling based features and bag of words. Pattern Recognit. 47 (2014), 2419–2427.
42. Gragnaniello, D., Sansone, C., Verdoliva, L., Biologically-inspired dense local descriptor for indirect immunofluorescence image classification. 2014 1st Workshop on Pattern Recognition Techniques for Indirect Immunofluorescence Images, 2014, 1–5.
43. Rumelhart, D.E., Hinton, G.E., Williams, R.J., Learning Internal Representations By Error Propagation. 1988, MIT Press.
44. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P., Gradient-based learning applied to document recognition. Proc. IEEE 86 (1998), 2278–2324.
45. LeCun, Y., Bengio, Y., Hinton, G., Deep learning. Nature 521 (2015), 436–444.
46. Girshick, R., Donahue, J., Darrell, T., Malik, J., Rich feature hierarchies for accurate object detection and semantic segmentation. presented at the Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014.
47. Long, J., Shelhamer, E., Darrell, T., Fully convolutional networks for semantic segmentation. presented at the Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015.
48. K. Simonyan, A. Zisserman, Very Deep Convolutional Networks for Large-Scale Image Recognition, arXiv: 1409.1556, 2014.
49. S. Ioffe, C. Szegedy, Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift, arXiv: 1502.03167, 2015.
50. He, K., Zhang, X., Ren, S., Sun, J., Deep residual learning for image recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, 770–778.
51. Bengio, Y., Simard, P., Frasconi, P., Learning Long-Term Dependencies with Gradient Descent is Difficult. 1994, IEEE Press.
52. LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., et al. Backpropagation applied to handwritten zip code recognition. Neural Comput. 1 (1989), 541–551.
53. Long, M., Cao, Y., Wang, J., Jordan, M.I., Learning transferable features with deep adaptation networks. Comput. Sci., 2015, 97–105.
54. Yosinski, J., Clune, J., Bengio, Y., Lipson, H., How transferable are features in deep neural networks?. presented at the Proc. Adv. Neural Inform. Process. Syst., 2014.
55. Tajbakhsh, N., Shin, J.Y., Gurudu, S.R., Hurst, R.T., Kendall, C.B., Gotway, M.B., et al. Convolutional neural networks for medical image analysis: Full training or fine tuning?. IEEE Trans. Med. Imaging 35 (2016), 1299–1312.
56. Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., et al. Decaf: a deep convolutional activation feature for generic visual recognition. presented at the Proc. 30th Int. Conf. Mach. Learn., 2013.
57. Ponomarev, G.V., Kazanov, M.D., Classification of ANA HEp-2 slide images using morphological features of stained patterns ☆. Pattern Recognit. Lett. 82 (2016), 79–84.
58. Bayramoglu, N., Kannala, J., Heikkilä, J., Human Epithelial Type 2 cell classification with convolutional neural networks. 2015 IEEE 15th International Conference on Bioinformatics and Bioengineering (BIBE), 2015, 1–6.
59. Shi, J., Zhou, S., Liu, X., Zhang, Q., Lu, M., Wang, T., Stacked deep polynomial network based representation learning for tumor classification with small ultrasound image dataset. Neurocomputing 194 (2016), 87–94.
60. Xi, J., Linlin, S., Xiande, Z., Shiqi, Y., Deep convolutional neural network based HEp-2 cell classification. 2016 23rd International Conference on Pattern Recognition (ICPR), 2016, 77–80.