A medical image fusion method based on convolutional neural networks

20th International Conference on Information Fusion, Fusion 2017 - Proceedings

Volumn , Issue , 2017, Pages

  Liu, Yu ^a   Chen, Xun ^a   Cheng, Juan ^a   Peng, Hu ^a  

^a HEFEI UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CONVOLUTION; INFORMATION FUSION; MEDICAL IMAGING; NEURAL NETWORKS;

ACTIVITY INFORMATIONS; CLINICAL APPLICATION; CONVOLUTIONAL NETWORKS; CONVOLUTIONAL NEURAL NETWORK; HUMAN VISUAL PERCEPTION; LOCAL SIMILARITY; OBJECTIVE ASSESSMENT; VISUAL QUALITIES;

IMAGE FUSION;

EID: 85029427610     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.23919/ICIF.2017.8009769     Document Type: Conference Paper

References (33)

1. A. James and B. Dasarathy, "Medical image fusion: a survey of the state of the art, " Information Fusion, vol. 19, pp. 4-19, 2014.
2. L. Yang, B. Guo, and W. Ni, "Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform, " Neurocomputing, vol. 72, pp. 203-211, 2008.
3. Z. Wang and Y. Ma, "Medical image fusion using m-pcnn, " Information Fusion, vol. 9, pp. 176-185, 2008.
4. B. Yang and S. Li, "Pixel-level image fusion with simultaneous orthogonal matching pursuit, " Information Fusion, vol. 13, pp. 10-19, 2012.
5. S. Li, H. Yin, and L. Fang, "Group-sparse representation with dictionary learning for medical image denoising and fusion, " IEEE Transactions on Biomedical Engineering, vol. 59, pp. 3450-3459, 2012.
6. Z. L. G. Bhatnagar, Q. Wu, "Directive contrast based multimodal medical image fusion in nsct domain, " IEEE Transactions on Multimedia, vol. 15, pp. 1014-1024, 2013.
7. S. Li, X. Kang, and J. Hu, "Image fusion with guided filtering, " IEEE Transactions on Image Processing, vol. 22, no. 7, pp. 2864-2875, 2013.
8. R. Shen, I. Cheng, and A. Basu, "Cross-scale coefficient selection for volumetric medical image fusion, " IEEE Transactions on Biomedical Engineering, vol. 60, pp. 1069-1079, 2013.
9. R. Singh and A. Khare, "Fusion of multimodal medical images using daubechies complex wavelet transform c a multiresolution approach, " Information Fusion, vol. 19, pp. 49-60, 2014.
10. L. Wang, B. Li, and L. Tan, "Multimodal medical volumetric data fusion using 3-d discrete shearlet transform and global-to-local rule, " IEEE Transactions on Biomedical Engineering, vol. 61, pp. 197-206, 2014.
11. Z. Liu, H. Yin, Y. Chai, and S. Yang, "A novel approach for multimodal medical image fusion, " Expert Systems with Applications, vol. 41, pp. 7425-7435, 2014.
12. G. Bhatnagar, Q. Wu, and Z. Liu, "A new contrast based multimodal medical image fusion framework, " Neurocomputing, vol. 157, pp. 143-152, 2015.
13. Y. Liu, S. Liu, and Z. Wang, "A general framework for image fusion based on multi-scale transform and sparse representation, " Information Fusion, vol. 24, no. 1, pp. 147-164, 2015.
14. Q. Wang, S. Li, H. Qin, and A. Hao, "Robust multi-modal medical image fusion via anisotropic heat diffusion guided low-rank structural analysis, " Information Fusion, vol. 26, pp. 103-121, 2015.
15. Y. Liu and Z. Wang, "Simultaneous image fusion and denosing with adaptive sparse representation, " IET Image Process., vol. 9, no. 5, pp. 347-357, 2015.
16. Y. Yang, Y. Que, S. Huang, and P. Lin, "Multimodal sensor medical image fusion based on type-2 fuzzy logic in nsct domain, " IEEE Sensors Journal, vol. 16, pp. 3735-3745, 2016.
17. J. Du, W. Li, B. Xiao, and Q. Nawaz, "Union laplacian pyramid with multiple features for medical image fusion, " Neurocomputing, vol. 194, pp. 326-339, 2016.
18. P. Burt and R. Kolczynski, "Enhanced image capture through fusion, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), 1993, pp. 173-182.
19. A. Toet, "A morphological pyramidal image decomposition, " Pattern Recognition Letters, vol. 9, no. 4, pp. 255-261, 1989.
20. H. Li, B. Manjunath, and S. Mitra, "Multisensor image fusion using the wavelet transform, " Graphical Models and Image Processing, vol. 57, no. 3, pp. 235-245, 1995.
21. J. Lewis, R. OCallaghan, S. Nikolov, D. Bull, and N. Canagarajah, "Pixel-and region-based image fusion with complex wavelets, " Information Fusion, vol. 8, no. 2, pp. 119-130, 2007.
22. Y. Liu, X. Chen, R. Ward, and Z. Wang, "Image fusion with convolutional sparse representation, " IEEE Signal Processing Letters, vol. 23, no. 12, pp. 1882-1886, 2016.
23. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based leaning applied to document recognition, " Proceedings of The IEEE, vol. 86, no. 11, pp. 2278-2324, 1998.
24. Y. Liu, X. Chen, J. Cheng, H. Peng, and Z. Wang, "Multi-focus image fusion with a deep convolutional neural network, " Information Fusion, vol. 36, pp. 191-207, 2017.
25. S. Zagoruyko and N. Komodakis, "Learning to compare image patches via convolutional neural networks, " in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 4353-4361.
26. P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, and Y. L, "Overfeat: Integrated recognition, localizaton and detection using convolutional networks, " arXiv, vol. 1312.6299v4, pp. 1-16, 2014.
27. T. Mertens, J. Kautz, and F. V. Reeth, "Exposure fusion, " in Proc. Pacific Graphics, 2007, pp. 382-390.
28. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, "Caffe: Convolutional architecture for fast feature embedding, " in Proceedings of the ACM International Conference on Multimedia, 2014, pp. 675-678.
29. M. Haghighat, A. Aghagolzadeh, and H. Seyedarabi, "A non-reference image fusion metric based on mutual information of image features, " Computers and Electrical Engineering, vol. 37, pp. 744-756, 2011.
30. C. S. Xydeas and V. S. Petrovic, "Objective image fusion performance measure, " Electronics Letters, vol. 36, no. 4, pp. 308-309, 2000.
31. G. Piella and H. Heijmans, "A new quality metric for image fusion, " in Proceedings of 10th International Conference on Image Processing, 2003, pp. 173-176.
32. Y. Han, Y. Cai, Y. Cao, and X. Xu, "A new image fusion performance metric based on visual information fidelity, " Information Fusion, vol. 14, pp. 127-135, 2013.
33. http://www.med.harvard.edu/AANLIB/.