Remote Sensing Image Fusion with Convolutional Neural Network

Sensing and Imaging

Volumn 17, Issue 1, 2016, Pages

  Zhong, Jinying ^a   Yang, Bin ^a   Huang, Guoyu ^a   Zhong, Fei ^a   Chen, Zhongze ^a  

^a UNIVERSITY OF SOUTH CHINA   (China)

Author keywords

Convolutional neural network; Gram Schmidt transform; Remote sensing image fusion; Super resolution

Indexed keywords

CONVOLUTION; IMAGE RECONSTRUCTION; IMAGE RESOLUTION; NEURAL NETWORKS; OPTICAL RESOLVING POWER; REMOTE SENSING;

CONVOLUTIONAL NEURAL NETWORK; MULTISPECTRAL IMAGES; PANCHROMATIC (PAN) IMAGE; REMOTE SENSING IMAGES; SCHMIDT; SPATIAL-RESOLUTION ENHANCEMENT; STRUCTURAL COMPONENT; SUPER RESOLUTION;

IMAGE FUSION;

EID: 84975475015     PISSN: 15572064     EISSN: 15572072     Source Type: Journal    
DOI: 10.1007/s11220-016-0135-6     Document Type: Article

References (22)

1. Thomas, C., Wald, L., Ranchin, T., & Chanussot, J. (2008). Synthesis of multispectral images to high spatial resolution: A critical review of fusion methods based on remote sensing physics. IEEE Transactions on Geoscience and Remote Sensing, 46(5), 1301–1312. doi:10.1109/TGRS.2007.912448.
2. Lu, T., Li, S. T., & Fu, W. (2014). Fusion based seamless mosaic for remote sensing images. Sensing and Imaging. doi:10.1007/s11220-014-0101-0.
3. Kang, X. D., Li, S. T., Fang, L. Y., & Benediktsson, J. A. (2014). Pansharpening based on intrinsic image decomposition. Sensing and Imaging. doi:10.1007/s11220-014-0094-8.
4. Ragheb, A. M., Osman, H., Abbas, A. M., & Elkaffas, S. M. (2012). Simultaneous fusion and denoising of panchromatic and multispectral satellite Images. Sensing and Imaging, 13(3), 119–141. doi:10.1007/s11220-013-0075-3.
5. Choi, M. (2006). A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter. IEEE Transactions on Geoscience and Remote Sensing, 44(6), 1672–1682. doi:10.1109/TGRS.2006.869923.
6. Tu, T. M., Huang, P. S., Hung, C. L., & Chang, C. P. (2004). A fast intensity–hue–saturation fusion technique with spectral adjustment for IKONOS imagery. IEEE Geoscience and Remote Sensing Letters, 1(4), 309–312. doi:10.1109/LGRS.2004.834804.
7. Laben, C. A., & Brower, B. V. (2000). Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening. U.S. Patent 6 011 875, Tech. Rep., Eastman Kodak Company.
8. Huang, F. H., & Yan, L. M. (2013). Study on the hyperspectral image fusion based on the Gram Schmidt improved algorithm. Information Technology Journal, 12(22), 6694–6701. doi:10.3923/itj.2013.6694.6701.
9. Chavez, P. S., Sides, S. C., & Anderson, J. A. (1991). Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic. Photogrammetric Engineering and Remote Sensing, 57(3), 295–303.
10. Ibrahim, S., & Wirth, M. (2009). Multiresolution region-based image fusion using the Contourlet transform. In Science and technology for humanity (TIC-STH), 2009 IEEE Toronto international conference, 26–27 Sept 2009 (pp. 421–426). doi: 10.1109/TIC-STH.2009.5444464.
11. Pradhan, P. S., King, R. L., & Younan, N. H. (2006). Estimation of the number of decomposition levels for a wavelet-based multiresolution multisensor image fusion. IEEE Transactions on Geoscience and Remote Sensing, 44(12), 3674–3686. doi:10.1109/TGRS.2006.881758.
12. Li, S. (2008). Multisensor remote sensing image fusion using stationary wavelet transform: effects of basis and decomposition level. International Journal of Wavelets, Multiresolution and Information Processing, 6(1), 37–50. doi:10.1142/S0219691308002203.
13. Núñez, J., Otazu, X., Fors, O., Prades, A., Palà, V., & Arbiol, R. (1999). Multiresolution-based image fusion with additive wavelet decomposition. IEEE Transactions on Geoscience and Remote Sensing, 37(3), 1204–1211. doi:10.1109/36.763274.
14. Zheng, S., Shi, W., & Liu, J. (2008). Remote sensing image fusion using multiscale mapped LS-SVM. IEEE Transactions on Geoscience and Remote Sensing, 46(5), 1313–1322. doi:10.1109/TGRS.2007.912737.
15. Wu, Y. Q., & Tao, F. X. (2015). Multispectral and panchromatic image fusion based on improved projected gradient NMF in NSST domain. Acta Optica Sinica, 35(4), 0410005. doi:10.3788/aos201535.0410005.
16. Otazu, X., González-Audícana, M., & Fors, O. (2005). Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods. IEEE Transactions on Geoscience and Remote Sensing, 43(10), 2376–2385. doi:10.1109/TGRS.2005.856106.
17. Shah, V. P., Younan, N. H., & King, R. L. (2008). An efficient pan-sharpening method via a combined adaptive PCA approach and contourlets. IEEE Transactions on Geoscience and Remote Sensing, 46(5), 1323–1335. doi:10.1109/TGRS.2005.856106.
18. Moonon, A. U., Hu, J. W., & Li, S. T. (2015). Remote sensing image fusion method based on nonsubsampled shearlet transform and sparse representation. Sensing and Imaging. doi:10.1007/s11220-015-0125-0.
19. Liu, B., Li, K., & Liu, W. (2013). Construction method of three-channel non-separable symmetric wavelets with arbitrary dilation matrices and its applications in multispectral image fusion. Image Processing, IET, 7(7), 679–685. doi:10.1049/iet-ipr.2013.0085.
20. Dong, C., Loy, C. C., He, K.M., & Tang, X. O. (2014). Learning a deep convolutional network for image super-resolution. In Proceedings of the 13th European conference on computer vision, 6–12 Sept 2014 (Vol. 8692, pp. 184–199). doi: 10.1007/978-3-319-10593-2_13.
21. LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278–2324. doi:10.1109/5.726791.
22. Zhou, X. R., Liu, J., Liu, S. G., Cao, L., Zhou, Q. M., & Huang, H. W. (2014). A GIHS-based spectral preservation fusion method for remote sensing images using edge restored spectral modulation. ISPRS Journal of Photogrammetry and Remote Sensing., 88, 16–27. doi:10.1016/j.isprsjprs.2013.11.011.