Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network

IEEE Geoscience and Remote Sensing Letters

Volumn 14, Issue 10, 2017, Pages 1795-1799

  Wei, Yancong ^a   Yuan, Qiangqiang ^a   Shen, Huanfeng ^a   Zhang, Liangpei ^a  

^a WUHAN UNIVERSITY   (China)

Author keywords

Convolutional neural network; data fusion; pansharpening; remote sensing; residual learning

Indexed keywords

CONVOLUTION; DATA FUSION; DEEP LEARNING; FEATURE EXTRACTION; IMAGE FUSION; LEARNING SYSTEMS; NEURAL NETWORKS; PERSONNEL TRAINING; REMOTE SENSING; SPECTRUM ANALYSIS;

CONVOLUTIONAL NEURAL NETWORK; HIGH NONLINEARITY; MULTISPECTRAL IMAGES; PAN-SHARPENING; PANCHROMATIC IMAGES; RESIDUAL LEARNING; SPATIAL RESOLUTION; VISUAL ASSESSMENTS;

DEEP NEURAL NETWORKS;

EID: 85028507222     PISSN: 1545598X     EISSN: None     Source Type: Journal    
DOI: 10.1109/LGRS.2017.2736020     Document Type: Article

References (24)

1. C. A. Laben and B. V. Brower, "Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening, " U.S. Patent 6 011 875 A, Jan. 4, 2000.
2. J. Choi, K. Yu, Y. Kim, "A new adaptive component-substitutionbased satellite image fusion by using partial replacement, " IEEE Trans. Geosci. Remote Sens., vol. 49, no. 1, pp. 295-309, Jan. 2011.
3. B. Aiazzi, L. Alparone, S. Baronti, A. Garzelli, M. Selva, "MTFtailored multiscale fusion of high-resolution MS and pan imagery, " Photogramm. Eng. Remote Sens., vol. 72, no. 5, pp. 591-596, May 2006.
4. J. G. Liu, "Smoothing filter-based intensity modulation: A spectral preserve image fusion technique for improving spatial details, " Int. J. Remote Sens., vol. 21, no. 18, pp. 3461-3472, Dec. 2000.
5. H. Shen, X. Meng, L. Zhang, "An integrated framework for the spatio-temporal-spectral fusion of remote sensing images, " IEEE Trans. Geosci. Remote Sens., vol. 54, no. 12, pp. 7135-7148, Dec. 2016.
6. C. Jiang, H. Zhang, H. Shen, L. Zhang, "Two-Step sparse coding for the pan-sharpening of remote sensing images, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 7, no. 5, pp. 1792-1805, May 2014.
7. Q. M. Wang, W. Z. Shi, Z. B. Li, P. M. Atkinson, "Fusion of sentinel-2 images, " Remote Sens. Environ., vol. 187, pp. 241-252, Dec. 2016.
8. Q. Wang, W. Shi, P. M. Atkinson, "Area-to-point regression kriging for pan-sharpening, " ISPRS J. Photogramm. Remote Sens., vol. 114, pp. 151-165, Apr. 2016.
9. J. Kim, J. K. Lee, K. M. Lee, "Accurate image super-resolution using very deep convolutional networks, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Las Vegas, NV, USA, Jun. 2016, pp. 1646-1654.
10. C. Dong, C. C. Loy, K. He, X. Tang, "Image super-resolution using deep convolutional networks, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 2, pp. 295-307, Feb. 2016.
11. W. Huang, L. Xiao, Z. Wei, H. Liu, S. Tang, "A new pan-sharpening method with deep neural networks, " IEEE Geosci. Remote Sens. Lett., vol. 12, no. 5, pp. 1037-1041, May 2015.
12. G. Masi, D. Cozzolino, L. Verdoliva, G. Scarpa, "Pansharpening by convolutional neural networks, " Remote Sens., vol. 8, no. 7, p. 594, Jul. 2016.
13. K. He, X. Zhang, S. Ren, J. Sun, "Deep residual learning for image recognition, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Las Vegas, NV, USA, Jun. 2016, pp. 770-778.
14. K. Zhang, W. Zuo, Y. Chen, D. Meng, L. Zhang, "Beyond a Gaussian denoiser: Residual learning of deep CNN for image denoising, " IEEE Trans. Image Process., vol. 26, no. 7, pp. 3142-3155, Jul. 2017.
15. B. T. Polyak, "Some methods of speeding up the convergence of iteration methods, " USSR Comput. Math. Math. Phys., vol. 4, no. 5, pp. 1-17, 1964.
16. Y. Jia et al., "Caffe: Convolutional architecture for fast feature embedding, " in Proc. 22nd ACM Int. Conf. Multimedia, 2014, pp. 675-678.
17. MatConvNet: CNNs for MATLAB. [Online]. Available: Http://www. vlfeat.org/matconvnet
18. X. Otazu, M. Gonzalez-Audicana, O. Fors, J. Nunez, "Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods, " IEEE Trans. Geosci. Remote Sens., vol. 43, no. 10, pp. 2376-2385, Oct. 2005.
19. P. H. Wu, H. F. Shen, L. P. Zhang, F. M. Göttsche, "Integrated fusion of multi-scale polar-orbiting and geostationary satellite observations for the mapping of high spatial and temporal resolution land surface temperature, " Remote Sens. Environ., vol. 156, pp. 169-181, Jan. 2015.
20. Q. Yuan, L. Zhang, H. Shen, P. Li, "Adaptive multiple-frame image super-resolution based on U-curve, " IEEE Trans. Image Process., vol. 19, no. 12, pp. 3157-3170, Dec. 2010.
21. J. Li, Q. Yuan, H. Shen, L. Zhang, "Noise removal from hyperspectral image with joint spectral-spatial distributed sparse representation, " IEEE Trans. Geosci Remote Sens., vol. 54, no. 9, pp. 5425-5439, Sep. 2016.
22. F. Hu, G.-S. Xia, Z. Wang, X. Huang, L. Zhang, "Unsupervised feature learning via spectral clustering of multidimensional patches for remotely sensed scene classification, " IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 8, no. 5, pp. 2015-2030, May 2015.
23. Q. Wang, J. Lin, Y. Yuan, "Salient band selection for hyperspectral image classification via manifold ranking, " IEEE Trans. Neural Netw. Learn. Syst., vol. 27, no. 6, pp. 1279-1289, Jun. 2016.
24. Q. Wang, Y. Yuan, P. Yan, "Visual saliency by selective contrast, " IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 7, pp. 1150-1155, Jul. 2013.