Multispectral and Hyperspectral Image Fusion Using a 3-D-Convolutional Neural Network

IEEE Geoscience and Remote Sensing Letters

Volumn 14, Issue 5, 2017, Pages 639-643

  Palsson, Frosti ^a   Sveinsson, Johannes R ^a   Ulfarsson, Magnus O ^a  

^a UNIVERSITY OF ICELAND   (Iceland)

Author keywords

Convolutional neural networks (CNNs); Deep learning (DL); Hyperspectral (HS); Image fusion; multispectral (MS)

Indexed keywords

ADDITIVE NOISE; NEURAL NETWORKS; SPECTROSCOPY;

COMPUTATIONAL TIME; CONVENTIONAL METHODS; CONVOLUTIONAL NEURAL NETWORK; DATA SET; DIMENSIONALITY REDUCTION; HIGH RESOLUTION; HYPERSPECTRAL; MULTI-SPECTRAL;

IMAGE FUSION;

EID: 85014871642     PISSN: 1545598X     EISSN: None     Source Type: Journal    
DOI: 10.1109/LGRS.2017.2668299     Document Type: Article

References (21)

1. G. Vivone et al., "A critical comparison among pansharpening algorithms," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 5, pp. 2565-2586, May 2015.
2. F. Palsson, J. R. Sveinsson, and M. O. Ulfarsson, "A new pansharpening algorithm based on total variation," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 1, pp. 318-322, Jan. 2014.
3. X. He, L. Condat, J. Bioucas-Dias, J. Chanussot, and J. Xia, "A new pansharpening method based on spatial and spectral sparsity priors," IEEE Trans. Image Process., vol. 23, no. 9, pp. 4160-4174, Sep. 2014.
4. Y. Zhang, S. De Backer, and P. Scheunders, "Noise-resistant waveletbased Bayesian fusion of multispectral and hyperspectral images," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 11, pp. 3834-3843, Nov. 2009.
5. F. Palsson, J. R. Sveinsson, M. O. Ulfarsson, and J. A. Benediktsson, "Model-based fusion of multi- and hyperspectral images using PCA and wavelets," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 5, pp. 2652-2663, May 2015.
6. Z. H. Nezhad, A. Karami, R. Heylen, and P. Scheunders, "Fusion of hyperspectral and multispectral images using spectral unmixing and sparse coding," IEEE J. Sel. Topics Appl. Earth Observ. Remote Ses., vol. 9, no. 6, pp. 2377-2389, Jun. 2016.
7. Y. Zhang, Y. Wang, Y. Liu, C. Zhang, M. He, and S. Mei, "Hyperspectral and multispectral image fusion using CNMF with minimum endmember simplex volume and abundance sparsity constraints," in Proc. IEEE Int. Geosci. Remote Sens. Symp. (IGARSS), Jul. 2015, pp. 1929-1932.
8. Y. Zhang and M. He, "Multi-spectral and hyperspectral image fusion using 3-D wavelet transform," J. Electron. (China), vol. 24, no. 2, pp. 218-224, Mar. 2007.
9. D. Sylla, A. Minghelli-Roman, P. Blanc, A. Mangin, and O. H. F. d'Andon, "Fusion of multispectral images by extension of the pan-sharpening ARSIS method," IEEE J. Sel. Topics Appl. Earth Observat. Remote Sens., vol. 7, no. 5, pp. 1781-1791, May 2014.
10. Z. Chen, H. Pu, B. Wang, and G.-M. Jiang, "Fusion of hyperspectral and multispectral images: A novel framework based on generalization of pan-sharpening methods," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 8, Aug. 2014, Art. no. 1.
11. C. Szegedy et al., "Going deeper with convolutions," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2015, pp. 1-9.
12. Y. LeCun et al., "Handwritten digit recognition with a back-propagation network," in Neural Networks, Current Applications. London, U.K.: Chappman & Hall, 1992.
13. W. Huang, L. Xiao, Z. Wei, H. Liu, and S. Tang, "A new pan-sharpening method with deep neural networks," IEEE Geosci. Remote Sens. Lett., vol. 12, no. 5, pp. 1037-1041, May 2015.
14. G. Masi, D. Cozzolino, L. Verdoliva, and G. Scarpa, "Pansharpening by convolutional neural networks," Remote Sens., vol. 8, no. 7, p. 594, 2016.
15. I. Jolliffe, Principal Component Analysis, 2nd ed. New York, NY, USA: Springer, 2002.
16. D. H. Hubel and T. N. Wiesel, "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex," J. Physiol., vol. 160, no. 1, pp. 106-154, 1962.
17. A. Graves, A.-R. Mohamed, and G. Hinton, "Speech recognition with deep recurrent neural networks," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Vancouver, BC, Canada, May 2013, pp. 6645-6649.
18. D. P. Kingma and J. Ba. (Dec. 2014). "Adam: A method for stochastic optimization." [Online]. Available: https://arxiv.org/abs/1412.6980
19. L. Wald, "Quality of high resolution synthesised images: Is there a simple criterion?" in Proc. 3rd Conf. 'Fusion Earth Data, Merging Point Meas., Raster Maps Remotely Sensed Images' SEE/URISCA, 2000, pp. 99-103.
20. R. H. Yuhas, A. F. Goetz, and J. W. Boardman, "Discrimination among semi-arid landscape endmembers using the spectral angle mapper (SAM) algorithm," in Proc. Summaries 3rd Annu. JPL Airborne Geosci. Workshop, vol. 1. 1992, pp. 147-149.
21. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.