Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation

IEEE Transactions on Geoscience and Remote Sensing

Volumn 53, Issue 7, 2015, Pages 3658-3668

  Wei, Qi ^a   Bioucas Dias, José ^b   Dobigeon, Nicolas ^a   Tourneret, Jean Yves ^a  

^a IRIT   (France)

^b INSTITUTO SUPERIOR TÉCNICO   (Portugal)

Author keywords

Alternating direction method of multipliers (ADMM); dictionary; hyperspectral (HS) image; image fusion; multispectral (MS) image; sparse representation

Indexed keywords

GLOSSARIES; IMAGE CODING; INVERSE PROBLEMS;

ALTERNATING DIRECTION METHOD OF MULTIPLIERS; ALTERNATING OPTIMIZATIONS; DIMENSIONAL SUBSPACE; HYPERSPECTRAL; MULTI-SPECTRAL IMAGE FUSIONS; MULTISPECTRAL IMAGES; SPARSE REGULARIZATIONS; SPARSE REPRESENTATION;

IMAGE FUSION;

ALGORITHM; IMAGE ANALYSIS; OBSERVATIONAL METHOD; OPTIMIZATION; SPECTRAL ANALYSIS;

EID: 84945312168     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2014.2381272     Document Type: Article

References (56)

1. Q. Wei, J. Bioucas-Dia, N. Dobigeon, and J.-Y. Tourneret, "Fusion of multispectral and hyperspectral images based on sparse representation," in Proc. EUSIPCO, Lisbon, Portugal, 2014, pp. 1-5.
2. I. Amro, J. Mateos, M. Vega, R. Molina, and A. K. Katsaggelos, "A survey of classical methods and new trends in pansharpening of multispectral images," EURASIP J. Adv. Signal Process., vol. 2011, no. 1, pp. 1-22, Sep. 2011.
3. M. González-Audícana, J. L. Saleta, R. G. Catalán, and R. García, "Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 6, pp. 1291-1299, Jun. 2004.
4. S. Li and B. Yang, "A new pan-sharpening method using a compressed sensing technique," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 2, pp. 738-746, Feb. 2011.
5. D. Liu and P. T. Boufounos, "Dictionary learning based pan-sharpening," in Proc. IEEE ICASSP, Kyoto, Japan, Mar. 2012, pp. 2397-2400.
6. D.Manolakis and G. Shaw, "Detection algorithms for hyperspectral imaging applications," IEEE Signal Process. Mag., vol. 19, no. 1, pp. 29-43, Jan. 2002.
7. J. M. Bioucas-Dias et al., "Hyperspectral unmixing overview: Geometrical, statistical, and sparse regression-based approaches," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 5, no. 2, pp. 354-379, Apr. 2012.
8. C.-I. Chang, Hyperspectral Data Exploitation: Theory and Application. Hoboken, NJ, USA: Wiley, 2007.
9. G. Chen, S.-E. Qian, J.-P. Ardouin, and W. Xie, "Super-resolution of hyperspectral imagery using complex ridgelet transform," Int. J. Wavelets Multiresolution Inf. Process., vol. 10, no. 3, pp. 1-22, May 2012.
10. X. He, L. Condat, J. Bioucas-Dias, J. Chanussot, and J. Xia, "A new pansharpening method based on spatial and spectral sparsity priors," IEEE Trans. Image Process., vol. 23, no. 9, pp. 4160-4174, Sep. 2014.
11. N. Yokoya and A. Iwasaki, "Hyperspectral and multispectral data fusion mission on hyperspectral imager suite (HISUI)," in Proc. IEEE IGARSS, Melbourne, Vic., Australia, Jul. 2013, pp. 4086-4089.
12. V. Shettigara, "A generalized component substitution technique for spatial enhancement of multispectral images using a higher resolution data set," Photogramm. Eng. Remote Sens., vol. 58, no. 5, pp. 561-567, 1992.
13. J. Zhou, D. Civco, and J. Silander, "A wavelet transform method to merge Landsat TM and SPOT panchromatic data," Int. J. Remote Sens., vol. 19, no. 4, pp. 743-757, Mar. 1998.
14. R. C. Hardie, M. T. Eismann, and G. L. Wilson, "MAP estimation for hyperspectral image resolution enhancement using an auxiliary sensor," IEEE Trans. Image Process., vol. 13, no. 9, pp. 1174-1184, Sep. 2004.
15. Q.Wei, N. Dobigeon, and J.-Y. Tourneret, "Bayesian fusion of multi-band images," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., 2014, pp. 3176-3180.
16. Q.Wei, N. Dobigeon, and J.-Y. Tourneret, "Bayesian fusion of hyperspectral and multispectral images," in Proc. IEEE ICASSP, Florence, Italy, May 2014.
17. Y. Zhang, S. De Backer, and P. Scheunders, "Noise-resistant wavelet-based Bayesian fusion of multispectral and hyperspectral images," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 11, pp. 3834-3843, Nov. 2009.
18. N. Yokoya, T. Yairi, and A. Iwasaki, "Coupled nonnegative matrix factorization unmixing for hyperspectral and multispectral data fusion," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 2, pp. 528-537, Feb. 2012.
19. N. Yokoya, J. Chanussot, and A. Iwasaki, "Hyperspectral and multispectral data fusion based on nonlinear unmixing," in Proc. 4th WHISPERS, Shanghai, China, Jun. 2012, pp. 1-4.
20. E. Shechtman and M. Irani, "Matching local self-similarities across images and videos," in Proc. IEEE CVPR, Minnesota, MN, USA, 2007, pp. 1-8.
21. J. Mairal, M. Elad, and G. Sapiro, "Sparse representation for color image restoration," IEEE Trans. Image Process., vol. 17, no. 1, pp. 53-69, Jan. 2008.
22. J. Mairal, F. Bach, J. Ponce, and G. Sapiro, "Online dictionary learning for sparse coding," in Proc. 26th Annu. ICML, Montreal, QC, Canada, 2009, pp. 689-696.
23. T. Deselaers and V. Ferrari, "Global and efficient self-similarity for object classification and detection," in Proc. IEEE CVPR, San Francisco, CA, USA, 2010, pp. 1633-1640.
24. J. Yang, J. Wright, T. S. Huang, and Y. Ma, "Image super-resolution via sparse representation," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
25. H. Yin, S. Li, and L. Fang, "Simultaneous image fusion and super-resolution using sparse representation," Inf. Fusion, vol. 14, no. 3, pp. 229-240, Jul. 2013.
26. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries," IEEE Trans. Image Process., vol. 15, no. 12, pp. 3736-3745, Dec. 2006.
27. I. Ramirez, P. Sprechmann, and G. Sapiro, "Classification and clustering via dictionary learning with structured incoherence and shared features," in Proc. IEEE CVPR, San Francisco, CA, USA, 2010, pp. 3501-3508.
28. Z. Xing, M. Zhou, A. Castrodad, G. Sapiro, and L. Carin, "Dictionary learning for noisy and incomplete hyperspectral images," SIAM J. Imag. Sci., vol. 5, no. 1, pp. 33-56, Jan. 2012.
29. J. Tropp and A. Gilbert, "Signal recovery from random measurements via orthogonal matching pursuit," IEEE Trans. Inf. Theory, vol. 53, no. 12, pp. 4655-4666, Dec. 2007.
30. R. Tibshirani, "Regression shrinkage and selection via the lasso," J. R. Stat. Soc. Ser. B, vol. 73, no. 3, pp. 267-288, Jun. 1996.
31. M. Afonso, J. Bioucas-Dias, and M. Figueiredo, "An augmented Lagrangian approach to the constrained optimization formulation of imaging inverse problems," IEEE Trans. Image Process., vol. 20, no. 3, pp. 681-95, Mar. 2011.
32. R. Molina, A. K. Katsaggelos, and J. Mateos, "Bayesian and regularization methods for hyperparameter estimation in image restoration," IEEE Trans. Image Process., vol. 8, no. 2, pp. 231-246, Feb. 1999.
33. R. Molina, M. Vega, J. Mateos, and A. K. Katsaggelos, "Variational posterior distribution approximation in Bayesian super resolution reconstruction of multispectral images," Appl. Comput. Harmonic Anal., vol. 24, no. 2, pp. 251-267, Mar. 2008.
34. A. Jalobeanu, L. Blanc-Feraud, and J. Zerubia, "An adaptive Gaussian model for satellite image deblurring," IEEE Trans. Image Process., vol. 13, no. 4, pp. 613-621, Apr. 2004.
35. A. Duijster, P. Scheunders, and S. De Backer, "Wavelet-based em algorithm for multispectral-image restoration," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 11, pp. 3892-3898, Nov. 2009.
36. M. Xu, H. Chen, and P. K. Varshney, "An image fusion approach based on Markov random fields," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 12, pp. 5116-5127, Dec. 2011.
37. C.-I. Chang, X.-L. Zhao, M. L. Althouse, and J. J. Pan, "Least squares subspace projection approach to mixed pixel classification for hyperspectral images," IEEE Trans. Geosci. Remote Sens., vol. 36, no. 3, pp. 898-912, May 1998.
38. J. M. Bioucas-Dias and J. M. Nascimento, "Hyperspectral subspace identification," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 8, pp. 2435-2445, Aug. 2008.
39. T. Tu, S. Su, H. Shyu, and P. S. Huang, "A new look at IHS-like image fusion methods," Inf. Fusion, vol. 2, no. 3, pp. 177-186, Sep. 2001.
40. V. P. Shah, N. H. Younan, and R. L. King, "An efficient pan-sharpening method via a combined adaptive PCA approach and contourlets," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 5, pp. 1323-1335, May 2008.
41. G. Dahlquist and Å. Björck, Numerical Methods in Scientific Computing, vol. 1, Philadelphia, PA, USA: SIAM, ser. Numerical Methods in Scientific Computing, 2008.
42. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Comput., vol. 20, no. 1, pp. 33-61, 1998.
43. K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, "Image denoising by sparse 3-D transform-domain collaborative filtering," IEEE Trans. Image Process., vol. 16, no. 8, pp. 2080-2095, Aug. 2007.
44. O. G. Guleryuz, "Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoising - Part I: Theory," IEEE Trans. Image Process., vol. 15, no. 3, pp. 539-554, Mar. 2006.
45. Q. Wei, J. Bioucas-Dias, N. Dobigeon, and J.-Y. Tourneret, "Hyperspectral and multispectral image fusion based on a sparse representation," IRIT-ENSEEIHT, Tech. Report, Univ. Toulouse, Toulouse, France, 2014. [Online]. Available: http://wei.perso.enseeiht.fr/papers/2014-TR-SparseFusion-WEI.pdf
46. M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006.
47. A. Gelman et al., Bayesian Data Analysis, 3rd ed. Boca Raton, FL, USA: CRC Press, 2013.
48. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, "Distributed optimization and statistical learning via the alternating direction method of multipliers," J. Found. Trends Mach. Learn., vol. 3, no. 1, pp. 1-122, Jan. 2011.
49. M. V. Afonso, J. M. Bioucas-Dias, and M. A. Figueiredo, "Fast image recovery using variable splitting and constrained optimization," IEEE Trans. Image Process., vol. 19, no. 9, pp. 2345-2356, Sep. 2010.
50. A. Plaza et al., "Recent advances in techniques for hyperspectral image processing," Remote Sens. Environ., vol. 113, Supplement 1, pp. S110-S122, Sep. 2009.
51. Y. Tarabalka, M. Fauvel, J. Chanussot, and J. Benediktsson, "SVM- and MRF-based method for accurate classification of hyperspectral images," IEEE Geosci. Remote Sens. Lett., vol. 7, no. 4, pp. 736-740, Oct. 2010.
52. J. Li, J. M. Bioucas-Dias, and A. Plaza, "Spectral-spatial classification of hyperspectral data using loopy belief propagation and active learning," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 2, pp. 844-856, Feb. 2013.
53. Z. Wang and A. C. Bovik, "A universal image quality index," IEEE Signal Process. Lett., vol. 9, no. 3, pp. 81-84, Mar. 2002.
54. L. Wald, "Quality of high resolution synthesised images: Is there a simple criterion?" in Proc. Int. Conf. Fusion Earth Data, Nice, France, Jan. 2000, pp. 99-103.
55. J. Eckstein and D. P. Bertsekas, "On the Douglas-Rachford splitting method and the proximal point algorithm for maximal monotone operators," Math. Programm., vol. 55, no. 1-3, pp. 293-318, Apr. 1992.
56. R. O. Green et al., "Imaging spectroscopy and the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS)," Remote Sens. Environ., vol. 65, no. 3, pp. 227-248, Sep. 1998.