A critical comparison among pansharpening algorithms

IEEE Transactions on Geoscience and Remote Sensing

Volumn 53, Issue 5, 2015, Pages 2565-2586

  Vivone, Gemine ^a,b   Alparone, Luciano ^c   Chanussot, Jocelyn ^d   Dalla Mura, Mauro ^e   Garzelli, Andrea ^f   Licciardi, Giorgio A ^g   Restaino, Rocco ^g   Wald, Lucien ^a  

^a UNIVERSITY OF SALERNO   (Italy)

^b NATO UNDERSEA RESEARCH CENTRE   (Italy)

^c UNIVERSITY OF FLORENCE   (Italy)

^d GIPSA LAB   (France)

^e UNIVERSITY OF ICELAND   (Iceland)

^f UNIVERSITY OF SIENA   (Italy)

^g PSL RESEARCH UNIVERSITY   (France)

Author keywords

Benchmarking; component substitution (CS); multiresolution analysis (MRA); multispectral (MS) pansharpening; quality assessment; very high resolution optical images

Indexed keywords

ALGORITHMS; BENCHMARKING; GEOMETRICAL OPTICS; MATLAB; MULTIRESOLUTION ANALYSIS;

ASSESSMENT INDEXES; COMPONENT SUBSTITUTION; EVALUATION CRITERIA; PAN-SHARPENING; PANCHROMATIC IMAGES; QUALITY ASSESSMENT; REDUCED RESOLUTION; VERY HIGH RESOLUTION OPTICAL IMAGES;

QUALITY CONTROL;

ALGORITHM; BENCHMARKING; DATA SET; MODEL VALIDATION; MULTISPECTRAL IMAGE; QUALITATIVE ANALYSIS; SATELLITE DATA; SPATIAL RESOLUTION;

EID: 84921019917     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2014.2361734     Document Type: Article

References (77)

1. C. Thomas, T. Ranchin, L. Wald, and J. Chanussot, "Synthesis of multispectral images to high spatial resolution: A critical review of fusion methods based on remote sensing physics," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 5, pp. 1301-1312, May 2008
2. C. Souza, Jr., L. Firestone, L. M. Silva, and D. Roberts, "Mapping forest degradation in the Eastern Amazon from SPOT 4 through spectral mixture models," Remote Sens. Environ., vol. 87, no. 4, pp. 494-506, Nov. 2003
3. A. Mohammadzadeh, A. Tavakoli, and M. J. Valadan Zoej, "Road extraction based on fuzzy logic and mathematical morphology from pansharpened IKONOS images," Photogramm. Rec., vol. 21, no. 113, pp. 44-60, Mar. 2006
4. F. Laporterie-Déjean, H. de Boissezon, G. Flouzat, and M.-J. Lefevre-Fonollosa, "Thematic and statistical evaluations of five panchromatic/multispectral fusion methods on simulated PLEIADES-HR images," Inf. Fusion, vol. 6, no. 3, pp. 193-212, Sep. 2005
5. Z. Wang, D. Ziou, C. Armenakis, D. Li, and Q. Li, "A comparative analysis of image fusion methods," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 6, pp. 1391-1402, Jun. 2005
6. I. Amro, J.Mateos, M. Vega, R.Molina, and A. K. Katsaggelos, "A survey of classical methods and new trends in pansharpening of multispectral images," EURASIP J. Adv. Signal Process., vol. 2011, no. 1, pp. 79:1-79:22, Sep. 2011
7. B. Aiazzi, L. Alparone, S. Baronti, A. Garzelli, and M. Selva, "Twenty-five years of pansharpening: A critical review and new developments," in Signal and Image Processing for Remote Sensing, 2nd ed., C.-H. Chen, Ed. Boca Raton, FL, USA: CRC Press, 2012, pp. 533-548
8. L. Alparone et al., "Comparison of pansharpening algorithms: Outcome of the 2006 GRS-S data fusion contest," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 10, pp. 3012-3021, Oct. 2007
9. W. Carper, T. Lillesand, and R. Kiefer, "The use of intensity-huesaturation transformations for merging SPOT panchromatic and multispectral image data," Photogramm. Eng. Remote Sens., vol. 56, no. 4, pp. 459-467, Apr. 1990
10. P. S. Chavez Jr., S. C. Sides, and J. A. Anderson, "Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic," Photogramm. Eng. Remote Sens., vol. 57, no. 3, pp. 295-303, Mar. 1991
11. P. S. Chavez, Jr. and A. W. Kwarteng, "Extracting spectral contrast in Landsat thematic mapper image data using selective principal component analysis," Photogramm. Eng. Remote Sens., vol. 55, no. 3, pp. 339-348, Mar. 1989
12. V. K. Shettigara, "A generalized component substitution technique for spatial enhancement of multispectral images using a higher resolution data set," Photogramm. Eng. Remote Sens., vol. 58, no. 5, pp. 561-567, May 1992
13. V. P. Shah, N. H. Younan, and R. L. King, "An efficient pan-sharpening method via a combined adaptive-PCA approach and contourlets," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 5, pp. 1323-1335, May 2008
14. C. A. Laben and B. V. Brower, "Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening," U.S. Patent 6 011 875, 2000
15. Q. Xu, B. Li, Y. Zhang, and L. Ding, "High-fidelity component substitution pansharpening by the fitting of substitution data," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 11, pp. 7380-7392, Nov. 2014
16. X. Kang, S. Li, and J. A. Benediktsson, "Pansharpening with Matting model," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 8, pp. 5088-5099, Aug. 2014
17. S. Mallat, "A theory for multiresolution signal decomposition: The wavelet representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 7, pp. 674-693, Jul. 1989
18. G. P. Nason and B. W. Silverman, "The stationary wavelet transform and some statistical applications," in Wavelets and Statistics, vol. 103, A. Antoniadis and G. Oppenheim, Eds. New York, NY, USA: Springer-Verlag, 1995, pp. 281-299
19. M. J. Shensa, "The discrete wavelet transform: Wedding the a trous and Mallat algorithm," IEEE Trans. Signal Process., vol. 40, no. 10, pp. 2464-2482, Oct. 1992
20. P. J. Burt and E. H. Adelson, "The Laplacian pyramid as a compact image code," IEEE Trans. Commun., vol. COM-31, no. 4, pp. 532-540, Apr. 1983
21. M. N. Do and M. Vetterli, "The contourlet transform: An efficient directional multiresolution image representation," IEEE Trans. Image Process., vol. 14, no. 12, pp. 2091-2106, Dec. 2005
22. J.-L. Starck, J. Fadili, and F. Murtagh, "The undecimated wavelet decomposition and its reconstruction," IEEE Trans. Image Process., vol. 16, no. 2, pp. 297-309, Feb. 2007
23. J. C. Price, "Combining panchromatic and multispectral imagery from dual resolution satellite instruments," Remote Sens. Environ., vol. 21, no. 2, pp. 119-128, Mar. 1987
24. D. Fasbender, J. Radoux, and P. Bogaert, "Bayesian data fusion for adaptable image pansharpening," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 6, pp. 1847-1857, Jun. 2008
25. F. Palsson, J. R. Sveinsson, and M. O. Ulfarsson, "A new pansharpening algorithm based on total variation," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 1, pp. 318-322, Jan. 2014
26. X. He, L. Condat, J. Bioucas-Dias, J. Chanussot, and J. Xia, "A new pansharpening method based on spatial and spectral sparsity priors," IEEE Trans. Image Process., vol. 23, no. 9, pp. 4160-4174, Sep. 2014
27. E. J. Candes, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489-509, Feb. 2006
28. D. L. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006
29. S. Li and B. Yang, "A new pan-sharpening method using a compressed sensing technique," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 2, pp. 738-746, Feb. 2011
30. X. X. Zhu and R. Bamler, "A sparse image fusion algorithm with application to pan-sharpening," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 5, pp. 2827-2836, May 2013
31. S. C. Park, M. K. Park, and M. G. Kang, "Super-resolution image reconstruction: A technical overview," IEEE Signal Process. Mag., vol. 20, no. 3, pp. 21-36, May 2003
32. Z. Pan et al., "Superresolution based on compressive sensing and structural self-similarity for remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 9, pp. 4864-4876, Sep. 2013
33. A. Garzelli, L. Capobianco, L. Alparone, B. Aiazzi, and S. Baronti, "Hyperspectral pansharpening based on modulation of pixel spectra," presented at the 2nd WHISPERS Conf., 2010
34. G. A. Licciardi et al., "Fusion of hyperspectral and panchromatic images using multiresolution analysis and nonlinear PCA band reduction," EURASIP J. Adv. Signal Process., vol. 2012, no. 1, pp. 207:1-207:17, Sep. 2012
35. M. Ehlers, S. Klonus, P. J. Astrand, and P. Rosso, "Multi-sensor image fusion for pansharpening in remote sensing," Int. J. Image Data Fusion, vol. 1, no. 1, pp. 25-45, Feb. 2010
36. L. Wald, T. Ranchin, and M. Mangolini, "Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images," Photogramm. Eng. Remote Sens., vol. 63, no. 6, pp. 691-699, Jun. 1997
37. Q. Du, N. H. Younan, R. L. King, and V. P. Shah, "On the performance evaluation of pan-sharpening techniques," IEEE Geosci. Remote Sens. Lett., vol. 4, no. 4, pp. 518-522, Oct. 2007
38. Z.Wang and A. C. Bovik, "A universal image quality index," IEEE Signal Process. Lett., vol. 9, no. 3, pp. 81-84, Mar. 2002
39. L. Alparone et al., "Multispectral and panchromatic data fusion assessment without reference," Photogramm. Eng. Remote Sens., vol. 74, no. 2, pp. 193-200, Feb. 2008
40. G. Piella and H. Heijmans, "A new quality metric for image fusion," in Proc. ICIP, 2003, vol. 2, pp. III-173-III-176
41. Z. Wang and A. C. Bovik, "Mean squared error: Love it or leave it? A new look at signal fidelity measures," IEEE Signal Process. Mag., vol. 26, no. 1, pp. 98-117, Jan. 2009
42. C. Thomas and L. Wald, "Analysis of changes in quality assessment with scale," in Proc. 9th Int. Conf. Inf. Fusion, 2006, pp. 1-5
43. B. Aiazzi, S. Baronti, and M. Selva, "Improving component substitution pansharpening through multivariate regression of MS+Pan data," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 10, pp. 3230-3239, Oct. 2007
44. T.-M. Tu, S.-C. Su, H.-C. Shyu, and P. S. Huang, "A new look at IHSlike image fusion methods," Inf. Fusion, vol. 2, no. 3, pp. 177-186, Sep. 2001
45. T.-M. Tu, P. S. Huang, C.-L. Hung, and C.-P. Chang, "A fast intensityhue-saturation fusion technique with spectral adjustment for IKONOS imagery," IEEE Geosci. Remote Sens. Lett., vol. 1, no. 4, pp. 309-312, Oct. 2004
46. W. Dou, Y. Chen, X. Li, and D. Sui, "A general framework for component substitution image fusion: An implementation using fast image fusion method," Comput. Geosci., vol. 33, no. 2, pp. 219-228, Feb. 2007
47. J. Choi, K. Yu, and Y. Kim, "A new adaptive component-substitution based satellite image fusion by using partial replacement," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 1, pp. 295-309, Jan. 2011
48. A. R. Gillespie, A. B. Kahle, and R. E. Walker, "Color enhancement of highly correlated images-II. Channel ratio and "Chromaticity" transform techniques," Remote Sens. Environ., vol. 22, no. 3, pp. 343-365, Aug. 1987
49. A. Garzelli, F. Nencini, and L. Capobianco, "Optimal MMSE pan sharpening of very high resolution multispectral images," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 1, pp. 228-236, Jan. 2008
50. B. Aiazzi, S. Baronti, M. Selva, and L. Alparone, "Bi-cubic interpolation for shift-free pan-sharpening," ISPRS J. Photogramm. Remote Sens., vol. 86, no. 6, pp. 65-76, Dec. 2013
51. S. Baronti, B. Aiazzi, M. Selva, A. Garzelli, and L. Alparone, "A theoretical analysis of the effects of aliasing and misregistration on pansharpened imagery," IEEE J. Sel. Topics Signal Process., vol. 5, no. 3, pp. 446-453, Jun. 2011
52. J. Jolliffe, Principal Component Analysis. Hoboken, NJ, USA: Wiley, 2005
53. B. Aiazzi, S. Baronti, F. Lotti, and M. Selva, "A comparison between global and context-Adaptive pansharpening of multispectral images," IEEE Geosci. Remote Sens. Lett., vol. 6, no. 2, pp. 302-306, Apr. 2009
54. T. Ranchin and L. Wald, "Fusion of high spatial and spectral resolution images: The ARSIS concept and its implementation," Photogramm. Eng. Remote Sens., vol. 66, no. 1, pp. 49-61, Jan. 2000
55. R. A. Schowengerdt, Remote Sensing: Models and Methods for Image Processing, 2nd ed. Orlando, FL, USA: Academic, 1997
56. G. Vivone, R. Restaino, M. Dalla Mura, G. Licciardi, and J. Chanussot, "Contrast and error-based fusion schemes for multispectral image pansharpening," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 5, pp. 930-934, May 2014
57. B. Aiazzi, L. Alparone, S. Baronti, A. Garzelli, and M. Selva, "An MTFbased spectral distortion minimizing model for pan-sharpening of very high resolution multispectral images of urban areas," in Proc. 2nd GRSS/ ISPRS Joint Workshop Remote Sens. Data Fusion URBAN Areas, 2003, pp. 90-94
58. B. Aiazzi, L. Alparone, S. Baronti, A. Garzelli, andM. Selva, "Advantages of Laplacian pyramids over "a trous" wavelet transforms,", in Proc. SPIE Image Signal Process. Remote Sens. XVIII, L. Bruzzone, Ed., vol. 8537, 2012, pp. 853 704-1-853 704-10
59. J. G. Liu, "Smoothing filter based intensity modulation: A spectral preserve image fusion technique for improving spatial details," Int. J. Remote Sens., vol. 21, no. 18, pp. 3461-3472, Dec. 2000
60. L.Wald and T. Ranchin, "Comment: Liu 'Smoothing filter-based intensity modulation: A spectral preserve image fusion technique for improving spatial details'," Int. J. Remote Sens., vol. 23, no. 3, pp. 593-597, Jan. 2002
61. M. M. Khan, J. Chanussot, L. Condat, and A. Montavert, "Indusion: Fusion of multispectral and panchromatic images using the induction scaling technique," IEEE Geosci. Remote Sens. Lett., vol. 5, no. 1, pp. 98-102, Jan. 2008
62. B. Aiazzi, L. Alparone, S. Baronti, A. Garzelli, and M. Selva, "MTFtailored multiscale fusion of high-resolution MS and Pan imagery," Photogramm.Eng.RemoteSens., vol. 72, no. 5, pp. 591-596, May 2006
63. X. Otazu, M. González-Audicana, O. Fors, and J. Núnez, "Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 10, pp. 2376-2385, Oct. 2005
64. B. Aiazzi, L. Alparone, S. Baronti, and A. Garzelli, "Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 10, pp. 2300-2312, Oct. 2002
65. J. Lee and C. Lee, "Fast and efficient panchromatic sharpening," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 1, pp. 155-163, Jan. 2010
66. L. Amolins, Y. Zhang, and P. Dare, "Wavelet based image fusion techniques-An introduction, review and comparison," ISPRS J. Photogramm. Remote Sens., vol. 62, no. 4, pp. 249-263, Sep. 2007
67. B. Garguet-Duport, J. Girel, J.-M. Chassery, and G. Pautou, "The use of multiresolution analysis and wavelet transform for merging SPOT panchromatic and multispectral image data," Photogramm. Eng. Remote Sens., vol. 62, no. 9, pp. 1057-1066, Sep. 1996
68. J. Núnez et al., "Multiresolution-based image fusion with additive wavelet decomposition," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 3, pp. 1204-1211, May 1999
69. M. González-Audicana, X. Otazu, O. Fors, and A. Seco, "Comparison between Mallat's and the 'a trous' discrete wavelet transform based algorithms for the fusion of multispectral and panchromatic images," Int. J. Remote Sens., vol. 26, no. 3, pp. 595-614, Feb. 2005
70. M. Vetterli and J. Kovacevic, Wavelets and Subband Coding. Englewood Cliffs, NJ, USA: Prentice-Hall, 1995
71. G. Strang and T. Nguyen, Wavelets and Filter Banks, 2nd ed. Wellesley, MA, USA: Wellesley Cambridge Press, 1996
72. R. H. Yuhas, A. F. H. Goetz, and J. W. Boardman, "Discrimination among semi-Arid landscape endmembers using the Spectral AngleMapper (SAM) algorithm," in Proc. Summaries 3rd Annu. JPL Airborne Geosci. Workshop, 1992, pp. 147-149
73. L. Wald, Data Fusion: Definitions and Architectures-Fusion of Images of Different Spatial Resolutions. Paris, France: Les Presses de l' École des Mines, 2002
74. L. Alparone, S. Baronti, A. Garzelli, and F. Nencini, "A global quality measurement of pan-sharpened multispectral imagery," IEEE Geosci. Remote Sens. Lett., vol. 1, no. 4, pp. 313-317, Oct. 2004
75. A. Garzelli and F. Nencini, "Hypercomplex quality assessment of multi-/ hyper-spectral images," IEEE Geosci. Remote Sens. Lett., vol. 6, no. 4, pp. 662-665, Oct. 2009
76. T. Updike and C. Comp, "Radiometric use of WorldView-2 imagery," DigitalGlobe, Longmont, CO, USA, Tech. Rep., Nov. 2010
77. B. Aiazzi et al., "Effects of multitemporal scene changes on pansharpening fusion," in Proc. 6th IEEE Int. Workshop Anal. MultiTemp. Remote Sens., 2011, pp. 73-76