Quantitative Quality Evaluation of Pansharpened Imagery: Consistency Versus Synthesis

IEEE Transactions on Geoscience and Remote Sensing

Volumn 54, Issue 3, 2016, Pages 1247-1259

  Palsson, Frosti ^a   Sveinsson, Johannes R ^a   Ulfarsson, Magnus Orn ^a   Benediktsson, Jon Atli ^a  

^a UNIVERSITY OF ICELAND   (Iceland)

Author keywords

Consistency; Image fusion; Pansharpening; Quality no reference (QNR); Quantitative quality evaluation; Synthesis

Indexed keywords

IMAGE PROCESSING; IMAGE RESOLUTION; INVERSE PROBLEMS; QUALITY CONTROL; SYNTHESIS (CHEMICAL);

COMPONENT SUBSTITUTION; CONSISTENCY PROPERTY; HIGH SPATIAL RESOLUTION MULTISPECTRAL IMAGES; ILL-POSED INVERSE PROBLEM; MULTISPECTRAL IMAGES; PANCHROMATIC IMAGES; RELATIVE PERFORMANCE; RELIABLE ASSESSMENT;

IMAGE QUALITY;

IMAGE PROCESSING; IMAGE RESOLUTION; MULTISPECTRAL IMAGE; PANCHROMATIC IMAGE; QUALITATIVE ANALYSIS; QUANTITATIVE ANALYSIS; QUICKBIRD; SPATIAL RESOLUTION; SPECTRAL ANALYSIS; WORLDVIEW;

EID: 84943188581     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2015.2476513     Document Type: Article

References (56)

1. L. Bruzzone et al., "Can multiresolution fusion techniques improve classification accuracy?" in Proc. SPIE Remote Sens., 2006, pp. 636 509.
2. F. Palsson, J. R. Sveinsson, J. A. Benediktsson, and H. Aanaes, "Classification of pansharpened urban satellite images," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 5, no. 1, pp. 281-297, Feb. 2012.
3. T.-M. Tu, S.-C. Su, H.-C. Shyu, and P. S. Huang, "A new look at IHS-like image fusion methods," Inf. Fusion, vol. 2, no. 3, pp. 177-186, Sep. 2001.
4. L. Leung, J. Liu, and J. Zhang, "An improved adaptive intensity hue saturation method for the fusion of remote sensing images," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 5, pp. 985-989, May 2014.
5. T.-M. Tu, P. Huang, C.-L. Hung, and C.-P. Chang, "A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery," IEEE Geosci. Remote Sens. Lett., vol. 1, no. 4, pp. 309-312, Oct. 2004.
6. C. Laben and B. Brower, "Process for Enhancing the Spatial Resolution of Multispectral Imagery Using Pan-Sharpening," U.S. Patent 6 011 875, Jan. 4, 2000. [Online]. Available: https://www.google.com/patents/ US6011875
7. B. Aiazzi, S. Baronti, and M. Selva, "Improving component substitution pansharpening through multivariate regression of MS+Pan data," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 10, pp. 3230-3239, Oct. 2007.
8. A. Garzelli, F. Nencini, and L. Capobianco, "Optimal MMSE pan sharpening of very high resolution multispectral images," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 1, pp. 228-236, Jan. 2008.
9. P. S. Chavez, Jr. and A. W. Kwarteng, "Extracting spectral contrast in Landsat thematic mapper image data using selective principal component analysis," Photogramm Eng. Remote Sens., vol. 55, no. 3, pp. 329-348, Mar. 2004.
10. V. K. Shettigara, "A generalized component substitution technique for spatial enhancement of multispectral images using a higher resolution data set," Photogramm Eng. Remote Sens., vol. 58, no. 5, pp. 561-567, Jan. 1992.
11. A. R. Gillespie, A. B. Kahle, and R. E. Walker, "Color enhancement of highly correlated images. II. Channel ratio and chromaticity transformation techniques," Remote Sens. Environ., vol. 22, no. 3, pp. 343-365, Sep. 1987.
12. X. Kang, S. Li, and J. Benediktsson, "Pansharpening with matting model," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 8, pp. 5088-5099, Aug. 2014.
13. P. Dutilleux, "An implementation of the algorithme trous to compute the wavelet transform," in Wavelets, ser. Inverse Problems and Theoretical Imaging, J.-M. Combes, A. Grossmann, and P. Tchamitchian, Eds. Berlin, Germany: Springer-Verlag, 1989, pp. 298-304.
14. T. Ranchin and L. Wald, "Fusion of high spatial and spectral resolution images: The ARSIS concept and its implementation," Photogramm. Eng. Remote Sens., vol. 66, no. 1, pp. 49-61, Jan. 2000.
15. P. Massip, P. Blanc, and L. Wald, "A method to better account for modulation transfer functions in ARSIS-based pansharpening methods," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 3, pp. 800-808, Mar. 2012.
16. M. Shensa, "The discrete wavelet transform: Wedding the a trous and Mallat algorithms," IEEE Trans. Signal Process., vol. 40, no. 10, pp. 2464-2482, Oct. 1992.
17. J. Nunez et al., "Multiresolution-based image fusion with additive wavelet decomposition," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 3, pp. 1204-1211, May 1999.
18. G. Vivone, R. Restaino, M. Dalla Mura, G. Licciardi, and J. Chanussot, "Contrast and error-based fusion schemes for multispectral image pans- harpening," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 5, pp. 930-934, May 2014.
19. M. Khan, J. Chanussot, L. Condat, and A. Montanvert, "Indusion: Fusion of multispectral and panchromatic images using the induction scaling technique," IEEE Geosci. Remote Sens. Lett., vol. 5, no. 1, pp. 98-102, Jan. 2008.
20. G. Vivone et al., "A critical comparison among pansharpening algorithms," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 5, pp. 2565-2586, May 2015.
21. V. Harikumar, P. Gajjar, M. Joshi, and M. Raval, "Multiresolution image fusion: Use of compressive sensing and graph cuts," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 7, no. 5, pp. 1771-1780, May 2014.
22. S. Li, H. Yin, and L. Fang, "Remote sensing image fusion via sparse representations over learned dictionaries," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 9, pp. 4779-4789, Sep. 2013.
23. S. Abdullah, N. ur Rehman, M. Khan, and D. Mandic, "A multivariate empirical mode decomposition based approach to pansharpening," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 7, pp. 3974-3984, Jul. 2015.
24. F. Palsson, J. R. Sveinsson, and M. O. Ulfarsson, "A new pansharpening algorithm based on total variation," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 1, pp. 318-322, Jan. 2014.
25. F. Palsson, J. R. Sveinsson, M. O. Ulfarsson, and J. A. Benediktsson, "Model-based fusion of multi- and hyperspectral images using PCA and wavelets," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 5, pp. 2652-2663, May 2015.
26. X. He, L. Condat, J. Bioucas-Dias, J. Chanussot, and J. Xia, "A new pansharpening method based on spatial and spectral sparsity priors," IEEE Trans. Image Process., vol. 23, no. 9, pp. 4160-4174, Sep. 2014.
27. C. K. Munechika, J. S. Warnick, C. Salvaggio, and J. R. Schott, "Resolution enhancement of multispectral image data to improve classification accuracy," Photogramm. Eng. Remote Sens., vol. 59, no. 1, pp. 67-72, Jan. 1993.
28. L. Wald, T. Ranchin, and M. Mangolini, "Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images," Photogramm. Eng. Remote Sens., vol. 63, no. 6, pp. 691-699, Jun. 1997.
29. L. Wald, Data Fusion: Definitions and Architectures: Fusion of Images of Different Spatial Resolutions. Paris, France: Les Presses de l'École des Mines, 2002.
30. J. Zhou, D. L. Civco, and J. A. Silander, "A wavelet transform method to merge Landsat TM and SPOT panchromatic data," Int. J. Remote Sens., vol. 19, no. 4, pp. 743-757, Nov. 1998.
31. M. Khan, L. Alparone, and J. Chanussot, "Pansharpening quality assessment using the modulation transfer functions of instruments," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 11, pp. 3880-3891, Nov. 2009.
32. A. Medina, J. Marcello, D. Rodriguez, F. Eugenio, and J. Martin, "Quality evaluation of pansharpening techniques on different land cover types," in Proc. IEEE IGARSS, Jul. 2012, pp. 5442-5445.
33. Q. Du, N. Younan, R. King, and V. Shah, "On the performance evaluation of pan-sharpening techniques," IEEE Geosci. Remote Sens. Lett., vol. 4, no. 4, pp. 518-522, Oct. 2007.
34. W. Pei, G. Wang, and X. Yu, "Performance evaluation of different references based image fusion quality metrics for quality assessment of remote sensing image fusion," in Proc. IEEE IGARSS, Jul. 2012, pp. 2280-2283.
35. D. Rodriguez-Esparragon et al., "Evaluation of the performance of spatial assessments of pansharpened images," in Proc. IEEE IGARSS, Jul. 2014, pp. 1619-1622.
36. V. Vijayaraj, C. O'Hara, and N. Younan, "Pansharpening and image quality interface," in Proc. IEEE IGARSS, Sep. 2004, vol. 4, pp. 2558-2560.
37. L. Santurri, B. Aiazzi, S. Baronti, and R. Carla, "Influence of spatial resolution on pan-sharpening results," in Proc. IEEE IGARSS, Jul. 2012, pp. 5446-5449.
38. B. Aiazzi, L. Alparone, S. Baronti, and I. Pippi, "Quality assessment of decision-driven pyramid-based fusion of high resolution multispectral with panchromatic image data," in Proc. IEEE/ISPRS Joint Workshop Remote Sens. Data Fusion Urban Areas, 2001, pp. 337-341.
39. G. Palubinskas, "Quality assessment of pan-sharpening methods," in Proc. IEEE IGARSS, Jul. 2014, pp. 2526-2529.
40. L. Wald, "Quality of high resolution synthesized images: Is there a simple criterion?" in Proc. 3rd Conf. Fusion Earth Data, T. Ranchin and L. Wald, Eds., 2000, pp. 99-105.
41. R. H. Yuhas, A. F. Goetz, and J. W. Boardman, "Discrimination among semi-arid landscape endmembers using the spectral angle mapper (SAM) algorithm," in Proc. Summaries 3rd Annu. JPL Airborne Geosci. Workshop, 1992, vol. 1, pp. 147-149.
42. Z. Wang and A. Bovik, "A universal image quality index," IEEE Signal Process. Lett., vol. 9, no. 3, pp. 81-84, Mar. 2002.
43. L. Alparone, S. Baronti, A. Garzelli, and F. Nencini, "A global quality measurement of pan-sharpened multispectral imagery," IEEE Geosci. Remote Sens. Lett., vol. 1, no. 4, pp. 313-317, Oct. 2004.
44. A. Garzelli and F. Nencini, "Hypercomplex quality assessment of multi/hyperspectral images," IEEE Geosci. Remote Sens. Lett., vol. 6, no. 4, pp. 662-665, Oct. 2009.
45. L. Alparone et al., "Multispectral and panchromatic data fusion assessment without reference," Photogramm. Eng. Remote Sens., vol. 74, no. 2, pp. 193-200, Feb. 2008.
46. Z. Wang, A. Bovik, H. Sheikh, and E. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
47. C. Thomas and L. Wald, "Comparing distances for quality assessment of fused images," in Proc. 26th EARSeL Symp., 2007, pp. 101-111.
48. X. Huang, D. Wen, J. Xie, and L. Zhang, "Quality assessment of panchromatic and multispectral image fusion for the ZY-3 satellite: From an information extraction perspective," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 4, pp. 753-757, Apr. 2014.
49. F. Laporterie-Déjean, H. de Boissezon, G. Flouzat, and M.-J. Lefévre-Fonollosa, "Thematic and statistical evaluations of five panchromatic/ multispectral fusion methods on simulated PLEIADES-HR images," Inf. Fusion, vol. 6, no. 3, pp. 193-212, Sep. 2005.
50. W. J. Carper, T. M. Lillesand, and P. W. Kiefer, "The use of intensity-hue-saturation transformations for merging spot panchromatic and mul-tispectral image data," Photogramm. Eng. Remote Sens., vol. 56, no. 4, pp. 459-467, Jan. 1990.
51. J. Choi, K. Yu, and Y. Kim, "A new adaptive component-substitution-based satellite image fusion by using partial replacement," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 1, pp. 295-309, Jan. 2011.
52. R. A. Schowengerdt, Remote Sensing: Models and Methods for Image Processing. San Diego, CA, USA: Academic, 2006.
53. J. Liu, "Smoothing filter-based intensity modulation: A spectral preserve image fusion technique for improving spatial details," Int. J. Remote Sens., vol. 21, no. 18, pp. 3461-3472, Jan. 2000.
54. B. Aiazzi, L. Alparone, S. Baronti, A. Garzelli, and M. Selva, "MTF-tailored multiscale fusion of high-resolution MS and pan imagery," Photogramm. Eng. Remote Sens., vol. 72, no. 5, pp. 591-596, May 2006.
55. G. Strang and T. Nguyen, Wavelets and Filter Banks. Wellesley, U.K.: Wellesley-Cambridge, 1996.
56. B. Aiazzi, L. Alparone, S. Baronti, A. Garzelli, and M. Selva, "An MTF-based spectral distortion minimizing model for pan-sharpening of very high resolution multispectral images of urban areas," in Proc. 2nd GRSS/ISPRS Joint Workshop Remote Sens. Data Fusion Urban Areas, May 2003, pp. 90-94.