Full Scale Regression-Based Injection Coefficients for Panchromatic Sharpening

IEEE Transactions on Image Processing

Volumn 27, Issue 7, 2018, Pages 3418-3431

  Vivone, Gemine ^a   Restaino, Rocco ^a   Chanussot, Jocelyn ^b  

^a UNIVERSITY OF SALERNO   (Italy)

^b UNIV GRENOBLE ALPES   (France)

Author keywords

data fusion; full scale estimation; Iterative methods; pansharpening; remote sensing

Indexed keywords

BENCHMARKING; DATA FUSION; IMAGE RESOLUTION; REGRESSION ANALYSIS; REMOTE SENSING; SPECTRAL RESOLUTION;

ASYMPTOTIC VALUES; HIGH SPATIAL RESOLUTION; HIGH SPECTRAL RESOLUTION; ITERATIVE ALGORITHM; PAN-SHARPENING; REDUCED RESOLUTION; SCALE ESTIMATION; SPATIAL RESOLUTION;

ITERATIVE METHODS;

EID: 85044388326     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2018.2819501     Document Type: Article

References (62)

1. R. A. Schowengerdt, Remote Sensing: Models and Methods for Image Processing. 3rd ed. Orlando, FL, USA: Elsevier, 2007.
2. L. Alparone, B. Aiazzi, S. Baronti, and A. Garzelli, Remote Sensing Image Fusion. Boca Raton, FL, USA: CRC Press, 2015.
3. A. Mohammadzadeh, A. Tavakoli, and M. J. Valadan Zoej, "Road extraction based on fuzzy logic and mathematical morphology from pan-sharpened IKONOS images," Photogramm. Rec., vol. 21, no. 113, pp. 44-60, Mar. 2006.
4. I. L. Castillejo-González et al., "Object-A nd pixel-based analysis for mapping crops and their agro-environmental associated measures using Quickbird imagery," Comput. Electron. Agricult., vol. 68, no. 2, pp. 207-215, 2009.
5. P. Sirguey, R. Mathieu, Y. Arnaud, M. M. Khan, and J. Chanussot, "Improving MODIS spatial resolution for snow mapping using wavelet fusion and ARSIS concept," IEEE Geosci. Remote Sens. Lett., vol. 5, no. 1, pp. 78-82, Jan. 2008.
6. C. Souza, Jr., L. Firestone, L. M. Silva, and D. Roberts, "Mapping forest degradation in the Eastern Amazon from SPOT 4 through spectral mixture models," Remote Sens. Environ., vol. 87, no. 4, pp. 494-506, Nov. 2003.
7. F. Bovolo, L. Bruzzone, L. Capobianco, A. Garzelli, S. Marchesi, and F. Nencini, "Analysis of the effects of pansharpening in change detection on VHR images," IEEE Geosci. Remote Sens. Lett., vol. 7, no. 1, pp. 53-57, Jan. 2010.
8. G. Vivone et al., "A critical comparison among pansharpening algorithms," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 5, pp. 2565-2586, May 2015.
9. B. Aiazzi, L. Alparone, S. Baronti, A. Garzelli, and M. Selva, "Twentyfive years of pansharpening: A critical review and new developments," in Signal and Image Processing for Remote Sensing, 2nd ed., C.-H. Chen, Ed. Boca Raton, FL, USA: CRC Press, 2012, pp. 533-548.
10. H. Ghassemian, "A review of remote sensing image fusion methods," Inf. Fusion, vol. 32, pp. 75-89, Nov. 2016.
11. S. Li, X. Kang, L. Fang, J. Hu, and H. Yin, "Pixel-level image fusion: A survey of the state of the art," Inf. Fusion, vol. 33, pp. 100-112, Jun. 2017.
12. A. R. Gillespie, A. B. Kahle, and R. E. Walker, "Color enhancement of highly correlated images. II. Channel ratio and 'chromaticity' transformation techniques," Remote Sens. Environ., vol. 22, no. 3, pp. 343-365, Aug. 1987.
13. P. S. Chavez, Jr., A. Y. Kwarteng, "Extracting spectral contrast in landsat thematic mapper image data using selective principal component analysis," Photogramm. Eng. Remote Sens., vol. 55, no. 3, pp. 339-348, 1989.
14. W. J. Carper, T. M. Lillesand, and R. W. Kiefer, "The use of intensityhue-saturation transformations for merging SPOT panchromatic and multispectral image data," Photogramm. Eng. Remote Sens., vol. 56, no. 4, pp. 459-467, Apr. 1990.
15. C. A. Laben and B. V. Brower, "Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening," U.S. Patent 6 011 875A, Jan. 4, 2000.
16. H. A. Aly and G. Sharma, "A regularized model-based optimization framework for pan-sharpening," IEEE Trans. Image Process., vol. 23, no. 6, pp. 2596-2608, Jun. 2014.
17. F. Palsson, J. R. Sveinsson, and M. O. Ulfarsson, "A new pansharpening algorithm based on total variation," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 1, pp. 318-322, Jan. 2014.
18. X. He, L. Condat, J. M. Bioucas-Dias, J. Chanussot, and J. Xia, "A new pansharpening method based on spatial and spectral sparsity priors," IEEE Trans. Image Process., vol. 23, no. 9, pp. 4160-4174, Sep. 2014.
19. G. Vivone et al., "Pansharpening based on semiblind deconvolution," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 4, pp. 1997-2010, Apr. 2015.
20. S. Li and B. Yang, "A new pan-sharpening method using a compressed sensing technique," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 2, pp. 738-746, Feb. 2011.
21. S. Li, H. Yin, and L. Fang, "Remote sensing image fusion via sparse representations over learned dictionaries," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 9, pp. 4779-4789, Sep. 2013.
22. M. R. Vicinanza, R. Restaino, G. Vivone, M. Dalla Mura, and J. Chanussot, "A pansharpening method based on the sparse representation of injected details," IEEE Geosci. Remote Sens. Lett., vol. 12, no. 1, pp. 180-184, Jan. 2015.
23. F. Fang, F. Li, C. Shen, and G. Zhang, "A variational approach for pansharpening," IEEE Trans. Image Process., vol. 22, no. 7, pp. 2822-2834, Jul. 2013.
24. G. Masi, D. Cozzolino, L. Verdoliva, and G. Scarpa, "Pansharpening by convolutional neural networks," Remote Sens., vol. 8, no. 7, p. 594, Jul. 2016.
25. P. S. Chavez, Jr., S. C. Sides, and J. A. Anderson, "Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic," Photogramm. Eng. Remote Sens., vol. 57, no. 3, pp. 295-303, 1991.
26. V. K. Shettigara, "A generalized component substitution technique for spatial enhancement of multispectral images using a higher resolution data set," Photogramm. Eng. Remote Sens., vol. 58, no. 5, pp. 561-567, 1992.
27. V. P. Shah, N. H. Younan, and R. L. King, "An efficient pan-sharpening method via a combined adaptive PCA approach and contourlets," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 5, pp. 1323-1335, May 2008.
28. B. Aiazzi, S. Baronti, and M. Selva, "Improving component substitution pansharpening through multivariate regression of MS+Pan data," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 10, pp. 3230-3239, Oct. 2007.
29. A. Garzelli, F. Nencini, and L. Capobianco, "Optimal MMSE pan sharpening of very high resolution multispectral images," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 1, pp. 228-236, Jan. 2008.
30. J. G. Liu, "Smoothing filter based intensity modulation: A spectral preserve image fusion technique for improving spatial details," Int. J. Remote Sens., vol. 21, no. 18, pp. 3461-3472, Dec. 2000.
31. L. Wald and T. Ranchin, "Comment: Liu 'Smoothing filter-based intensity modulation: A spectral preserve image fusion technique for improving spatial details,"' Int. J. Remote Sens., vol. 23, no. 3, pp. 593-597, Jan. 2002.
32. S. G. Mallat, "A theory for multiresolution signal decomposition: The wavelet representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 7, pp. 674-693, Jul. 1989.
33. G. P. Nason and B. W. Silverman, "The stationary wavelet transform and some statistical applications," in Wavelets and Statistics, vol. 103, A. Antoniadis and G. Oppenheim, Eds. New York, NY, USA: Springer-Verlag, 1995, pp. 281-299.
34. M. J. Shensa, "The discrete wavelet transform: Wedding the a trous and Mallat algorithms," IEEE Trans. Signal Process., vol. 40, no. 10, pp. 2464-2482, Oct. 1992.
35. P. J. Burt and E. H. Adelson, "The Laplacian pyramid as a compact image code," IEEE Trans. Commun., vol. COM-31, no. 4, pp. 532-540, Apr. 1983.
36. M. N. Do and M. Vetterli, "The contourlet transform: An efficient directional multiresolution image representation," IEEE Trans. Image Process., vol. 14, no. 12, pp. 2091-2106, Dec. 2005.
37. J. L. Starck, J. Fadili, and F. Murtagh, "The undecimated wavelet decomposition and its reconstruction," IEEE Trans. Image Process., vol. 16, no. 2, pp. 297-309, Feb. 2007.
38. F. Laporterie, O. Amram, G. Flouzat, E. Pilicht, and M. Gayt, "Data fusion thanks to an improved morphological pyramid approach: Comparison loop on simulated images and application to SPOT 4 data," in Proc. IEEE IGARSS, 2000, pp. 2117-2119.
39. L. Alparone, L. Wald, J. Chanussot, C. Thomas, P. Gamba, and L. M. Bruce, "Comparison of pansharpening algorithms: Outcome of the 2006 GRS-S data-fusion contest," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 10, pp. 3012-3021, Oct. 2007.
40. S. Baronti, B. Aiazzi, M. Selva, A. Garzelli, and L. Alparone, "A theoretical analysis of the effects of aliasing and misregistration on pansharpened imagery," IEEE J. Sel. Topics Signal Process., vol. 5, no. 3, pp. 446-453, Jun. 2011.
41. G. Vivone, R. Restaino, M. Dalla Mura, G. Licciardi, and J. Chanussot, "Contrast and error-based fusion schemes for multispectral image pansharpening," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 5, pp. 930-934, May 2014.
42. B. Aiazzi, L. Alparone, S. Baronti, A. Garzelli, and M. Selva, "An MTF-based spectral distortion minimizing model for pansharpening of very high resolution multispectral images of urban areas," in Proc. 2nd GRSS/ISPRS Joint Workshop Remote Sens. Data Fusion URBAN Areas, 2003, pp. 90-94.
43. R. Restaino, G. Vivone, M. Dalla Mura, and J. Chanussot, "Fusion of multispectral and panchromatic images based on morphological operators," IEEE Trans. Image Process., vol. 25, no. 6, pp. 2882-2895, Jun. 2016.
44. B. Aiazzi, L. Alparone, S. Baronti, A. Garzelli, and M. Selva, "MTFtailored multiscale fusion of high-resolution MS and PAN imagery," Photogramm. Eng. Remote Sens., vol. 72, no. 5, pp. 591-596, May 2006.
45. B. Aiazzi, S. Baronti, F. Lotti, and M. Selva, "A comparison between global and context-adaptive pansharpening of multispectral images," IEEE Geosci. Remote Sens. Lett., vol. 6, no. 2, pp. 302-306, Apr. 2009.
46. R. Restaino, M. Dalla Mura, G. Vivone, and J. Chanussot, "Contextadaptive pansharpening based on image segmentation," IEEE Trans. Geosci. Remote Sens., vol. 55, no. 2, pp. 753-766, Feb. 2017.
47. A. Garzelli, "Pansharpening of multispectral images based on nonlocal parameter optimization," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 4, pp. 2096-2107, Apr. 2015.
48. B. Aiazzi, L. Alparone, S. Baronti, and A. Garzelli, "Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 10, pp. 2300-2312, Oct. 2002.
49. L. Alparone, A. Garzelli, and G. Vivone, "Intersensor statistical matching for pansharpening: Theoretical Issues and practical solutions," IEEE Trans. Geosci. Remote Sens., vol. 55, no. 8, pp. 4682-4695, Aug. 2017.
50. L. Wald, T. Ranchin, and M. Mangolini, "Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images," Photogramm. Eng. Remote Sens., vol. 63, no. 6, pp. 691-699, 1997.
51. J. Choi, K. Yu, and Y. Kim, "A new adaptive component-substitutionbased satellite image fusion by using partial replacement," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 1, pp. 295-309, Jan. 2011.
52. M. Ghahremani and H. Ghassemian, "Nonlinear IHS: A promising method for pan-sharpening," IEEE Geosci. Remote Sens. Lett., vol. 13, no. 11, pp. 1606-1610, Nov. 2016.
53. R. Restaino, G. Vivone, M. Dalla Mura, and J. Chanussot, "A pansharpening algorithm based on morphological filters," in Mathematical Morphology and its Applications to Signal and Image Processing, J. A. Benediktsson, J. Chanussot, L. Najman, and H. Talbot, Eds. New York, NY, USA: Springer, 2015, pp. 98-109.
54. X. X. Zhu and R. Bamler, "A sparse image fusion algorithm with application to pan-sharpening," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 5, pp. 2827-2836, May 2013.
55. C. Chen, Y. Li, W. Liu, and J. Huang, "SIRF: Simultaneous satellite image registration and fusion in a unified framework," IEEE Trans. Image Process., vol. 24, no. 11, pp. 4213-4224, Nov. 2015.
56. R. H. Yuhas, A. F. H. Goetz, and J. W. Boardman, "Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm," in Proc. Summaries 3rd Annu. JPL Airborne Geosci. Workshop, 1992, pp. 147-149.
57. L. Alparone, S. Baronti, A. Garzelli, and F. Nencini, "A global quality measurement of pan-sharpened multispectral imagery," IEEE Geosci. Remote Sens. Lett., vol. 1, no. 4, pp. 313-317, Oct. 2004.
58. A. Garzelli and F. Nencini, "Hypercomplex quality assessment of multi/hyperspectral images," IEEE Trans. Geosci. Remote Sens., vol. 6, no. 4, pp. 662-665, Oct. 2009.
59. B. Aiazzi, L. Alparone, S. Baronti, R. Carlà, A. Garzelli, and L. Santurri, "Full scale assessment of pansharpening methods and data products," Proc. SPIE, vol. 9244, p. 924402, Oct. 2014.
60. M. M. Khan, L. Alparone, and J. Chanussot, "Pansharpening quality assessment using the modulation transfer functions of instruments," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 11, pp. 3880-3891, Nov. 2009.
61. C. Thomas, T. Ranchin, L. Wald, and J. Chanussot, "Synthesis of multispectral images to high spatial resolution: A critical review of fusion methods based on remote sensing physics," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 5, pp. 1301-1312, May 2008.
62. L. Alparone, B. Aiazzi, S. Baronti, A. Garzelli, F. Nencini, and M. Selva, "Multispectral and panchromatic data fusion assessment without reference," Photogramm. Eng. Remote Sens., vol. 74, no. 2, pp. 193-200, Feb. 2008.