A nonlocal variational model for pansharpening image fusion

SIAM Journal on Imaging Sciences

Volumn 7, Issue 2, 2014, Pages 761-796

  Duran, J ^a,b   Buades, A ^a,b   Coll, B ^a,b   Sbert, C ^a,b  

^a UNIVERSITAT DE LES ILLES BALEARS   (Spain)

^b UNIVERSITÉ PARIS SACLAY   (France)

Author keywords

Energy functional; Image fusion; Multispectral imagery; Neighborhood filter; Nonlocal operators; Pansharpening

Indexed keywords

IMAGE PROCESSING; IMAGING TECHNIQUES;

ENERGY FUNCTIONALS; MULTI-SPECTRAL IMAGERY; NEIGHBORHOOD FILTER; NONLOCAL OPERATOR; PAN-SHARPENING;

IMAGE FUSION;

EID: 84903393691     PISSN: None     EISSN: 19364954     Source Type: Journal    
DOI: 10.1137/130928625     Document Type: Article

References (60)

1. B. Aiazzi, L. Alparone, S. Baronti, and A. Garzelli, Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis, IEEE Trans. Geosci. Remote Sens., 40 (2002), pp. 2300-2312.
2. B. Aksoylu and M. Parks, Variational theory and domain decomposition for nonlocal problems, Appl. Math. Comput., 217 (2011), pp. 6498-6515.
3. F. Andreu, J.M. Mazón, J.D. Rossi, and J. Toledo, A nonlocal p-Laplacian evolution equation with nonhomogeneous Dirichlet boundary conditions, SIAM J. Math. Anal., 40 (2009), pp. 1815-1851.
4. P. Arias, V. Caselles, and G. Sapiro, A variational framework for non-local image inpainting, in Proceedings of the 7th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition, Bonn, Germany, 2009, Lecture Notes in Comput. Sci. 5681, 2009, pp. 345-358.
5. G. Aubert and P. Kornprobst, Can the nonlocal characterization of Sobolev spaces by Bourgain et al. be useful for solving variational problems?, SIAM J. Numer. Anal., 47 (2009), pp. 844-860.
6. C. Ballester, V. Caselles, L. Igual, and J. Verdera, A variational model for P+XS image fusion, Int. J. Comput. Vis., 69 (2006), pp. 43-58.
7. ] J. Boulanger, J.-B. Sibarita, C. Kervrann, and P. Bouthemy, Non-parametric regression for patchbased fluorescence microscopy image sequence denoising, in Proceedings of the 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Paris, France, 2008, pp. 748-751.
8. A. Buades, B. Coll, and J.M. Morel, A review of image denoising algorithms, with a new one, Multiscale Model. Simul., 4 (2005), pp. 490-530.
9. J.W. Carper, T.M. Lillesand, and R.W. Kiefer, The use of intensity-hue-saturation transformations for merging spot panchromatic and multispectral image data, Photogramm. Eng. Remote Sens., 56 (1990), pp. 459-467.
10. T.F. Chan and J. Shen, Image Processing and Analysis: Variational, PDE, Wavelet, and Stochastic Methods, SIAM, Philadelphia, 2005.
11. P.S. Chavez, S.C. Sides, and J.A. Anderson, Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic, Photogramm. Eng. Remote Sens., 57 (1991), pp. 295-303.
12. G. Cliche and F. Bonn, Integration of SPOT panchromatic channel into multispectral mode for image sharpness enhancement, Photogramm. Eng. Remote Sens., 51 (1985), pp. 311-316.
13. K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, Image denoising by sparse 3-D transformdomain collaborative filtering, IEEE Trans. Image Process., 16 (2007), pp. 2080-2095.
14. B. Dacorogna, Direct Methods in the Calculus of Variations, 2nd ed., Appl. Math. Sci. 78, Springer- Verlag, New York, 2008.
15. Q. Du, O. Gungor, and J. Shan, Performance evaluation for pansharpening techniques, in Proceedings of the 25th IEEE International Symposium on Geoscience and Remote Sensing, Vol. 6, Seoul, Korea, 2005, pp. 4264-4266.
16. Q. Du, M. Gunzburger, R.B. Lehoucq, and K. Zhou, A nonlocal vector calculus, nonlocal volumeconstrained problems and nonlocal balance laws, Math. Models Methods Appl. Sci., 13 (2013), pp. 493-540.
17. Q. Du, N.H. Younan, R. King, and V.P. Shah, On the performance evaluation of pan-sharpening techniques, IEEE Geosci. Remote Sens. Lett., 4 (2007), pp. 518-522.
18. J. Duran, A. Buades, B. Coll, and C. Sbert, Implementation of nonlocal pansharpening image fusion, Image Process. On Line, 4 (2014), pp. 1-15.
19. A.A. Efros and T.K. Leung, Texture synthesis by non-parametric sampling, in Proceedings of the 7th IEEE International Conference on Computer Vision, Vol. 2, Kerkyra, Greece, 1999, pp. 1033-1038.
20. M. Ehlers, Multisensor image fusion techniques in remote sensing, Int. Soc. Photogramm. Remote Sens., 46 (1991), pp. 19-30.
21. M.C. El-Mezouar, N. Taleb, K. Kpalma, and J. Ronsin, Vegetation extraction from IKONOS imagery using high spatial resolution index, J. Appl. Remote Sens., 5 (2011), 053543.
22. M. Elad and D. Datsenko, Example-based regularization deployed to super-resolution reconstruction of a single image, Computer J., 52 (2009), pp. 15-30.
23. A. Elmoataz, O. Lézoray, S. Bougleux, and V.T. Ta, Unifying local and nonlocal processing with partial difference operators on weighted graphs, in Proceedings of the International Workshop on Local and Non-Local Approximation in Image Processing, Lausanne, Switzerland, 2008, pp. 11-26.
24. A. Filippidis, L.C. Jain, and N. Martin, Multisensor data fusion for surface land-mine detection, IEEE Trans. Syst. Man Cybern. C, 30 (2000), pp. 145-150.
25. B. Garguet-Duport, J. Girel, J.M. Chassery, and G. Pautou, The use of multiresolution analysis and wavelet transform for merging SPOT panchromatic and multispectral image data, Photogramm. Eng. Remote Sens., 62 (1996), pp. 1057-1066.
26. G. Gilboa, J. Darbon, S. Osher, and T.F. Chan, Nonlocal Convex Functionals for Images Regularizations, Report 06-57, UCLA CAM, 2006.
27. G. Gilboa and S. Osher, Nonlocal linear image regularization and supervised segmentation, Multiscale Model. Simul., 6 (2007), pp. 595-630.
28. G. Gilboa and S. Osher, Nonlocal operators with applications to image processing, Multiscale Model.
29. M. Gunzburger and R.B. Lehoucq, A nonlocal vector calculus with applications to nonlocal boundary value problems, Multiscale Model. Simul., 8 (2010), pp. 1581-1598.
30. W.A. Hallada and S. Cox, Image sharpening for mixed spatial and spectral resolution satellite systems, in Proceedings of the 17th International Symposium on Remote Sensing of Environment, Ann Arbor, MI, 1983, pp. 1023-1032.
31. R. Haydan, G.W. Dalke, J. Henkel, and J.E. Bare, Applications of the IHS color transform to the processing of multisensor data and image enhancement, in Proceedings of the 1st International Symposium on Remote Sensing Environment, Cairo, Egypt, 1982, pp. 599-616.
32. B. Hinds and P. Radu, Dirichlet's principle and wellposedness of solutions for a nonlocal p-Laplacian system, Appl. Math. Comput., 219 (2012), pp. 1411-1419.
33. P.S. Huang and T.-M. Tu, A target fusion-based approach for classifying high spatial resolution imagery, in IEEEWorkshop on Advances in Techniques for Analysis of Remotely Sensed Data, Greenbelt, MD, 2003, pp. 175-181.
34. M. Jung and L.A. Vese, Nonlocal variational image deblurring models in the presence of Gaussian or impulse noise, in Proceedings of the 2nd International Conference on Scale Space and Variational Methods in Computer Vision, Voss, Norway, 2009, Lecture Notes in Comput. Sci. 5567, 2009, pp. 401-412.
35. S. Kindermann, S Osher, and P.W. Jones, Deblurring and denoising of images by nonlocal functionals, Multiscale Model. Simul., 4 (2005), pp. 1091-1115.
36. M. Lebrun, A. Buades, and J.M. Morel, A nonlocal Bayesian image denoising algorithm, SIAM J. Imaging Sci., 6 (2013), pp. 1665-1688.
37. Y. Lou, X. Zhang, S. Osher, and A. Bertozzi, Image recovery via nonlocal operators, J. Sci. Comput., 42 (2010), pp. 185-197.
38. M. Lyons, S. Phinn, and C. Roelfsema, Integrating QuickBird multi-spectral satellite and field data: Mapping bathymetry, seagrass cover, seagrass species and change in Moreton Bay, Australia in 2004 and 2007, Remote Sens., 3 (2011), pp. 42-64.
39. M. Mahmoudi and G. Sapiro, Fast image and video denoising via nonlocal means of similar neighborhoods, IEEE Signal Process. Lett., 12 (2005), pp. 839-842.
40. M. Mignotte, A non-local regularization strategy for image deconvolution, Pattern Recognit. Lett., 29 (2008), pp. 2206-2212.
41. M. Möller, T. Wittman, A.L. Bertozzi, and M. Burger, A variational approach for sharpening high dimensional images, SIAM J. Imaging Sci., 5 (2012), pp. 150-178.
42. J. Nunez, X. Otazu, O. Fors, A. Prades, V. Pala, and R. Arbiol, Multiresolution-based image fusion with additive wavelet decomposition, IEEE Trans. Geosci. Remote Sens., 37 (1999), pp. 1204-1211.
43. D.N. Petley, W.D.O. Crick, and A.B. Hart, The use of satellite imagery in landslide studies in high mountain areas, in Proceedings of the 23rd Asian Conference on Remote Sensing, Kathmandu, Nepal, 2002.
44. C. Pohl and J.L. van Genderen, Multisensor image fusion in remote sensing: Concepts, methods and applications, Int. J. Remote Sens., 19 (1998), pp. 823-854.
45. H. Raggam, M. Franke, M. Ofner, and K. Gutjahr, Accuracy assessment of vegetation height mapping using spaceborne IKONOS as well as aerial ultracam stereo images, in Proceedings of the EARSeL Workshop 3D Remote Sensing Systems, Oporto, Portugal, 2005.
46. L.I. Rudin, S.J. Osher, and E. Fatemi, Nonlinear total variation based noise removal algorithms, Phys. D, 60 (1992), pp. 259-268.
47. V.K. Shettigara, A generalized component substitution technique for spatial enhancement of multispectral images using a higher resolution data set, Photogramm. Eng. Remote Sens., 58 (1992), pp. 561-567.
48. C.M. Souza and D. Roberts, Mapping forest degradation in the Amazon region with IKONOS images, Int. J. Remote Sens., 26 (2005), pp. 425-429.
49. C. Thomas, T. Ranchin, L. Wald, and J. Chanussot, Synthesis of multispectral images to high spatial resolution: A critical review of fusion methods based on remote sensing physics, IEEE Trans. Geosci. Remote Sens., 46 (2008), pp. 1301-1312.
50. T.-M. Tu, P.S. Huang, C.-L. Hung, and C.-P. Chang, A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery, IEEE Geosci. Remote Sens. Lett., 4 (2004), pp. 309-312.
51. V. Vijayaraj, C.G.O. Hara, and N.H. Younan, Quality analysis of pansharpened images, in Proceedings of the IEEE International Symposium on Geoscience and Remote Sensing, Vol. 1, Anchorage, AK, 2004, pp. 85-88.
52. T.A. Wilson, S.K. Rogers, and M. Kabrisky, Perceptual-based image fusion for hyperspectral data, IEEE Trans. Geosci. Remote Sens., 35 (1997), pp. 1007-1017.
53. A. Wong and J. Orchard, A nonlocal-means approach to exemplar-based inpainting, in Proceedings of the 15th IEEE International Conference on Image Processing, San Diego, CA, 2008, pp. 2600-2603.
54. F. Yamazaki, M. Matsuoka, P. Warnitchai, S. Polngam, and S. Ghosh, Tsunami reconnaissance survey in Thailand using satellite images and GPS, Asian J. Geoinf., 5 (2005), pp. 53-61.
55. L. Yatziv and G. Sapiro, Fast image and video colorization using chrominance blending, IEEE Trans. Image Process., 15 (2006), pp. 1120-1129.
56. D.A. Yocky, Image merging and data fusion by means of the discrete two-dimensional wavelet transform, J. Opt. Soc. Amer. A, 12 (1995), pp. 1834-1841.
57. K. Yoshida, Functional Analysis, Springer-Verlag, 1971.
58. X. Zhang, M. Burger, X. Bresson, and S. Osher, Bregmanized nonlocal regularization for deconvolution and sparse reconstruction, SIAM J. Imaging Sci., 3 (2010), pp. 253-276.
59. Y. Zhang, A new merging method and its spectral and spatial effects, Internat. J. Remote Sens., 20 (1999), pp. 2003-2014.
60. J. Zhou, D.L. Civico, and J.A. Silander, A wavelet transform method to merge Landsat and SPOT panchromatic data, Internat. J. Remote Sens., 19 (1998), pp. 743-757.