Adjustable model-based fusion method for multispectral and panchromatic images

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 42, Issue 6, 2012, Pages 1693-1704

  Zhang, Liangpei ^a   Shen, Huanfeng ^a   Gong, Wei ^a   Zhang, Hongyan ^a  

^a WUHAN UNIVERSITY   (China)

Author keywords

Adjustable image fusion; maximum a posteriori (MAP); model based; remote sensing

Indexed keywords

FUSION METHODS; GRADIENT DESCENT ALGORITHMS; HIGH SPATIAL RESOLUTION; IKONOS IMAGES; IMAGE FUSION METHODS; MAXIMUM A POSTERIORI; MODEL-BASED; MULTI-SPECTRAL; OBSERVATION MODEL; PANCHROMATIC IMAGES; QUANTITATIVE EVALUATION; QUICKBIRD; REGULARIZATION PARAMETERS; SPATIAL INFORMATIONS; SPECTRAL INFORMATION;

INVERSE PROBLEMS; ITERATIVE METHODS; PROBABILITY DENSITY FUNCTION; REMOTE SENSING;

IMAGE FUSION;

EID: 84869488524     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2198810     Document Type: Article

References (54)

1. C. P. Ruiz and F. J. A. Lopez, "Restoring SPOT images using PSF-derived deconvolution filters," Int. J. Remote Sens., vol. 23, no. 12, pp. 2379-2391, Jun. 2002.
2. B. J. Kang and K. R. Park, "Real-Time image restoration for iris recognition systems," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 6, pp. 1555-1566, Dec. 2007. (Pubitemid 350201162)
3. K. Panetta, S. Agaian, Y. Zhou, and E. J. Wharton, "Parameterized logarithmic framework for image enhancement," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 2, pp. 460-473, Apr. 2010.
4. H. Shen, L. Zhang, B. Huang, and P. Li, "A MAP approach for joint motion estimation, segmentation, super resolution," IEEE Trans. Image Process., vol. 16, no. 2, pp. 479-490, Feb. 2007. (Pubitemid 46421688)
5. M. K. Ng, H. Shen, S. Chaudhuri, and A. C. Yau, "Zoom-based superresolution reconstruction approach using prior total variation," Opt. Eng., vol. 46, no. 12, p. 127 003, Dec. 2007.
6. M. V. Joshi, S. Chaudhuri, and R. Panuganti, "A learning-based method for image super-resolution from zoomed observations," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 35, no. 3, pp. 527-537, Jun. 2005. (Pubitemid 40794863)
7. C. Pohl and J. L. van Genderen, "Multisensor image fusion remote sensing: Concepts, methods and applications," Int. J. Remote Sens., vol. 19, no. 5, pp. 823-854, Mar. 1998.
8. P. S. Chavez, Jr., S. C. Sides, and J. A. Anderson, "Comparison of three different methods to merge multiresolution and multispectral data. Landsat TMand SPOT panchromatic," Photogram. Eng. Remote Sens., vol. 57, no. 3, pp. 295-303, Mar. 1991.
9. V. K. Shettigara, "A generalized component substitution technique for spatial enhancement ofmultispectral images using a higher resolution data set," Photogram. Eng. Remote Sens., vol. 58, no. 5, pp. 561-567, 1992.
10. X. Li, Y. Pang, and Y. Yuan, "L1-norm-based 2D PCA," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 4, pp. 1170-1175, Aug. 2010.
11. Y. Pang, D. Tao, Y. Yuan, and X. Li, "Binary two-dimensional PCA," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 4, pp. 1176-1180, Aug. 2008.
12. M. Gonzalez-Audicana, X. Otazu, O. Fors, and J. Alvarez-Mozos, "A low computational-cost method to fuse IKONOS images using the spectral response function of its sensors," IEEE Trans. Geosci. Remote Sens., vol. 44, no. 6, pp. 1683-1691, Jun. 2006.
13. Y. Zhang, "A new automatic approach for effectively fusing Landsat 7 as well as IKONOS images," in Proc. IGARSS, Toronto, ON, Canada, 2002, pp. 2429-2431. (Pubitemid 35228649)
14. C. A. Laben and B. V. Brower, "Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening," U.S. Patent 6 011 875, Jan. 4, 2000.
15. B. Aiazzi, L. Alparone, S. Baronti, A. Garzelli, and M. Selva, "MTFtailored multiscale fusion of high-resolutionMS and pan imagery," Photogramm. Eng. Remote Sens., vol. 72, no. 5, pp. 591-596, May 2006. (Pubitemid 43848078)
16. B. Aiazzi, L. Alparone, S. Baronti, and A. Garzelli, "Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 10, pp. 2300-2312, Oct. 2002.
17. X. Otazu, M. Gonzalez-Audicana, O. Fors, and J. Nunez, "Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods," IEEE Trans. Geoscience and Remote Sensing, vol. 43, no. 10, pp. 2376-2385, Oct. 2005. (Pubitemid 41637795)
18. M. Choi, R. Y. Kim, M. R. Nam, and H. O. Kim, "Fusion of multispectral and panchromatic satellite images using the curvelet transform," IEEE Geosci. Remote Sens. Lett., vol. 2, no. 2, pp. 136-140, Apr. 2005. (Pubitemid 40680161)
19. H. Song, S. Yu, L. Song, and X. Yang, "Fusion of multispectral and panchromatic satellite images based on contourlet transform and local average gradient," Opt. Eng., vol. 46, p. 020502, Feb. 2007.
20. C. Thomas, T. Ranchin, L. Wald, and J. Chanussot, "Synthesis of multispectral images to high spatial resolution: A critical review of fusion methods based on remote sensing physics," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 5, pp. 1301-1312, May 2008.
21. U. Pradhan and D. W. Holcomb, "Optimizing the high-pass filter addition technique for image fusion," Photogramm. Eng. Remote Sens., vol. 74, no. 9, pp. 1107-1118, Sep. 2008.
22. J. G. Liu, "Smoothing filter-based intensity modulation: A spectral preserve image fusion technique for improving spatial details," Int. J. Remote Sens., vol. 21, no. 18, pp. 3461-3472, Dec. 2000. (Pubitemid 32045194)
23. M. Ehlers, "Spectral characteristics preserving image fusion based on Fourier domain filtering," in Proc. SPIE-Remote Sens. Environ. Monit., GIS Appl., Geol. IV, Maspalomas, Gran Canaria, Spain, 2004.
24. H. Gross and J. Schott, "Application of spectral mixture analysis and image fusion techniques for image sharpening," Remote Sens. Environ., vol. 63, no. 2, pp. 85-94, Feb. 1998. (Pubitemid 29360407)
25. M. T. Eismann and R. C. Hardie, "Application of the stochastic mixing model to hyperspectral resolution enhancement," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 9, pp. 1924-1933, Sep. 2004.
26. S. C. Park, M. K. Park, and M. G. Kang, "Super-resolution image reconstruction: A technical overview," IEEE Signal Process. Mag., vol. 20, no. 3, pp. 21-36, May 2003.
27. M. L. S. Aguena and N. Mascarenhas, "Multispectral image data fusion using projections onto convex sets techniques," in Proc. XV Braz. Symp. Comput. Graph. Image Process., 2002, pp. 76-82.
28. R. C. Hardie, M. T. Eismann, and G. L. Wilson, "MAP estimation for hyperspectral image resolution enhancement using an auxiliary sensor," IEEE Trans. Image Process., vol. 13, no. 9, pp. 1174-1184, Sep. 2004.
29. Y. Zhang, S. De Backer, and P. Scheunders, "Noise-resistant waveletbased Bayesian fusion of multispectral and hyperspectral images," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 11, pp. 3834-3843, Nov. 2009.
30. R. Molina, M. Vega, J. Mateos, and A. K. Katsaggelos, "Variational posterior distribution approximation Bayesian super resolution reconstruction of multispectral images," Appl. Comput. Harmon. Anal., special issue on "Mathematical Imaging," Part II, vol. 24, no. 2, pp. 251-267, Mar. 2008.
31. M. V. Joshi, L. Bruzzone, and S. Chaudhuri, "A model-based approach to multiresolution fusion remotely sensed images," IEEE Trans. Geosci. Remote Sens., vol. 44, no. 9, pp. 2549-2562, Sep. 2006.
32. L. Joshi and A. Jalobeanu, "MAP estimation for multiresolution fusion remotely sensed images using an IGMRF prior mode," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 3, pp. 1245-1255, Mar. 2010.
33. Z. Li and H. Leung, "Fusion of multispectral and panchromatic images using a restoration-based method," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 5, pp. 1482-1491, May 2009.
34. H. Aans, J. R. Sveinsson, A. A. Nielsen, T. Bovith, and J. A. Benediktsson, "Model-based satellite image fusion," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 5, pp. 1336-1346, May 2008.
35. S. Li and B. Yang, "A new pan-sharpening method using a compressed sensing technique," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 2, pp. 738-746, Feb. 2011.
36. G. A. Boggione, E. G. Pires, P. A. Santos, and L. M. G. Fonseca, "Simulation of a panchromatic band by spectral combination of multispectral ETM+ bands," in Proc. ISRSE, Honolulu, HI, 2003.
37. M. Vega, J. Mateos, R. Molina, and A. K. Katsaggelos, "Super-resolution of multispectral images," Comput. J., vol. 52, no. 1, pp. 153-167, Jan. 2009.
38. M. K. Ng, W. C. Kwan, and R. H. Chan, "A fast algorithm for highresolution color image reconstruction with multisensors," in Proc. Numer. Anal. Appl., vol. 1988, Lecture Notes Computer Science, pp. 615-627.
39. S. Farsiu, M. Elad, and P. Milanfar, "Multiframe demosaicing and superresolution of color images," IEEE Trans. Image Process., vol. 15, no. 1, pp. 141-159, Jan. 2006. (Pubitemid 43051464)
40. M. K. Ng, H. Shen, L. Zhang, and E. Lam, "A total variation based superresolution reconstruction algorithm for digital video," EURASIP J. Adv. Signal Process., vol. 2007, p. 74 585, 2007.
41. R. R. Schultz and R. L. Stevenson, "Extraction of high-resolution frames from video sequences," IEEE Trans. Image Process., vol. 5, no. 6, pp. 996-1011, June 1996. (Pubitemid 126776754)
42. D. Jing and C. Zhijun, "Study on adjustable image fusion method for remote sensing," Acta Opt. Sin., vol. 5, pp. 25 593-25 597, May 2005.
43. T. M. Tu, Y. C. Lee, C. P. Chang, and P. S. Huang, "Adjustable intensity-hue-saturation and Brovey transform fusion technique for IKONOS/QuickBird imagery," Opt. Eng., vol. 44, p. 116 201, Nov 2005.
44. N. Nguyen, P. Milanfar, and G. Golub, "Efficient generalized crossvalidation with applications to parametric image restoration and resolution enhancement," IEEE Trans. Image Process., vol. 10, no. 9, pp. 1299-1308, Sep. 2001. (Pubitemid 32949954)
45. N. K. Bose, S. Lertrattanapanich, and J. Koo, "Advances superresolution using L-curve," in Proc. IEEE Int. Symp. Circuits Syst., 2001, pp. 433-436.
46. D. Krawczyk-StánDo and M. Rudnicki, "Regularization parameter selection discrete ill-posed problems-The use of the U-curve," Int. J. Appl. Math. Comput. Sci., vol. 17, no. 2, pp. 157-164, Jun. 2007.
47. Q. Yuan, L. Zhang, H. Shen, and P. Li, "Adaptive multiple-frame image super-resolution based on U-curve," IEEE Trans. Image Process., vol. 19, no. 12, pp. 3157-3170, Dec. 2010.
48. M. G. Kang and A. K. Katsaggelos, "General choice of the regularization functional regularized image restoration," IEEE Trans. Image Process., vol. 4, no. 5, pp. 594-602, May 1995.
49. E. S. Lee and M. G. Kang, "Regularized adaptive high-resolution image reconstruction considering inaccurate subpixel registration," IEEE Trans. Image Process., vol. 12, no. 7, pp. 826-837, July 2003.
50. H. Hu and L. P. Kondi, "An image super-resolution algorithm for different error levels per frame," IEEE Trans. Image Process., vol. 15, no. 3, pp. 592-603, Mar. 2006. (Pubitemid 43257558)
51. T. Ranchin, B. Aiazzi, L. Alparone, S. Baronti, and L. Wald, "Image fusion-The ARSIS concept and some successful implementation schemes," ISPRS J. Photogramm. Remote Sens., vol. 58, no. 1/2, pp. 4-18, Jun. 2003. (Pubitemid 36614798)
52. Z. J. Wang, D. Ziou, C. Armenakis, D. Li, and Q. Q. Li, "A comparative analysis of image fusion methods," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 6, pp. 1391-1402, Jun. 2005. (Pubitemid 40811947)
53. H. S. Stone, M. T. Orchard, E.-C. Chang, and S. A. Martucci, "A fast direct Fourier-based algorithm for subpixel registration of images," IEEE Trans. Geosci. Remote Sens., vol. 39, no. 10, pp. 2235-2243, Oct. 2001. (Pubitemid 33048393)
54. X. Li, S. Lin, S. Yan, and D. Xu, "Discriminant locally linear embedding with high-order tensor data," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 2, pp. 342-352, Apr. 2008. (Pubitemid 351479557)