An edge preserving multiresolution fusion: Use of contourlet transform and MRF prior

IEEE Transactions on Geoscience and Remote Sensing

Volumn 53, Issue 6, 2015, Pages 3210-3220

  Upla, Kishor P ^a   Joshi, Manjunath V ^b   Gajjar, Prakash P ^c  

^a SARDAR VALLABHBHAI NATIONAL INSTITUTE OF TECHNOLOGY   (India)

^b DHIRUBHAI AMBANI INSTITUTE OF INFORMATION AND COMMUNICATION TECHNOLOGY   (India)

^c Department of Electronics and Communication   (India)

Author keywords

Canny edge detector; Contourlet transform (CT); gradient descent; image fusion; Markov random field (MRF); maximum a posteriori (MAP)

Indexed keywords

COMPUTERIZED TOMOGRAPHY; IMAGE FUSION; IMAGE RESOLUTION; IMAGE SEGMENTATION; MARKOV PROCESSES; OPTIMIZATION; PIXELS; SPECTRAL RESOLUTION; TEXTURES;

CANNY EDGE DETECTORS; CONTOURLET TRANSFORM; GRADIENT DESCENT; MARKOV RANDOM FIELDS; MAXIMUM A POSTERIORI;

IMAGE TEXTURE;

DATA SET; IKONOS; IMAGE PROCESSING; OPTIMIZATION; PANCHROMATIC IMAGE; PIXEL; RESOLUTION; SPATIAL RESOLUTION; WORLDVIEW;

EID: 85027954725     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2014.2371812     Document Type: Article

References (55)

1. L. Wald, " Some terms of reference in data fusion," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 3, pp. 1190-1193, May 1999.
2. W. J. Carper, T. M. Lillesand, and R.W. Kiefer, " The use of intensity-huesaturation transform for merging SPOT panchromatic and multispectral image data," Photogramm. Eng. Remote Sens., vol. 56, no. 4, pp. 459-467, Apr. 1990.
3. E. M. Schetselaar, " Fusion by the IHS transform should we use cylindrical of spherical coordinates?," Int. J. Remote Sens., vol. 19, no. 4, pp. 759-765, Jan. 1998.
4. M. Gonzalez, A. Audicana, J. L. Saleta, R. G. Catalan, and R. Garcia, " Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 6, pp. 1291-1299, Jun. 2004.
5. R. Hayden, G. W. Dalke, J. Henkel, and J. E. Bare, " Application of the IHS color transform to the processing of multisensor data and image enhancement," Proc. Int. Symp. Remote Sens. Arid Semi-Arid Lands, 1982, pp. 599-607.
6. P. S. Chavez, " Digital merging of Landsat TM and digitized NHAP data 1: 24,000 scale image mapping," Photogramm. Eng. Remote Sens., vol. 52, no. 10, pp. 1637-1647, Oct. 1986.
7. L. Wald, T. Ranchin, and M. Mangolini, " Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images," Photogramm. Eng. Remote Sens., vol. 63, no. 6, pp. 691-699, Jun. 1997.
8. P. S. J. Chavez, S. C. Sides, and J. A. Anderson, " Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic," Photogramm. Eng. Remote Sens., vol. 57, no. 3, pp. 295-303, Mar. 1991.
9. M. Ehlers, " Multisensor image fusion techniques in remote sensing," ISPRS J. Photogramm. Remote Sens., vol. 46, no. 1, pp. 19-30, Feb. 1991.
10. J. Choi, K. Yu, and Y. Kim, " A new adaptive component-substitution based satellite image fusion by using partial replacement," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 1, pp. 295-309, Jan. 2011.
11. S. Rahmani, M. Strait, D. Merkurjev, M. Moeller, and T. Wittman, " An adaptive IHS PAN-sharpening method," IEEE Geosci. Remote Sens. Lett., vol. 7, no. 4, pp. 746-750, Oct. 2010.
12. Z. Li and H. Leung, " Fusion of multispectral and panchromatic images using a restoration-based method," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 5, pp. 1482-1491, May 2009.
13. R. C. Hardie, M. T. Eismann, and G. L. Wilson, " MAP estimation for hyperspectral image resolution enhancement using an auxiliary sensor," IEEE Trans. Image Process., vol. 13, no. 9, pp. 1174-1184, Sep. 2004.
14. L. Zhang, H. Shen, W. Gong, and H. Zhang, " Adjustable modelbased fusion method for multispectral and panchromatic images," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 6, pp. 1693-1704, Dec. 2012.
15. M. V. Joshi and A. Jalobeanu, " MAP estimation for multiresolution fusion in remotely sensed images using an IGMRF prior model," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 3, pp. 1245-1255, Mar. 2010.
16. D. Fasbender, J. Radoux, and P. Bogaert, " Bayesian data fusion for adaptable image pansharpening," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 6, pp. 1847-1857, Jun. 2008.
17. S. Li and B. Yang, " A new pansharpening method using a compressed sensing technique," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 2, pp. 738-746, Feb. 2011.
18. C. Jiang, H. Zhang, H. Shen, and L. Zhang, " A practical compressed sensing based pan sharpening method," IEEE Trans. Geosci. Lett., vol. 9, no. 4, pp. 629-633, Jul. 2012.
19. X. X. Zhu and R. Bamler, " A sparse image fusion algorithm with application to pansharpening," IEEE Trans. Geosci. Remote Sens., vol. 51, no. 5, pp. 2827-2836, May 2013.
20. E. Yu and R. Wang, " Fusion and enhancement of the multispectral image with wavelet transform," Comput. Eng. Sci., vol. 23, no. 1, pp. 47-50, 2001.
21. J. Zhou, D. L. Civco, and J. A. Silander, " A wavelet transform method to merge Landsate TM and SPOT panchromatic data," Int. J. Remote Sens., vol. 19, no. 4, pp. 743-757, Jan. 1998.
22. T. Ranchin and L. Wald, " Fusion of high spatial and spectral resolution images: The ARSIS concept and its implementation," Photogramm. Eng. Remote Sens., vol. 66, no. 1, pp. 49-61, Jan. 2000.
23. J. Nunez et al., " Multiresolution based image fusion with additive wavelet decomposition," IEEE Trans. Geosci. Remote Sens., vol. 37, no. 3, pp. 1204-1211, May 1999.
24. T. Ranchin, B. Aiazzi, L. Alparone, S. Baronti, and L. Wald, " Image fusion-The ARSIS concept and some successful implementation schemes," ISPRS J. Photogramm. Remote Sens., vol. 58, no. 1/2, pp. 4-18, Jun. 2003.
25. A. Garzelli, G. Bennelli, M. Barni, and C. Magini, " Improving wavelet based merging of panchromatic and multispectral images by contextual information," in Proc. SPIE Image Signal Process. Remote Sens., 2000, pp. 82-91.
26. X. Otazu, M. Gonzalez-Audicana, O. Fors, and J. Nunez, " Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 10, pp. 2376-2385, Oct. 2005.
27. T. A. Wilson, S. K. Rogers, and M. Kabrisky, " Perceptual based image fusion for hyperspectral data," IEEE Trans. Geosci. Remote Sens., vol. 35, no. 4, pp. 1007-1017, Jul. 1997.
28. B. Aiazzi, L. Alparone, S. Baronti, and A. Garzelli, " Context driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis," IEEE Trans. Geosci. Remote Sens., vol. 40, no. 10, pp. 2300-2312, Oct. 2002.
29. A. G. Mahyari and M. Yazdi, " Fusion of panchromatic and multispectral images using temporal Fourier transform," IET Image Process., vol. 4, no. 4, pp. 255-260, Aug. 2010.
30. V. P. Shah and N. H. Younan, " An efficient pan-sharpening method via a combined adaptive PCA approach and contourlets," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 5, pp. 1323-1335, May 2008.
31. H. Shi, B. Tian, and Y. Wang, " Fusion of multispectral and panchromatic satellite images using principal component analysis and nonsubsampled contourlet transform," in Proc. 7th Int. Conf. FSKD, 2010, pp. 2313-2315.
32. A. G. Mahyari and M. Yazdi, " Panchromatic and multispectral image fusion based on maximization of both spectral and spatial similarities," IEEE Trans. Geosci. Sens., vol. 49, no. 6, pp. 1976-1985, Jun. 2011.
33. K. P. Upla, P. P. Gajjar, and M. V. Joshi, " Multiresoltution fusion using contourlet transform based edge learning," in Proc. IEEE Int. Geosci. Remote Sens. Symp., 2011, pp. 523-526.
34. D. Rajan and S. Chaudhuri, " Simultaneous estimation of super-resolved scene and depth map from low resolution defocused observations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 9, pp. 1102-1117, Sep. 2003.
35. A. N. Rajagopalan and S. Chaudhuri, " An MRF based approach to simultaneous recovery of depth and restoration from defocussed images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 7, pp. 577-589, Jul. 1999.
36. M. N. Do and M. Vetterli, " The contourlet transform: An efficient directional multiresolution image representation," IEEE Trans. Image Process., vol. 14, no. 12, pp. 2091-2106, Dec. 2005.
37. A. L. da Cunha, J. Zhou, and M. N. Do, " The nonsubsampled contourlet transform: Theory, design, and applications," IEEE Trans. Image Process., vol. 15, no. 10, pp. 3089-3101, Oct. 2006.
38. M. Do andM. Vetterli, " Framing pyramids," IEEE Trans. Signal Process., vol. 51, no. 9, pp. 2329-2342, Sep. 2003.
39. H. R. Bamberger and M. J. T. Smith, " A filter bank for the directional decomposition of images: Theory and design," IEEE Trans. Signal Process., vol. 40, no. 4, pp. 882-893, Apr. 1992.
40. P. J. Burt and E. H. Adelson, " The Laplacian pyramid as a compact image code," IEEE Trans. Commun., vol. COM-31, no. 4, pp. 532-540, Apr. 1983.
41. V. N. Katsikis and D. Pappars, " Fast computing of the moore-penrose inverse matrix," Electron. J. Linear Algebra, vol. 17, pp. 637-650, Nov. 2008.
42. S. Z. Li, Markov Random Field Modeling in Computer Vision. London, U.K.: Springer-Verlag, 1995.
43. R. R. Schultz and R. L. Stevenson, " Extraction of high-resolution frames from video sequences," IEEE Trans. Image Process., vol. 5, no. 6, pp. 996-1011, Jun. 1996.
44. Sep. 2012. [Online]. Available: http: //www.isprs.org/data/ikonos-hobart/ default.aspx
45. Feb. 2014. [Online]. Available: http: //www.glcf.umd.edu/data/quickbird/ sundarbans.shtml
46. May 2013. [Online]. Available: http: //www.digitalglobe.com/downloads/ microsites/dfc/optical/WV2-9Oct20 11.zip
47. M. Vetterli and C. Herley, " Wavelets and filter banks: Theory and design," IEEE Trans. Signal Process., vol. 40, no. 9, pp. 2207-2232, Sep. 1993.
48. S. M. Phoong, C.W. Kim, P. P. Vaidyanathan, and R. Ansari, " A new class of two-channel biorthogonal filter banks and wavelet bases," IEEE Trans. Signal Process., vol. 43, no. 3, pp. 649-665, Mar. 1993.
49. L. Zhang, L. Zhang, X. Mou, and D. Zhang, " FSIM: A feature similarity index for image quality assessment," IEEE Trans. Image Process., vol. 20, no. 8, pp. 2378-2386, Aug. 2011.
50. L.Wald, " Quality of high resolution synthesized images: Is there a simple criterion?" in Proc. Int. Conf. Fusion Earth Data, 2000, pp. 46-61.
51. C. Chang, " Spectral information divergence for hyperspectral image analysis," in Proc. IEEE Int. Geosci. Remote Sens. Symp., 1999, vol. 1, pp. 509-511.
52. Z.Wang and A. C. Bovik, " A universal image quality index," IEEE Signal Process. Lett., vol. 9, no. 3, pp. 81-84, Mar. 2002.
53. L. Alparone et al., " Multispectral and panchromatic data fusion assessment without reference," Photogramm. Eng. Remote Sens., vol. 74, no. 2, pp. 193-200, Feb. 2008.
54. M. Xu, H. Chen, and P. K. Vershney, " An image fusion approach based on Markov random fields," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 12, pp. 5116-5127, Dec. 2011.
55. A. Eshtehardi, H. Ebadi, M. J. Valadan, and A. Mohammadzadeh, " Image fusion of Landsat ETM+ and SPOT setellite images using IHS, Brovey and PCA," presented at the Technical Session III-Image Data Fusion, ISPRS Commiss. VII, WG2/WG7 Conf. Information Extraction SAR Optical Data, Emphasis Developing Countries, Istanbul, Turkey, May 16-18, 2007.