SIRF: Simultaneous Satellite Image Registration and Fusion in a Unified Framework

IEEE Transactions on Image Processing

Volumn 24, Issue 11, 2015, Pages 4213-4224

  Chen, Chen ^a   Li, Yeqing ^a   Liu, Wei ^b   Huang, Junzhou ^a  

^a University of Texas at Arlington   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

dynamic gradient sparsity; group sparsity; Image fusion; image registration; joint fusion; pan sharpening

Indexed keywords

ALGORITHMS; COMPUTATIONAL EFFICIENCY; CONVEX OPTIMIZATION; DATA FUSION; IMAGE REGISTRATION; ITERATIVE METHODS; OPTIMIZATION;

CONVEX OPTIMIZATION PROBLEMS; GEOGRAPHICAL LOCATIONS; GROUP SPARSITIES; HIGH-QUALITY PRODUCTS; LEAST SQUARES FITTING; OPTIMIZATION PROBLEMS; PAN-SHARPENING; SPECTRAL INFORMATION;

IMAGE FUSION;

EID: 84939503568     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2456415     Document Type: Article

References (53)

1. C. Thomas, T. Ranchin, L. Wald, and J. Chanussot, "Synthesis of multispectral images to high spatial resolution: A critical review of fusion methods based on remote sensing physics," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 5, pp. 1301-1312, May 2008.
2. P. S. Chavez, S. C. Sides, and J. A. Anderson, "Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic," Photogram. Eng. Remote Sens., vol. 57, no. 3, pp. 295-303, 1991.
3. R. Haydn, G. W. Dalke, J. Henkel, and J. E. Bare, "Application of the IHS color transform to the processing of multisensor data and image enhancement," in Proc. Int. Symp. Remote Sens. Environ., 1982, pp. 599-616.
4. J. Zhou, D. L. Civco, and J. A. Silander, "A wavelet transform method to merge Landsat TM and SPOT panchromatic data," Int. J. Remote Sens., vol. 19, no. 4, pp. 743-757, 1998.
5. I. Amro, J. Mateos, M. Vega, R. Molina, and A. K. Katsaggelos, "A survey of classical methods and new trends in pansharpening of multispectral images," EURASIP J. Adv. Signal Process., vol. 2011, no. 79, pp. 1-22, 2011.
6. A. R. Gillespie, A. B. Kahle, and R. E. Walker, "Color enhancement of highly correlated images. I. Decorrelation and HSI contrast stretches," Remote Sens. Environ., vol. 20, no. 3, pp. 209-235, 1986.
7. H. Aanæs, J. R. Sveinsson, A. A. Nielsen, T. Bovith, and J. A. Benediktsson, "Model-based satellite image fusion," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 5, pp. 1336-1346, May 2008.
8. C. Ballester, V. Caselles, L. Igual, J. Verdera, and B. Rougé, "A variational model for P+XS image fusion," Int. J. Comput. Vis., vol. 69, no. 1, pp. 43-58, 2006.
9. M. Möller, T. Wittman, A. L. Bertozzi, and M. Burger, "A variational approach for sharpening high dimensional images," SIAM J. Imag. Sci., vol. 5, no. 1, pp. 150-178, 2012.
10. F. Fang, F. Li, C. Shen, and G. Zhang, "A variational approach for pansharpening," IEEE Trans. Image Process., vol. 22, no. 7, pp. 2822-2834, Jul. 2013.
11. E. J. Candès, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489-509, Feb. 2006.
12. X. Ding, Y. Jiang, Y. Huang, and J. Paisley, "Pan-sharpening with a Bayesian nonparametric dictionary learning model," in Proc. 17th Int. Conf. Artif. Intell. Statist., 2014, pp. 176-184.
13. S. Li and B. Yang, "A new pan-sharpening method using a compressed sensing technique," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 2, pp. 738-746, Feb. 2011.
14. C. Jiang, H. Zhang, H. Shen, and L. Zhang, "A practical compressed sensing-based pan-sharpening method," IEEE Geosci. Remote Sens. Lett., vol. 9, no. 4, pp. 629-633, Jul. 2012.
15. F. Palsson, J. R. Sveinsson, and M. O. Ulfarsson, "A new pansharpening algorithm based on total variation," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 1, pp. 318-322, Jan. 2014.
16. Z. Li and H. Leung, "Fusion of multispectral and panchromatic images using a restoration-based method," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 5, pp. 1482-1491, May 2009.
17. H. A. Aly and G. Sharma, "A regularized model-based optimization framework for pan-sharpening," IEEE Trans. Image Process., vol. 23, no. 6, pp. 2596-2608, Jun. 2014.
18. J. Inglada, V. Muron, D. Pichard, and T. Feuvrier, "Analysis of artifacts in subpixel remote sensing image registration," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 1, pp. 254-264, Jan. 2007.
19. S. Leprince, S. Barbot, F. Ayoub, and J.-P. Avouac, "Automatic and precise orthorectification, coregistration, and subpixel correlation of satellite images, application to ground deformation measurements," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 6, pp. 1529-1558, Jun. 2007.
20. M. L. Uss, B. Vozel, V. A. Dushepa, V. A. Komjak, and K. Chehdi, "A precise lower bound on image subpixel registration accuracy," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 6, pp. 3333-3345, Jun. 2014.
21. P. Blanc, L. Wald, and T. Ranchin, "Importance and effect of coregistration quality in an example of 'pixel to pixel' fusion process," in Proc. 2nd Conf. Fusion Earth Data, Merging Point Meas., Raster Maps Remotely Sensed Images, 1998, pp. 67-74.
22. A. Beck and M. Teboulle, "A fast iterative shrinkage-thresholding algorithm for linear inverse problems," SIAM J. Imag. Sci., vol. 2, no. 1, pp. 183-202, 2009.
23. C. Chen, Y. Li, W. Liu, and J. Huang, "Image fusion with local spectral consistency and dynamic gradient sparsity," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2014, pp. 2760-2765.
24. M. Yuan and Y. Lin, "Model selection and estimation in regression with grouped variables," J. Roy. Statist. Soc., B (Statistical Methodology), vol. 68, no. 1, pp. 49-67, 2006.
25. X. Bresson and T. F. Chan, "Fast dual minimization of the vectorial total variation norm and applications to color image processing," Inverse Problems Imag., vol. 2, no. 4, pp. 455-484, 2008.
26. J. Huang, C. Chen, and L. Axel, "Fast multi-contrast MRI reconstruction," in Proc. Med. Image Comput. Comput.-Assist. Intervent, 2012, pp. 281-288.
27. C. Chen, Y. Li, and J. Huang, "Calibrationless parallel MRI with joint total variation regularization," in Proc. Med. Image Comput. Comput.-Assist. Intervent., 2013, pp. 106-114.
28. P. Thevenaz, U. E. Ruttimann, and M. Unser, "A pyramid approach to subpixel registration based on intensity," IEEE Trans. Image Process., vol. 7, no. 1, pp. 27-41, Jan. 1998.
29. A. Myronenko and X. Song, "Intensity-based image registration by minimizing residual complexity," IEEE Trans. Med. Imag., vol. 29, no. 11, pp. 1882-1891, Nov. 2010.
30. B. Cohen and I. Dinstein, "New maximum likelihood motion estimation schemes for noisy ultrasound images," Pattern Recognit., vol. 35, no. 2, pp. 455-463, 2002.
31. A. Myronenko, X. Song, and D. J. Sahn, "Maximum likelihood motion estimation in 3D echocardiography through non-rigid registration in spherical coordinates," in Functional Imaging and Modeling of the Heart. Berlin, Germany: Springer-Verlag, 2009, pp. 427-436.
32. P. Viola and W. M. Wells, III, "Alignment by maximization of mutual information," Int. J. Comput. Vis., vol. 24, no. 2, pp. 137-154, 1997.
33. J. Huang, T. Zhang, and D. Metaxas, "Learning with structured sparsity," J. Mach. Learn. Res., vol. 12, pp. 3371-3412, Nov. 2011.
34. J. Huang, X. Huang, and D. Metaxas, "Learning with dynamic group sparsity," in Proc. IEEE Int. Conf. Comput. Vis., Sep./Oct. 2009, pp. 64-71.
35. Y. Zheng et al., "Landmark matching based retinal image alignment by enforcing sparsity in correspondence matrix," Med. Image Anal., vol. 18, no. 6, pp. 903-913, 2014.
36. J. Ma, J. Zhao, J. Tian, A. L. Yuille, and Z. Tu, "Robust point matching via vector field consensus," IEEE Trans. Image Process., vol. 23, no. 4, pp. 1706-1721, Apr. 2014.
37. J. Ma, J. Zhao, Y. Ma, and J. Tian, "Non-rigid visible and infrared face registration via regularized Gaussian fields criterion," Pattern Recognit., vol. 48, no. 3, pp. 772-784, 2015.
38. Y. Peng, A. Ganesh, J. Wright, W. Xu, and Y. Ma, "RASL: Robust alignment by sparse and low-rank decomposition for linearly correlated images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2233-2246, Nov. 2012.
39. A. Sotiras, C. Davatzikos, and N. Paragios, "Deformable medical image registration: A survey," IEEE Trans. Med. Imag., vol. 32, no. 7, pp. 1153-1190, Jul. 2013.
40. S. Suri and P. Reinartz, "Mutual-information-based registration of Terra SAR-X and Ikonos imagery in urban areas," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 2, pp. 939-949, Feb. 2010.
41. K. M. Pohl et al., "A unifying approach to registration, segmentation, and intensity correction," in Proc. Med. Image Comput. Comput.-Assist. Intervent., 2005, pp. 310-318.
42. J. Modersitzki and S. Wirtz, "Combining homogenization and registration," in Biomedical Image Registration. Berlin, Germany: Springer-Verlag, 2006, pp. 257-263.
43. J. Huang, S. Zhang, H. Li, and D. Metaxas, "Composite splitting algorithms for convex optimization," Comput. Vis. Image Understand., vol. 115, no. 12, pp. 1610-1622, 2011.
44. J. R. Bergen, P. Anandan, K. J. Hanna, and R. Hingorani, "Hierarchical model-based motion estimation," in Proc. Eur. Conf. Comput. Vis., 1992, pp. 237-252.
45. M. W. Schmidt, N. LeRoux, and F. Bach, "Convergence rates of inexact proximal-gradient methods for convex optimization," in Proc. Adv. Neural Inf. Process. Syst., 2011, pp. 1458-1466.
46. V. Vijayaraj, C. G. O'Hara, and N. H. Younan, "Quality analysis of pansharpened images," in Proc. IEEE Int. Geosci. Remote Sens. Symp., Sep. 2004, pp. 85-88.
47. L. Wald, T. Ranchin, and M. Mangolini, "Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images," Photogram. Eng. Remote Sens., vol. 63, no. 6, pp. 691-699, 1997.
48. L. Alparone, L. Wald, J. Chanussot, C. Thomas, P. Gamba, and L. M. Bruce, "Comparison of pansharpening algorithms: Outcome of the 2006 GRS-S data-fusion contest," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 10, pp. 3012-3021, Oct. 2007.
49. Z. Wang and A. C. Bovik, "Modern image quality assessment," Synth. Lect. Image, Video, Multimedia Process., vol. 2, no. 1, pp. 1-156, 2006.
50. M. Choi, "A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter," IEEE Trans. Geosci. Remote Sens., vol. 44, no. 6, pp. 1672-1682, Jun. 2006.
51. Space Imaging. (2000). IKONOS Scene, Geo Eye, Dulles, VA, USA. [Online]. Available: http://glcf.umd.edu/data/ikonos/
52. D. Krishnan and R. Fergus, "Dark flash photography," in Proc. SIGGRAPH, 2009, Art. ID 96.
53. M.-Y. Liu, O. Tuzel, and Y. Taguchi, "Joint geodesic upsampling of depth images," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 169-176.