Robust registration of multimodal remote sensing images based on structural similarity

IEEE Transactions on Geoscience and Remote Sensing

Volumn 55, Issue 5, 2017, Pages 2941-2958

  Ye, Yuanxin ^a,b   Shan, Jie ^c   Bruzzone, Lorenzo ^b   Shen, Li ^a  

^a SOUTHWEST JIAOTONG UNIVERSITY   (China)

^b UNIVERSITY OF TRENTO   (Italy)

^c PURDUE UNIVERSITY   (United States)

Author keywords

Image registration; multimodal image analysis; phase congruency; structural similarity

Indexed keywords

IMAGE RECONSTRUCTION; NONLINEAR OPTICS; OPTICAL RADAR; RADAR IMAGING; RADIOMETRY; SYNTHETIC APERTURE RADAR; TEMPLATE MATCHING;

AUTOMATIC REGISTRATION; FAST TEMPLATE MATCHING; LIGHT DETECTION AND RANGING; MULTIMODAL IMAGE REGISTRATION; MULTIMODAL REGISTRATION; NORMALIZED CORRELATION COEFFICIENT; REMOTE SENSING IMAGES; STRUCTURAL SIMILARITY;

REMOTE SENSING;

AUTOMATION; DATA ACQUISITION; DATA ASSIMILATION; IMAGE ANALYSIS; LIDAR; RADIOMETRIC METHOD; REMOTE SENSING; SYNTHETIC APERTURE RADAR;

EID: 85014281567     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2017.2656380     Document Type: Article

References (53)

1. B. Zitová and J. Flusser, "Image registration methods: A survey," Image Vis. Comput., vol. 21, pp. 977-1000, Oct. 2003.
2. H. Gonçalves, L. Corte-Real, and J. A. Gonçalves, "Automatic image registration through image segmentation and SIFT," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 7, pp. 2589-2600, Mar. 2011.
3. H. Gonçalves, J. A. Gonçalves, L. Corte-Real, and A. C. Teodoro, "CHAIR: Automatic image registration based on correlation and Hough transform," Int. J. Remote Sens., vol. 33, no. 24, pp. 7936-7968, Jul. 2012.
4. P. Bunting, F. Labrosse, and R. Lucas, "A multi-resolution area-based technique for automatic multi-modal image registration," Image Vis. Comput., vol. 28, no. 8, pp. 1203-1219, Aug. 2010.
5. L. Yu, D. R. Zhang, and E. J. Holden, "A fast and fully automatic registration approach based on point features for multi-source remotesensing images," Comput. Geosci., vol. 34, no. 7, pp. 838-848, Jul. 2008.
6. H. G. Sui, C. Xu, J. Y. Liu, and F. Hua, "Automatic optical-to-SAR image registration by iterative line extraction and Voronoi integrated spectral point matching," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 11, pp. 6058-6072, Nov. 2015.
7. H. Gonçalves, J. Gonçalves, and L. Corte-Real, "HAIRIS: A method for automatic image registration through histogram-based image segmentation," IEEE Trans. Image Process., vol. 20, no. 3, pp. 776-789, Sep. 2011.
8. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
9. K. Mikolajczyk and C. Schmid, "A performance evaluation of local descriptors," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 10, pp. 1615-1630, Oct. 2005.
10. J. Ma, J. C. W. Chan, and F. Canters, "Fully automatic subpixel image registration of multiangle CHRIS/Proba data," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 7, pp. 2829-2839, Jul. 2010.
11. A. Sedaghat, M. Mokhtarzade, and H. Ebadi, "Uniform robust scaleinvariant feature matching for optical remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 11, pp. 4516-4527, Nov. 2011.
12. A. Sedaghat and H. Ebadi, "Remote sensing image matching based on adaptive binning SIFT descriptor," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 10, pp. 5283-5293, Oct. 2015.
13. Y. Ye and J. Shan, "A local descriptor based registration method for multispectral remote sensing images with non-linear intensity differences," ISPRS J. Photogramm. Remote Sens., vol. 90, pp. 83-95, Apr. 2014.
14. H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, "Speeded-up robust features (SURF)," Comput. Vis. Image Understand., vol. 110, no. 3, pp. 346-359, 2008.
15. E. Rublee, V. Rabaud, K. Konolige, and G. Bradski, "ORB: An efficient alternative to SIFT or SURF," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 2564-2571.
16. A. Alahi, R. Ortiz, and P. Vandergheynst, "FREAK: Fast retina keypoint," in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 2012, pp. 510-517.
17. A. Kelman, M. Sofka, and C. V. Stewart, "Keypoint descriptors for matching across multiple image modalities and non-linear intensity variations," in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 2007, pp. 3257-3263.
18. J. Inglada and A. Giros, "On the possibility of automatic multisensor image registration," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 10, pp. 2104-2120, Oct. 2004.
19. Y. Hel-Or, H. Hel-Or, and E. David, "Fast template matching in nonlinear tone-mapped images," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 1355-1362.
20. Y. Hel-Or, H. Hel-Or, and E. David, "Matching by tone mapping: Photometric invariant template matching," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 2, pp. 317-330, Feb. 2014.
21. A. A. Cole-Rhodes, K. L. Johnson, J. LeMoigne, and I. Zavorin, "Multiresolution registration of remote sensing imagery by optimization of mutual information using a stochastic gradient," IEEE Trans. Image Process., vol. 12, no. 12, pp. 1495-1511, Dec. 2003.
22. H. M. Chen, M. K. Arora, and P. K. Varshney, "Mutual informationbased image registration for remote sensing data," Int. J. Remote Sens., vol. 24, no. 18, pp. 3701-3706, Sep. 2003.
23. D. Brunner, G. Lemoine, and L. Bruzzone, "Earthquake damage assessment of buildings using VHR optical and SAR imagery," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 5, pp. 2403-2420, May 2010.
24. M. Ravanbakhsh and C. S. Fraser, "A comparative study of DEM registration approaches," J. Spatial Sci., vol. 58, no. 1, pp. 79-89, Apr. 2013.
25. J. M. Murphy, J. Le Moigne, and D. J. Harding, "Automatic image registration of multimodal remotely sensed data with global shearlet features," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 3, pp. 1685-1704, Mar. 2016.
26. I. Zavorin and J. L. Moigne, "Use of multiresolution wavelet feature pyramids for automatic registration of multisensor imagery," IEEE Trans. Image Process., vol. 14, no. 6, pp. 770-782, Jun. 2005.
27. M. P. Heinrich et al., "Non-local shape descriptor: A new similarity metric for deformable multi-modal registration," in Proc. MICCAI, 2011, pp. 541-548.
28. M. P. Heinrich et al., "MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration," Med. Image Anal., vol. 16, no. 7, pp. 1423-1435, Oct. 2012.
29. H. Rivaz, Z. Karimaghaloo, and D. L. Collins, "Self-similarity weighted mutual information: A new nonrigid image registration metric," Med. Image Anal., vol. 18, no. 2, pp. 343-358, Feb. 2014.
30. Z. Li, D. Mahapatra, J. A. W. Tielbeek, J. Stoker, L. J. van Vliet, and F. M. Vos, "Image registration based on autocorrelation of local structure," IEEE Trans. Med. Imag., vol. 35, no. 1, pp. 63-75, Jan. 2016.
31. P. Kovesi, "Image features from phase congruency," Videre, J. Comput. Vis. Res., vol. 1, no. 3, pp. 1-26, 1999.
32. Y. Ye, and L. Shen, "Hopc: A novel similarity metric based on geometric structural properties for multi-modal remote sensing image matching," in Proc. ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., 2016, pp. 9-16.
33. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 2005, pp. 886-893.
34. J. Canny, "A computational approach to edge-detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 8, no. 6, pp. 679-698, Nov. 1986.
35. A. V. Oppenheim and J. S. Lim, "The importance of phase in signals," Proc. IEEE, vol. 69, no. 5, pp. 529-541, May 1981.
36. M. C. Morrone and R. A. Owens, "Feature detection from local energy," Pattern Recognit. Lett., vol. 6, no. 5, pp. 303-313, Dec. 1987.
37. P. Moreno, A. Bernardino, and J. Santos-Victor, "Improving the SIFT descriptor with smooth derivative filters," Pattern Recognit. Lett., vol. 30, no. 1, pp. 18-26, Jan. 2009.
38. P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan, "Object detection with discriminatively trained part-based models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1627-1645, Sep. 2010.
39. H. Harzallah, F. Jurie, and C. Schmid, "Combining efficient object localization and image classification," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2009, pp. 237-244.
40. A. Shrivastava, T. Malisiewicz, A. Gupta, and A. A. Efros, "Data-driven visual similarity for cross-domain image matching," ACM Trans. Graph., vol. 30, no. 6, pp. 12-15, Dec. 2011.
41. L. di Stefano, M. Marchionni, and S. Mattoccia, "A fast area-based stereo matching algorithm," Image Vis. Comput., vol. 22, no. 12, pp. 983-1005, Oct. 2004.
42. A. Wong and D. A. Clausi, "ARRSI: Automatic registration of remotesensing images," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 5, pp. 1483-1493, May 2007.
43. A. Goshtasby, "Piecewise linear mapping functions for image registration," Pattern Recognit., vol. 19, no. 6, pp. 459-466, 1986.
44. V. J. D. Tsai, "Delaunay triangulations in TIN creation: An overview and a linear-time algorithm," Int. J. Geograph. Inf. Sci., vol. 7, no. 6, pp. 501-524, 1993.
45. Y. Han, J. Choi, Y. Byun, and Y. Kim, "Parameter optimization for the extraction of matching points between high-resolution multisensor images in urban areas," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 9, Sep. 2014, Art. no. 1.
46. A. Myronenko and X. Song, "Intensity-based image registration by minimizing residual complexity," IEEE Trans. Med. Imag., vol. 29, no. 11, pp. 1882-1891, Nov. 2010.
47. J. Pluim, J. Maintz, and M. Viergever, "Image registration by maximization of combined mutual information and gradient information," IEEE Trans. Med. Imag., vol. 19, no. 8, pp. 809-814, Aug. 2000.
48. M. A. Fischler and R. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, 1981.
49. C. L. Tsai, C. Y. Li, G. Yang, and K. S. Lin, "The edge-driven dualbootstrap iterative closest point algorithm for registration of multimodal fluorescein angiogram sequence," IEEE Trans. Med. Imag., vol. 29, no. 3, pp. 636-649, Mar. 2010.
50. G. Hong and Y. Zhang, "Wavelet-based image registration technique for high-resolution remote sensing images," Comput. Geosci., vol. 34, no. 12, pp. 1708-1720, Dec. 2008.
51. E. Shechtman and M. Irani, "Matching local self-similarities across images and videos," in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
52. Y. Ye, L. Shen, M. Hao, J. Cheng, and Z. Xu, "Robust optical-to-SAR image matching based on shape properties," IEEE Geosci. Remote Sens. Lett., 2017.
53. K. Liu et al., "Rotation-invariant HOG descriptors using Fourier analysis in polar and spherical coordinates," Int. J. Comput. Vis., vol. 106, no. 3, pp. 342-364, Feb. 2014.