Fusing Meter-Resolution 4-D InSAR Point Clouds and Optical Images for Semantic Urban Infrastructure Monitoring

IEEE Transactions on Geoscience and Remote Sensing

Volumn 55, Issue 1, 2017, Pages 14-26

  Wang, Yuanyuan ^a   Zhu, Xiao Xiang ^a,b   Zeisl, Bernhard ^c   Pollefeys, Marc ^c  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b GERMAN AEROSPACE CENTER DLR   (Germany)

^c ETH ZURICH   (Switzerland)

Author keywords

Bridge monitoring; interferometric synthetic aperture radar (InSAR); optical InSAR fusion; railway monitoring; SAR; semantic classification

Indexed keywords

BRIDGES; DEFORMATION; GEOMETRICAL OPTICS; INTERFEROMETRY; REMOTE SENSING; SEMANTICS; SYNTHETIC APERTURE RADAR;

DEFORMATION MONITORING; DEFORMATION PARAMETER; SAR INTERFEROMETRY; SAR TOMOGRAPHY (SARTOM); SEMANTIC CLASSIFICATION; STATE-OF-THE-ART METHODS; SYNTHETIC APERTURE RADAR INTERFEROMETRY; URBAN INFRASTRUCTURE;

RADAR IMAGING;

BRIDGE; ENVIRONMENTAL MONITORING; GEOMETRY; IMAGE CLASSIFICATION; INTERFEROMETRY; MACHINE LEARNING; OPTICAL METHOD; PIXEL; RAILWAY; REMOTE SENSING; SPATIAL RESOLUTION; SYNTHETIC APERTURE RADAR; THREE-DIMENSIONAL MODELING; URBAN AREA;

EID: 84991101920     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2016.2554563     Document Type: Article

References (64)

1. R. Bamler, M. Eineder, N. Adam, X. X. Zhu., S. Gernhardt, "Interferometric potential of high resolution spaceborne SAR," Photogrammetrie-Fernerkundung-Geoinf., vol. 5, pp. 407-419, Nov. 2009.
2. U. Soergel, Ed., Radar Remote Sensing of Urban Areas, vol. 15. Dordrecht, Netherlands: Springer, 2010.
3. Y. Wang and X. X. Zhu, "InSAR forensics: Tracing InSAR scatterers in high resolution optical image," presented at the Fringe, 2015, pp. 1-8.
4. Y. Wang and X. X. Zhu, "Semantic interpretation of InSAR point clouds," in Proc. IEEE Int. Geosci. Remote Sens. Symp. (IGARSS), Milan, Italy, Jul. 2015, pp. 5019-5022.
5. C. Frueh, R. Sammon., A. Zakhor, "Automated texture mapping of 3D city models with oblique aerial imagery," in Proc. 2nd Int. Symp. 3D Data Process., Vis. Transmiss. (3DPVT), Sep. 2004, pp. 396-403.
6. F. Lombardini, "Differential tomography: A new framework for SAR interferometry," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 1, pp. 37-44, Jan. 2005.
7. G. Fornaro, D. Reale., F. Serafino, "Four-dimensional SAR imaging for height estimation and monitoring of single and double scatterers," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 1, pp. 224-237, Jan. 2009.
8. X. X. Zhu and R. Bamler, "Very high resolution spaceborne SAR tomography in urban environment," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 12, pp. 4296-4308, Dec. 2010.
9. X. X. Zhu and R. Bamler, "Tomographic SAR inversion by L1-norm regularization-The compressive sensing approach," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 10, pp. 3839-3846, Oct. 2010.
10. G. Fornaro, F. Serafino., F. Soldovieri, "Three-dimensional focusing with multipass SAR data," IEEE Trans. Geosci. Remote Sens., vol. 41, no. 3, pp. 507-517, Mar. 2003.
11. A. Reigber and A. Moreira, "First demonstration of airborne SAR tomography using multibaseline L-band data," IEEE Trans. Geosci. Remote Sens., vol. 38, no. 5, pp. 2142-2152, Sep. 2000.
12. X. X. Zhu and R. Bamler, "Let's do the time warp: Multicomponent nonlinear motion estimation in differential SAR tomography," IEEE Geosci. Remote Sens. Lett., vol. 8, no. 4, pp. 735-739, Jul. 2011.
13. S. Agarwal et al., "Building Rome in a day," Commun. ACM, vol. 54, no. 10, pp. 105-112, Oct. 2011.
14. M. Pollefeys et al., "Detailed real-time urban 3D reconstruction from video," Int. J. Comput. Vis., vol. 78, nos. 2-3, pp. 143-167, Jul. 2008.
15. M. Pollefeys et al., "Visual modeling with a hand-held camera," Int. J. Comput. Vis., vol. 59, no. 3, pp. 207-232, Sep. 2004.
16. N. Snavely, S. M. Seitz., R. Szeliski, "Modeling the world from Internet photo collections," Int. J. Comput. Vis., vol. 80, no. 2, pp. 189-210, Nov. 2008.
17. C. Wu, "Towards linear-time incremental structure from motion," in Proc. Int. Conf. 3D Vis.-3DV, Jun./Jul. 2013, pp. 127-134.
18. H. Hirschmuller, "Stereo processing by semiglobal matching and mutual information," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, pp. 328-341, Feb. 2008.
19. M. Pollefeys, R. Koch., L. Van Gool, "Self-calibration and metric reconstruction inspite of varying and unknown intrinsic camera parameters," Int. J. Comput. Vis., vol. 32, no. 1, pp. 7-25, Aug. 1999.
20. M. A. Ali and D. A. Clausi, "Automatic registration of SAR and visible band remote sensing images," in Proc. IEEE Int. Geosci. Remote Sens. Symp. (IGARSS), vol. 3. Jun. 2002, pp. 1331-1333.
21. H. Cheng, S. Zheng, Q. Yu, J. Tian., J. Liu, "Matching of SAR images and optical images based on edge feature extracted via SVM," in Proc. 7th Int. Conf. Signal Process. (ICSP), vol. 2. Aug./Sep. 2004, pp. 930-933.
22. B. Fan, C. Huo, C. Pan., Q. Kong, "Registration of optical and SAR satellite images by exploring the spatial relationship of the improved SIFT," IEEE Geosci. Remote Sens. Lett., vol. 10, no. 4, pp. 657-661, Jul. 2013.
23. T. D. Hong and R. A. Schowengerdt, "A robust technique for precise registration of radar and optical satellite images," Photogram. Eng. Remote Sens., vol. 71, no. 5, pp. 585-593, May 2005.
24. H. Li, B. S. Manjunath., S. K. Mitra, "A contour-based approach to multisensor image registration," IEEE Trans. Image Process., vol. 4, no. 3, pp. 320-334, Mar. 1995.
25. G. Palubinskas and P. Reinartz, "Template based matching of optical and SAR imagery," in Proc. Joint Urban Remote Sens. Event (JURSE), Lausanne, Switzerland, Mar./Apr. 2015, pp. 1-4.
26. S. Auer, C. Gisinger., J. Tao, "Characterization of facade regularities in high-resolution SAR images," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 5, pp. 2727-2737, May 2015.
27. J. Tao, S. Auer, G. Palubinskas, P. Reinartz., R. Bamler, "Automatic SAR simulation technique for object identification in complex urban scenarios," IEEE J. Sel. Topics Appl. Earth Observ. Remote Ses., vol. 7, no. 3, pp. 994-1003, Mar. 2014.
28. L. Schack, U. Soergel., C. Heipke, "Persistent scatterer aided facade lattice extraction in single airborne optical oblique images," ISPRS Ann. Photogram. Remote Sens. Spatial Inf. Sci., vol. II-3/W4, pp. 197-205, Mar. 2015.
29. D. Brunner, G. Lemoine., L. Bruzzone, "Earthquake damage assessment of buildings using VHR optical and SAR imagery," IEEE Trans. Geosci. Remote Sens., vol. 48, no. 5, pp. 2403-2420, May 2010.
30. S. Gernhardt and R. Bamler, "Deformation monitoring of single buildings using meter-resolution SAR data in PSI," ISPRS J. Photogram. Remote Sens., vol. 73, pp. 68-79, Sep. 2012.
31. Y. Wang and X. X. Zhu, "Automatic feature-based geometric fusion of multiview TomoSAR point clouds in urban area," IEEE J. Sel. Topics Appl. Earth Observ. Remote Ses., vol. 8, no. 3, pp. 953-965, Mar. 2015.
32. Z. Zhang, "Iterative point matching for registration of free-form curves and surfaces," Int. J. Comput. Vis., vol. 13, no. 2, pp. 119-152, 1994.
33. R. S. J. Estépar, A. Brun., C.-F. Westin, "Robust generalized total least squares iterative closest point registration," in Medical Image Computing and Computer-Assisted Intervention-MICCAI. Springer-Verlag Berlin Heidelberg, 2004, pp. 234-241.
34. L. Maier-Hein, T. R. dos Santos, A. M. Franz., H.-P. Meinzer, "Iterative closest point algorithm in the presence of anisotropic noise," in Proc. Bildverarbeitung Med., 2010, pp. 231-235.
35. M. Eineder, C. Minet, P. Steigenberger, X. Cong., T. Fritz, "Imaging geodesy-Toward centimeter-level ranging accuracy with TerraSAR-X," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 2, pp. 661-671, Feb. 2011.
36. X. Cong, U. Balss, M. Eineder., T. Fritz, "Imaging geodesy-Centimeter-level ranging accuracy with TerraSAR-X: An update," IEEE Geosci. Remote Sens. Lett., vol. 9, no. 5, pp. 948-952, Sep. 2012.
37. M. Eineder et al., "TerraSAR-X pixel localization accuracy: Approaching the centimeter level," in Proc. IEEE Int. Geosci. Remote Sens. Symp. (IGARSS), Jul. 2014, pp. 2669-2670.
38. I. Sobel, "An isotropic 3 3 image gradient operator," Presented at Stanford AI Project, 1968.
39. P. J. Huber, Robust Statistics. Hoboken, NJ, USA: Wiley, 1981.
40. A. M. Zoubir, V. Koivunen, Y. Chakhchoukh., M. Muma, "Robust estimation in signal processing: A tutorial-style treatment of fundamental concepts," IEEE Signal Process. Mag., vol. 29, no. 4, pp. 61-80, Jul. 2012.
41. Y. Wang and X. X. Zhu, "Robust estimators for multipass SAR interferometry," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 2, pp. 968-980, Feb. 2016.
42. E. Ollila and V. Koivunen, "Influence functions for array covariance matrix estimators," in Proc. IEEE Workshop Statist. Signal Process., Sep./Oct. 2003, pp. 462-465.
43. M. Shahzad and X. X. Zhu, "Robust reconstruction of building facades for large areas using spaceborne TomoSAR point clouds," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 2, pp. 752-769, Feb. 2015.
44. X. X. Zhu and M. Shahzad, "Façade reconstruction using multiview spaceborne TomoSAR point clouds," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 6, pp. 3541-3552, Jun. 2014.
45. M. Shahzad and X. X. Zhu, "Automatic detection and reconstruction of 2-D/3-D building shapes from spaceborne TomoSAR point clouds," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 3, pp. 1292-1310, Mar. 2016.
46. S. Katz, A. Tal., R. Basri, "Direct visibility of point sets," ACM Trans. Graph., vol. 26, no. 3, p. 24, Jul. 2007.
47. R. Mehra, P. Tripathi, A. Sheffer., N. J. Mitra, "Visibility of noisy point cloud data," Comput. Graph., vol. 34, no. 3, pp. 219-230, Jun. 2010.
48. F. R. Gonzalez, N. Adam, A. Parizzi., R. Brcic, "The integrated wide area processor (IWAP): A processor for wide area persistent scatterer interferometry," presented at the ESA Living Planet Symp., Edinburgh, U.K., 2013.
49. N. Adam, B. Kampes, M. Eineder, J. Worawattanamateekul., M. Kircher, "The development of a scientific permanent scatterer system," in Proc. ISPRS Workshop High Resolution Mapping Space, Hanover, Germany, 2003, p. 6.
50. X. X. Zhu, Y. Wang, S. Gernhardt., R. Bamler, "Tomo-GENESIS: DLR's tomographic SAR processing system," in Proc. Joint Urban Remote Sens. Event (JURSE), Apr. 2013, pp. 159-162.
51. X. Zhu, Very High Resolution Tomographic SAR Inversion for Urban Infrastructure Monitoring: A Sparse and Nonlinear Tour, vol. 666. Munich, Germany, Deutsche Geodätische Kommission, 2011.
52. X. X. Zhu and R. Bamler, "Demonstration of super-resolution for tomographic SAR imaging in urban environment," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 8, pp. 3150-3157, Aug. 2012.
53. Y. Wang, X. X. Zhu., R. Bamler, "An efficient tomographic inversion approach for urban mapping using meter resolution SAR image stacks," IEEE Geosci. Remote Sens. Lett., vol. 11, no. 7, pp. 1250-1254, Jul. 2014.
54. (2015). Pix4D. [Online]. Available: https://www.pix4d.com/
55. X. X. Zhu, S. Montazeri, C. Gisinger, R. F. Hanssen., R. Bamler, "Geodetic SAR tomography," IEEE Trans. Geosci. Remote Sens., vol. 54, no. 1, pp. 18-35, Jan. 2016.
56. C. Gisinger et al., "Precise three-dimensional stereo localization of corner reflectors and persistent scatterers with TerraSAR-X," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 4, pp. 1782-1802, Apr. 2015.
57. G. Csurka, C. R. Dance, L. Fan, J. Willamowski., C. Bray, "Visual categorization with bags of keypoints," in Proc. Workshop Statist. Learn. Comput. Vis. ECCV, vol. 1. 2004, pp. 1-2.
58. C. Cortes and V. Vapnik, "Support-vector networks," Mach. Learn., vol. 20, no. 3, pp. 273-297, Sep. 1995.
59. A. Vedaldi and B. Andrea, "VLFeat: An open and portable library of computer vision algorithms," in Proc. 18th Int. Conf. Multimedia, Florence, Italy, 2010, pp. 1469-1472.
60. A. D. Kerr, "Analysis of thermal track buckling in the lateral plane," Acta Mech., vol. 30, nos. 1-2, pp. 17-50, Mar. 1978.
61. K. Bredies, K. Kunisch., T. Pock, "Total generalized variation," SIAM J. Imag. Sci., vol. 3, no. 3, pp. 492-526, Jan. 2010.
62. F. Knoll, K. Bredies, T. Pock., R. Stollberger, "Second order total generalized variation (TGV) for MRI," Magn. Reson. Med., vol. 65, no. 2, pp. 480-491, Feb. 2011.
63. X. X. Zhu, N. Ge., M. Shahzad, "Joint sparsity in SAR tomography for urban mapping," IEEE J. Sel. Topics Signal Process., vol. 9, no. 8, pp. 1498-1509, Dec. 2015.
64. J. Kang, Y. Wang, M. Köner., X. X. Zhu, "Object-based InSAR deformation reconstruction with application to bridge monitoring," in Proc. IEEE Int. Geosci. Remote Sens. Symp. (IGARSS), Beijing, China, Jul. 2016.