Context-based automatic reconstruction and texturing of 3D urban terrain for quick-response tasks

ISPRS Journal of Photogrammetry and Remote Sensing

Volumn 93, Issue , 2014, Pages 157-170

  Bulatov, Dimitri ^a   Häufel, Gisela ^a   Meidow, Jochen ^a   Pohl, Melanie ^a   Solbrig, Peter ^a   Wernerus, Peter ^a  

^a FRAUNHOFER IOSB   (Germany)

Author keywords

Building detection; Building reconstruction; Pose estimation; Simulation; Texturing; Urban terrain

Indexed keywords

BUILDINGS; COMPUTER SIMULATION; DISASTER PREVENTION; LANDFORMS; SEMANTICS; SENSORS; TEXTURING;

BUILDING DETECTION; BUILDING RECONSTRUCTION; POSE ESTIMATION; SIMULATION; URBAN TERRAIN;

IMAGE TEXTURE;

AIRBORNE SENSING; DISASTER MANAGEMENT; NUMERICAL MODEL; PARTICIPATORY APPROACH; RECONSTRUCTION; TERRAIN; THREE-DIMENSIONAL MODELING; URBAN AREA;

EID: 84902303011     PISSN: 09242716     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.isprsjprs.2014.02.016     Document Type: Article

References (46)

1. Baillard C., Zisserman A. A plane-sweep strategy for the 3D reconstruction of buildings from multiple images. Int. Arch. Photogramm. Rem. Sensing Spatial Inf. Sci. 2000, 33(Part B2):56-62.
2. Beder, C., Steffen, R. 2008. Incremental estimation without specifying a-priori covariance matrices for the novel parameters. In: Proc. of VLMP Workshop on IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, pp. 1-6.
3. Bodensteiner, C., Arens, M. 2012. Real-time 2D video/3D LiDAR registration. In: IEEE 21st International Conference on Pattern Recognition, Tsukuba (Japan), pp. 2206-2209.
4. Böhm J. Multi-image fusion for occlusion-free façade texturing. Int. Arch. Photogramm. Rem. Sensing Spatial Inf. Sci. 2004, 35(5):867-872.
5. Brenner C. Towards fully automatic generation of city models. Int. Arch. Photogramm. Rem. Sensing Spatial Inf. Sci. 2000, 33(Part B3/1):84-92.
6. L1 splines. Photogramm. Eng. Rem. Sensing 2010, 76(4):439-449.
7. Bulatov, D., Pohl, M. 2013. Detection of small roof details in image sequences. In: Proc. of Scandinavian Conference on Image Analysis, Espoo (Finland), 23-26 June, pp. 601-610.
8. Bulatov D., Wernerus P., Heipke C. Multi-view dense matching supported by triangular meshes. ISPRS J. Photogramm. Rem. Sensing 2011, 66(6):907-918.
9. Bulatov D., Solbrig P., Gross H., Wernerus P., Repasi E., Heipke C. Context-based urban terrain reconstruction from UAV-videos for geoinformation applications. Int. Arch. Photogramm. Rem. Sensing Spatial Inf. Sci. 2011, 38(Part 1C22):75-80.
10. Bulatov, D., Solbrig, P., Wernerus, P. 2012a. Ad-hoc model acquisition for combat simulation in urban terrain. In: Conference on Earth Resources and Environmental Remote Sensing/GIS Applications, 2012, Edinburgh, (United Kingdom), Proceedings of SPIE 8538, 85380G, 10 p.
11. Bulatov D., Rottensteiner F., Schulz K. Context-based urban terrain reconstruction from images and videos. ISPRS Ann. Photogramm. Rem. Sensing Spatial Inf. Sci. 2012, 1(3):185-190.
12. Burns J., Hanson A., Riseman E. Extracting straight lines. IEEE Trans. Pattern Anal. Mach. Intell. 1986, 8(4):425-455.
13. Delong A., Osokin A., Isack H.N., Boykov Y. Fast approximate energy minimization with label costs. Int. J. Comput. Vision 2012, 96(1):1-27.
14. Dubbelman, G., Esteban, I., Schutte, K. 2010. Efficient trajectory bending with applications to loop closure. In: Proc. of IEEE Conference on Intelligent Robots and Systems, Taipei (Taiwan), pp. 1-7.
15. Elberink S.O., Vosselman G. Building reconstruction by target based graph matching on incomplete laser data: analysis and limitations. Sensors 2009, 9(8):6101-6118.
16. El Hakim S., Brenner C., Roth G. A multi-sensor approach to creating accurate virtual environments. ISPRS J. Photogramm. Rem. Sensing 1998, 53(6):379-391.
17. Fischer A., Kolbe T., Lang F., Cremers A., Förstner W., Plümer L., Steinhage V. Extracting buildings from aerial images using hierarchical aggregation in 2D and 3D. Comput Vision Image Understan. 1998, 72(2):185-203.
18. Fischler M., Bolles R. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 1981, 45:381-395.
19. Grady L. Random walks for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 2006, 28(11):1768-1783.
20. Gross H., Thönnessen U. Extraction of lines from laser point clouds. Int. Arch. Photogramm. Rem. Sensing Spatial Inf. Sci. 2006, 36(Part 3/W49):86-91.
21. Gross H., Thönnessen U., Hansen W.v. 3D-Modeling of urban structures. Int. Arch. Photogramm. Rem. Sensing 2005, 36(Part 3W24):137-142.
22. Haala, N. 2005. Multi-Sensor-Photogrammetrie - Vision oder Wirklichkeit? Habilitation, Deutsche Geodätische Kommission, München.
23. Haala N., Rothermel M. Dense multi-stereo matching for high quality digital elevation models. Photogramm. Fernerkundung Geoinf. 2012, 2012(4):331-343.
24. Haala N., Brenner C., Anders K.-H. 3D urban GIS from laser altimeter and 2D map data. Int. Arch. Photogramm. Rem. Sensing Spatial Inf. Sci. 1998, 32(Part 3/1):339-346.
25. Hartigan J., Wong M. Algorithm AS 136: a k-means clustering algorithm. Appl. Statist. 1979, 28(1):100-108.
26. Hartley R., Zisserman A. Multiple View Geometry in Computer Vision 2000, Cambridge University Press.
27. Henricsson, O. 1996. Analysis of image structures using color attributes and similarity relations, Ph.D. thesis, ETH Zürich, No. 11663.
28. Hirschmüller H. Stereo processing by semi-global matching and mutual information. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 30(2):328-341.
29. Huang H., Brenner C., Sester M. A generative statistical approach to automatic 3D building roof reconstruction from laser scanning data. ISPRS J. Photogramm. Rem. Sensing 2013, 79:29-43.
30. Lafarge F., Mallet C. Creating large-scale city models from 3D-point clouds: a robust approach with hybrid representation. Int. J. Comput. Vision 2012, 99(1):69-85.
31. Lafarge F., Keriven R., Brédif M., Vu H. A hybrid multi-view stereo algorithm for modeling urban scenes. IEEE Trans. Pattern Anal. Mach. Intell. 2013, 35(1):5-17.
32. L1 spline fits. Comput. Aided Geom. Des. 2004, 21(1):43-64.
33. Lepetit V., Moreno-Noguer F., Fua P. EPnP: an accurate O(n) solution to the PnP problem. Int. J. Comput. Vision 2009, 81(2):155-166.
34. Martinetz T.M., Schulten K.J. A neural-gas network learns topologies. Artif. Neural Networks 1991, 397-402.
35. Mayer H. 3D reconstruction and visualization of urban scenes from uncalibrated wide-baseline image sequences. Photogramm. Fernerkundung Geoinf. 2007, 2007(3):167-176.
36. Meidow J. Efficient multiple loop adjustment for computer vision tasks. Photogramm. Fernerkundung Geoinf. 2012, 2012(5):501-510.
37. Meixner P., Leberl F., Brédif M. Interpretation of 2D and 3D building details on facades and roofs. Int. Arch. Photogramm. Rem. Sensing Spatial Inf. Sci. 2011, 38(Part 3/W22):137-142.
38. Rau J.-Y., Lin B.-C. Automatic roof model reconstruction from ALS data and 2D ground plans based on side projection and the TMR algorithm. ISPRS J. Photogramm. Rem. Sensing 2011, 66(6):13-27.
39. Rottensteiner F. Consistent estimation of building parameters considering geometric regularities by soft constraints. Int. Arch. Photogramm. Remote Sensing Spatial Inf. Sci. 2006, 36(Part 3):13-18.
40. Rottensteiner F., Sohn G., Jung J., Gerke M., Baillard C., Benitez S., Breitkopf U. The ISPRS benchmark on urban object classification and 3D building reconstruction. ISPRS Ann. Photogramm. Rem. Sensing Spatial Inf. Sci. 2012, 1(3):293-298.
41. Rutzinger M., Rottensteiner F., Pfeiffer N. A comparison of evaluation techniques for building extraction from airborne laser scanning. IEEE J. Selected Topics Appl. Earth Observation Rem. Sensing 2009, 2(1):11-20.
42. Shechtman, E, Irani, M. 2007. Matching local self-similarities across images and videos. In: Proc. of Conference on Computer Vision and Pattern Recognition, Minneapolis, pp. 1-8.
43. Sohn G., Jwa Y., Kim H.B., Jung J. An implicit regularization for 3D building rooftop modeling using airborne LIDAR Data. ISPRS Ann. Photogramm. Rem. Sensing Spatial Inf. Sci. 2012, 2(3):305-310.
44. Toldo, R., Fusiello, A. 2008. Robust multiple structures estimation with J-linkage. In: Proc. of European Conference on Computer Vision, Marseille, (France), vol. 1, pp. 537-547.
45. Verma, V., Kumar, R., Hsu, S. 2006. 3D building detection and modeling from aerial Lidar data. In: IEEE Conf. on Computer Vision and Pattern Recognition, New York, vol. 2, pp. 2213-2220.
46. Wassenberg, J., Middelmann, W., Sanders, P. 2009. An efficient parallel algorithm for graph-based image segmentation. In: Proc. of Computer Analysis on Images and Patterns, Münster, (Germany), pp. 1003-1010.