Automatic creation of semantically rich 3D building models from laser scanner data

Automation in Construction

Volumn 31, Issue , 2013, Pages 325-337

  Xiong, Xuehan ^b   Adan, Antonio ^a   Akinci, Burcu ^c   Huber, Daniel ^b  

^a UNIVERSITY OF CASTILLA LA MANCHA   (Spain)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

3D modeling; Interior modeling; Lidar object recognition; Opening detection; Scan to BIM; Wall analysis

Indexed keywords

3-D MODELING; 3-D POINT DATA; 3D INFORMATION; ARCHITECTURE , ENGINEERING , AND CONSTRUCTIONS; AUTOMATIC CREATIONS; BUILDING INFORMATION MODEL - BIM; BUILDING MAINTENANCE; BUILDING MODEL; DATA SETS; DESIGN DRAWINGS; DIVERSE APPLICATIONS; ERROR PRONES; INDOOR ENVIRONMENT; INFORMATION MODELS; INPAINTING; LASER SCANNER; LASER SCANNER DATA; LASER SCANS; MANUAL OPERATIONS; PLANAR PATCH; POINT CLOUD; POINT MEASUREMENT; SCAN TO BIM; SPACE USAGE; STRUCTURAL COMPONENT; SURFACE REGION; UNIQUE FEATURES; WALL ANALYSIS;

ARCHITECTURAL DESIGN; DOORS; FLOORS; INFORMATION THEORY; LASER APPLICATIONS; LASERS; LEARNING ALGORITHMS; MODELS; OBJECT RECOGNITION; OPTICAL RADAR; SCANNING; THREE DIMENSIONAL; WALLS (STRUCTURAL PARTITIONS);

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84873283130     PISSN: 09265805     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.autcon.2012.10.006     Document Type: Article

References (63)

1. A. Adan, and D. Huber Reconstruction of wall surfaces under occlusion and clutter in 3D indoor environments Tech. Rep. CMU-RI-TR-10-12, Pittsburgh, PA 2010
2. A. Adan, and D. Huber 3D reconstruction of interior wall surfaces under occlusion and clutter Proceedings of 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT) 2011 (Hangzhou, China. URL http://www.ri.cmu.edu/pub-files/2011/5/3dimpvt-final.pdf)
3. A. Adan, X. Xiong, B. Akinci, and D. Huber Automatic creation of semantically rich 3D building models from laser scanner data Proceedings of the International Symposium on Automation and Robotics in Construction (ISARC) 2011
4. S. Agarwal, N. Snavely, I. Simon, S.M. Seitz, and R. Szeliski Building Rome in a day 2009 IEEE 12th International Conference on Computer Vision Sep. 2009 72 79 (URL http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber= 5459148)
5. B. Akinci, F. Boukamp, C. Gordon, D. Huber, C. Lyons, and K. Park A formalism for utilization of sensor systems and integrated project models for active construction quality control Automation in Construction 15 2 2006 124 138 (Pubitemid 41817142)
6. E. Anil, B. Akinci, and D. Huber Representation requirements of as-is building information models generated from laser scanned point cloud data Proceedings of the International Symposium on Automation and Robotics in Construction (ISARC) 2011 (Seoul, Korea)
7. E. Anil, P. Tang, B. Akinci, and D. Huber Assessment of quality of as-is building information models generated from point clouds using deviation analysis Proceedings of the SPIE Vol. 7864A, Electronics Imaging Science and Technology Conference (IS&T), 3D Imaging Metrology 2011 (San Francisco, California)
8. S. Becker Generation and application of rules for quality dependent façade reconstruction Journal of Photogrammetry and Remote Sensing 64 6 2009 640 653
9. M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester Image inpainting Proceedings of SIGGRAPH 2000 417 424 (URL http://portal.acm.org/citation.cfm? doid=344779.344972) (Pubitemid 32394006)
10. D.P. Bertsekas, A. Nedic, and A.E. Ozdaglar Convex analysis and optimization Athena Scientific 2003
11. J. Böhm Facade detail from incomplete range data Proceedings of the ISPRS Congress, Beijing, China vol. 1 2008 2 (Beijing, China, URL http://www.isprs.org/proceedings/XXXVII/congress/5-pdf/115.pdf)
12. J. Böhm, S. Becker, and N. Haala Model refinement by integrated processing of laser scanning and photogrammetry Proceedings of 3D Virtual Reconstruction and Visualization of Complex Architectures (3D-Arch) 2007 (Zurich, Switzerland)
13. F. Bosché Automated recognition of 3D CAD model objects in laser scans and calculation of as-built dimensions for dimensional compliance control in construction Advanced Engineering Informatics 24 1 Jan. 2010 107 118 (URL http://dx.doi.org/10.1016/j.aei.2009.08.006)
14. F. Bosche, and C.T. Haas Automated retrieval of 3D CAD model objects in construction range images Automation in Construction 17 4 2008 499 512 (URL http://www.sciencedirect.com/science/article/B6V20-4PYYG3X-1/1/ c9926c5f2bafbc0a941121af14a4246c) (Pubitemid 351173673)
15. I. Brilakis, M. Lourakis, R. Sacks, S. Savarese, S. Christodoulou, J. Teizer, and A. Makhmalbaf Toward automated generation of parametric BIMs based on hybrid video and laser scanning data Advanced Engineering Informatics 24 4 Nov. 2010 456 465 (URL http://dx.doi.org/10.1016/j.aei.2010.06.006)
16. A. Budroni, and J. Boehm Automated 3D reconstruction of interiors from point clouds International Journal of Architectural Computing 08 01 2010 55 74
17. A. Budroni, and J. Böhm Automatic 3D modelling of indoor Manhattan-world scenes from laser data ISPRS Commission V Mid-Term Symposium: Close Range Image Measurement Techniques vol. XXXVIII 2010 115 120
18. H. Cantzler Improving architectural 3d reconstruction by constrained modelling 2003
19. W.W. Cohen Stacked sequential learning International Joint Conference on Artificial Intelligence 2005 671 676
20. J. Davis, S.R. Marschner, M. Garr, and M. Levoy Filling holes in complex surfaces using volumetric diffusion First International Symposium on 3D Data Processing, Visualization, and Transmission 2002
21. P. Debevec, C.J. Taylor, and J. Malik Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach Proceedings of ACM SIGGRAPH 1996 11 20
22. F. DellAcqua, and R. Fisher Reconstruction of planar surfaces behind occlusions in range images Transactions on Pattern Analysis and Machine Intelligence (PAMI) 24 4 2002 569 575 (Pubitemid 34448775)
23. S.F. El-Hakim, P. Boulanger, F. Blais, J.-A. Beraldin, S.F. El-Hakim, P. Boulanger, F. Blais, and J.-A. Beraldin A system for indoor 3D mapping and virtual environments Proceedings of Videometrics V (SPIE v. 3174) 1997 21 35
24. C. Frueh, S. Jain, and A. Zakhor Data processing algorithms for generating textured 3D building facade meshes from laser scans and camera images International Journal of Computer Vision (IJCV) 61 2 2005 159 184
25. Y. Furukawa, B. Curless, S.M. Seitz, and R. Szeliski Manhattan-world stereo Proceedings of Computer Vision and Pattern Recognition IEEE 2009 (URL http://dblp.uni-trier.de/db/conf/cvpr/cvpr2009.html#FurukawaCSS09)
26. Y. Furukawa, B. Curless, S.M. Seitz, and R. Szeliski Reconstructing building interiors from images Proceedings of the International Conference on Computer Vision (ICCV) 2009 (URL http://ieeexplore.ieee.org/xpls/abs-all.jsp? arnumber=5459145)
27. Y. Furukawa, B. Curless, S.M. Seitz, and R. Szeliski Towards internet-scale multi-view stereo Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR) 2010
28. M. Golparvar-Fard, F. Pena-Mora, C. a Arboleda, and S. Lee Visualization of construction progress monitoring with 4D simulation model overlaid on time-lapsed photographs Journal of Computing in Civil Engineering 23(6) 2009 391 (URL http://link.aip.org/link/JCCEE5/v23/i6/p391/s1&Agg=doi)
29. G.H. Golub, and C.F. van Loan An analysis of the total least squares problem SIAM Journal on Numerical Analysis 17 1980 883 893
30. GSA GSA BIM Guide For 3D Imaging, version 1.0 2009 (URL http://www.gsa.gov/bim)
31. GSA GSA BIM Guide For Energy Performance, version 1.0 2009 (URL http://www.gsa.gov/bim)
32. D. Hähnel, W. Burgard, and S. Thrun Learning compact 3D models of indoor and outdoor environments with a mobile robot Robotics and Autonomous Systems 44 1 2003 15 27
33. D. Huber, and M. Hebert Fully automatic registration of Multiple 3D data sets Image and Vision Computing (IVC) 21 7 2003 637 650
34. H.S.H. Koppula, A. Anand, T. Joachims, and A. Saxena Semantic labeling of 3D point clouds for indoor scenes Neural Information Processing Systems 2011 (URL http://pr.cs.cornell.edu/sceneunderstanding/nips-2011.pdf)
35. Z. Kou Stacked graphical models for efficient inference in markov random fields In Proceedings of the 2007 SIAM International Conference on Data Mining 2007
36. P. Koutsourakis, L. Simon, O. Teboul, G. Tziritas, and N. Paragios Single view reconstruction using shape grammars for urban environments International Conference on Computer Vision (ICCV) Sep. 2009 Ieee Kyoto, Japan 1795 1802 (URL http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=5459400)
37. H. Moravec Robot Spatial Perception by Stereoscopic Vision and 3D Evidence Grids 1996
38. D. Munoz, J.A. Bagnell, and M. Hebert Stacked hierarchical labeling European Conference on Computer Vision (ECCV) 2010
39. Murphy, K., Torralba, A., Eaton, D., Freeman, W.T., 2005. Object detection and localization using local and global features. Lecture Notes in Computer Science (unrefereed). Sicily workshop on object recognition.
40. A. Nüchter, and J. Hertzberg Towards semantic maps for mobile robots Robotics and Autonomous Systems 56 2008 915 926
41. A. Nüchter, H. Surmann, K. Lingemann, and J. Hertzberg Semantic scene analysis of scanned 3D indoor environments Proceedings of the Eighth International Fall Workshop on Vision, Modeling, and Visualization (VMV) 2003
42. M. Pollefeys, D. Nister, J.M. Frahm, A. Akbarzadeh, P. Mordohai, B. Clipp, C. Engels, D. Gallup, S.J. Kim, P. Merrell, C. Salmi, S. Sinha, B. Talton, L. Wang, Q. Yang, H. Stewenius, R. Yang, G. Welch, and H. Towles Detailed real-time urban 3{D} reconstruction from video International Journal of Computer Vision 78 2-3 2008 143 167 (Pubitemid 351406110)
43. S. Pu, and G. Vosselman Automatic extraction of building features from terrestrial laserscanning IEVM06 2006
44. S. Pu, and G. Vosselman Knowledge based reconstruction of building models from terrestrial laser scanning data ISPRS Journal of Photogrammetry and Remote Sensing 64 6 2009 575 584 (URL http://www.sciencedirect.com/science/article/ B6VF4-4W80C7C-1/2/c3090806c210aad2366e5179b91ff001)
45. T. Rabbani, F.A. van den Heuvel, and G. Vosselman Segmentation of point clouds using smoothness constraint The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences 36 5 2006 248 253
46. A. Rabinovich, A. Vedaldi, C. Galleguillos, E. Wiewiora, and S. Belongie Objects in context Proc. ICCV 2007
47. N. Ripperda, and C. Brenner Application of a formal grammar to facade reconstruction in semiautomatic and automatic environments Proceedings of AGILE Conference on Geographic Information Science 2009 (Hannover, Germany)
48. S. Roth, and M.J. Black Fields of experts: a framework for learning image priors Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR) 2005 860 867 (San Diego, California)
49. R.B. Rusu, Z.C. Martona, N. Blodowa, M. Dolhaa, and M. Beetza Towards 3D point cloud based object maps for household environments Robotics and Autonomous Systems 56 11 2008 927 941
50. S. Salamanca, P. Merchan, E. Perez, A. Adan, and C. Cerrada Filling holes in 3D meshes using image restoration algorithms Proceedings of the Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT) 2008 (Atlanta, GA)
51. A.D. Sappa Improving segmentation results by studying surface continuity Proceedings of the International Conference on Pattern Recognition (ICPR) 2 2002 929 932 (Pubitemid 44844888)
52. N. Snavely, S.M. Seitz, and R. Szeliski Photo tourism: exploring photo collections in 3D Proceedings of SIGGRAPH 25 3 Jul. 2006 835 846 (URL http://portal.acm.org/citation.cfm?id=1141964 http://www.mendeley.com/research/ photo-tourism-exploring-photo-collections-in-3d/) (Pubitemid 44481045)
53. I. Stamos, Y. Gene, G. Wolberg, and S. Zokai 3D modeling using planar segments and mesh elements Proceedings of 3D Data Processing, Visualization, and Transmission (3DPVT) 2006 599 606
54. P. Tang, D. Huber, and B. Akinci A comparative analysis of depth-discontinuity and mixed-pixel detection algorithms Proceedings of the International Conference on 3-D Digital Imaging and Modeling (3DIM) 2007 29 38
55. P. Tang, D. Huber, B. Akinci, R. Lipman, and A. Lytle Automatic reconstruction of as-built building information models from laser-scanned point clouds: a review of related techniques Automation in Construction 19 7 2010 829 843
56. S. Thrun, C. Martin, Y. Liu, D. Hähnel, R. Emery-Montemerlo, D. Chakrabarti, and W. Burgard A real-time expectation-maximization algorithm for acquiring multi-planar maps of indoor environments with mobile robots IEEE Transactions on Robotics 20 3 2004 433 443
57. Trimble Trimble Indoor Mobile Mapping Solution 2011 URL http://www.trimble.com/Indoor-Mobile-Mapping-Solution/Indoor-Mapping.aspx
58. E. Valero, A.A. Oliver, D. Huber, and C. Cerrada Detection, modeling, and classification of moldings for automated reverse engineering of buildings from 3D data International Symposium on Automation and Robotics in Construction (ISARC) 2011
59. D.H. Wolpert Stacked generalization Neural Networks 5 1992 241 259
60. X. Xiong, and D. Huber Using context to create semantic 3D models of indoor environments Proceedings of the British Machine Vision Conference 2010 BMVA Press 45.1 45.11 10.5244/C.24.45
61. X. Xiong, D. Munoz, J.A. Bagnell, and M. Hebert 3-D scene analysis via sequenced predictions over points and regions IEEE International Conference on Robotics and Automation (ICRA) 2011
62. K. Yue, D. Huber, B. Akinci, and R. Krishnamurti The ASDMCon project: the challenge of detecting defects on construction sites Proceedings of the Third International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT) 2006
63. Z. Zhu, and I. Brilakis Concrete column recognition in images and videos Journal of Computing in Civil Engineering 24 6 Jan. 2010 478 (URL http://link.aip.org/link/?JCCEE5/24/478/1)