D4AR-A 4-dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication

Electronic Journal of Information Technology in Construction

Volumn 14, Issue , 2009, Pages 129-153

  Mani, Golparvar Fard ^a   Feniosky, Peña Mora ^a   Savarese, Silvio ^b  

^a University of Illinois at Urbana Champaign   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

3D site progress analysis; Augmented reality; Construction field imagery; Image processing; Progress monitoring; Structure from motion

Indexed keywords

3D SITE PROGRESS ANALYSIS; AUTOMATIC DATA COLLECTION; CONSTRUCTION ACTIVITIES; CONSTRUCTION FIELD IMAGERY; CONSTRUCTION PROJECTS; CONSTRUCTION SITES; DATA COLLECTION; EARLY DETECTION; GEOMETRIC REPRESENTATION; IMAGE PROCESSING TECHNIQUE; IN-FIELD; LOCATION BASED; NEW TECHNOLOGIES; PERCEIVED BENEFITS; PROGRESS MONITORING; PROJECT MANAGERS; SCHEDULE DELAY; STRUCTURE FROM MOTION; TRAFFIC LIGHT;

AD HOC NETWORKS; AUGMENTED REALITY; CONSTRUCTION INDUSTRY; DATA ACQUISITION; IMAGE PROCESSING; IMAGE RECONSTRUCTION; IMAGING SYSTEMS; LOCATION; PHOTOGRAPHY; PROJECT MANAGEMENT; VIRTUAL REALITY;

THREE DIMENSIONAL;

EID: 70350154917     PISSN: 14036835     EISSN: 14006529     Source Type: Journal    
DOI: None     Document Type: Article

References (83)

1. Abba, W. (1997) Earned Value Management-Reconciling Government and Commercial Practices, Program Manager, Vol.26, 58-63.
2. Abeid J., Allouche E., Arditi D., and Hayman M. (2003). PHOTO-NET II: a Computer-based Monitoring System Applied to Project Management, Journal of Automation in Construction, Vol.12, No.5, 603-616.
3. Akbarzadeh A., Frahm J., Mordohai P., Clipp B., Engels C., Gallup D., Merrell P., Phelps M., Sinha S., Talton B., Wang L., Yang Q., Stewenius H., Yang R., Welch G., Towles H., Nister D. and Pollefeys M. (2006), Towards urban 3D reconstruction from video, Proc. 3DPVT'06 (Int. Symp. on 3D Data, Processing, Visualization and Transmission), 2006.
4. Akinci B., Boukamp F., Gordon C., Huber D., Lyons C., and Park K. (2006). A formalism for utilization of sensor systems and integrated project models for active construction quality control. Automation in Construction, Vol.15, No.2, 124-138.
5. Aliaga D., Funkhouser T., Yanovsky D., and Carlbom I. (2003). Sea of images. IEEE Computer Graphics and Applications, 23 (6), 22-30.
6. Arya S., Mount D., Netanyahu N., Silverman R., and Wu A. (1998). An optimal algorithm for approximate nearest neighbor searching fixed dimensions. Journal of the ACM, Vol.45, No.6, 891-923.
7. Avidan S. and Shashua A. (1997). Novel view synthesis in tensor space. Proc., Computer Vision and Pattern Recognition, Vol.1, 1034-1040.
8. Behzadan A. and Kamat V. (2007), Georeferenced Registration of Construction Graphics in Mobile Outdoor Augmented Reality, ASCE Journal of Computing in Civil Engineering, Vol.21, No.4, 247-258
9. Behzadan A., Aziz Z., Anumba C., and Kamat V. (2008), Ubiquitous Location Tracking for Context Specific Information Delivery on Construction Sites, Elsevier Journal of Automation in Construction, Vol.17, No.6, 737-748.
10. Besl P. and McKay N. (1992). A method for registration of 3-d shapes. IEEE Trans. Pat. Anal. and Mach. Intel. Vol.14, No.2, 239-256.
11. Bosche F. and Haas C.T. (2008). Automated retrieval of 3D CAD model objects in construction range images. Journal of Automation in Construction, Vol.17, No.4, 499-512.
12. Brilakis I. and Soibelman L. (2008). Shape-Based Retrieval of Construction Site Photographs. ASCE Journal of Computing in Civil Engineering, Vol.22, No.1, 14-20.
13. Brown M. and Lowe D. (2005). Unsupervised 3D object recognition and reconstruction in unordered datasets. Proceeding of the International Conference on 3D digital imaging and modeling, 56-63.
14. Chen S. and Williams L. (1993): View interpolation for image synthesis. Computer Graphics Vol.27, 279-288.
15. Chen Z., Li H., and Wong C. (2002) An application of Bar-Code system for reducing construction wastes. Journal of Automation in Construction, Vol.11, No.5, 521-533.
16. Collier E. and Fischer M. (1996). Visual-based 4D modeling on the San Mateo County Health Center. Proceedings of the Third Congress on Computing in Civil Eng, ASCE, Anaheim, CA, 800-805.
17. Debevec P., Taylor C., and Malik J. (1996). Modeling and rendering architecture from photographs: a hybrid geometry-and image based approach. Proceeding, SIGGRAPH conference, 11-20.
18. Echeverry D. and Beltran A. (1997). Bar-code control of construction field personnel and construction materials, Proceedings of the 4th Congress in Computing in Civil Engineering, Philadelphia, PA, 341-347.
19. El-Omari S. and Moselhi O. (2008). Integrating 3D laser scanning and photogrammetry for progress measurement of construction work. Journal of Automation in Construction. Vol.18, No.1, 1-9.
20. Ergen E., Akinci B. and Sacks R. (2007) Tracking and locating components in a precast storage yard utilizing radio frequency identification technology and GPS. Journal of Automation in Construction, Vol.16, No.3, 354-367. (Pubitemid 46205287)
21. Faugeras O., Luong Q.-T., Papadopoulo T. (2004). The geometry of multiple images: the laws that govern the formation of multiple images of a scene and some of their applications. MIT press.
22. Fischler M. and Bolles R. (1981). Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, Vol.24, No.6, 381-395.
23. Golparvar-Fard M., Peña-Mora F., Arboleda C. and Lee S. (2009). Visualization of construction progress monitoring with 4D simulation model overlaid on time-lapsed photographs, ASCE Journal of Computing in Civil Eng., Special Ed. on Graphical 3D Visualization in AEC, in press.
24. Golparvar Fard M. And Peña-Mora, F. (2007) Application of visualization techniques for construction progress monitoring. Proceedings of the ASCE International Workshop on Computing in Civil Engineering, Pittsburgh, PA, Vol.261, No.27, 216-223.
25. Golparvar Fard M., Sridharan A., Lee S., and Peña-Mora F. (2007). Visual representation of construction progress monitoring metrics on time-lapse photographs. Construction Management and Economics. 25th Anniversary Conference, Univ. of Reading, UK.
26. Golparvar Fard M., Staub-French S., Po B. and Tory M. (2006). Requirements for a mobile interactive workspace to support design development and coordination. Proceedings of, XI Joint Int. Conf. on Computing and Decision Making in Civil & Building Eng. ASCE, Montreal, QC, 3587-3596
27. Gordon S., Lichti D., Stewart M., and Franke J. (2004). Modelling point clouds for precise structural deformation measurement. XXth ISPRS Congress, Istanbul, Turkey.
28. Halpin D. (2006). Construction Management, John Wiley and Sons, New York, NY, 3rd Edition.
29. Han J. (2006) Multi-touch interaction wall, ACM SIGGRAPH 2006 Emerging technologies, Boston, MA.
30. Hartley R. and Zisserman A. (2004). Multiple view geometry. Cambridge, UK: Cambridge University Press.
31. Hartley, R. (1997). In defense of the eight-point algorithm. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.19, No.6, 580-593.
32. Hartmann T., Gao J., and Fischer M. (2008). Areas of application for 3D and 4D models on construction projects. ASCE Journal of Construction Engineering and Management, Vol.134, No.1, 776-785.
33. Hartmann T. and Fischer M. (2007). Supporting the constructability review with 3D/4D models. Building research and information, Vol.35, No.1, 70-80.
34. Horn B. (1987), Closed-form Solution of Absolute Orientation using Unit Quaternions. Journal of the Optical Society Vol.A, No.4, 629-642.
35. Jaselskis E., Cackler E., Walters R., Zhang J., and Kaewmoracharoen M. (2006). Using scanning lasers for realtime pavement thickness measurement. CTRE Project 05-205, National Concrete Pavement Technology Center, Iowa State University.
36. Jaselskis E. and El-Misalami T. (2003). Implementing Radio Frequency Identification in the construction process. Journal of Construction Engineering and Management, ASCE Vol. 129. No.6, 680-688.
37. Kamat V. and Martinez J. (2008). Software mechanisms for extensible and scalable 3D visualization of construction operations, Advances in Engineering Software, Vol.39, No.8, 659-675.
38. Kim Y. and Ballard G. (2000). Is the Earned-Value Method an Enemy of Work Flow?. Proc., 8th Annual Conf. of the Int. Group for Lean Construction, IGLC-6, Brighton, UK.
39. Kiziltas S., Akinci B., Ergen E. and Tang, P (2008). Technological assessment and process implications of field data capture technologies for construction and facility/infrastructure management, ITcon, Vol.13, Special Issue Sensors in Construction and Infrastructure Management, 134-154.
40. Koo B. and Fischer M. (2000). Feasibility Study of 4D in Commercial Construction. Journal of Construction Engineering and Management, Vol.126, No.4, 251-260.
41. Korde T., Wang Y. and Russell A. (2005) Visualization of construction data, Proceedings of the 6th Construction Specialty Conference, Toronto, Canada, CT-148, 1-11.
42. Kymell W. (2008). Building information modeling: planning and managing construction projects with 4D CAD and simulations. McGraw-Hill.
43. Lee S. and Peña-Mora F. (2006). Visualization of construction progress monitoring. Proceedings of Joint International Conference on Computing and Decision Making in Civil & Building Engineering, 2527-2533.
44. Leung S., Mak S., and Lee B. (2008). Using a real-time integrated communication system to monitor the progress and quality of construction works. Journal of Automation in Construction, Vol.17, 759-1757
45. Lourakis M. and Argyros A. (2004). The design and implementation of a generic sparse bundle adjustment software package based on the Levenberg-Marquardt algorithm (Technical Report 340). Inst. of Computer Science-FORTH, Heraklion, Crete, Greece. Available from www.ics.forth.gr/- ;lourakis/sba.
46. Lowe D. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, Vol.60, No.2, 91-110.
47. Ma Y., Soatto S., Kosecka J., and Sastry S. (2006). An invitation to 3-D Vision: From images to geometric models. Springer, third Edition.
48. McKinney K., Fischer M., and Kunz J. (1998). 4D Annotator: a visual decision support tool for construction planners. Computing in Civil Engineering, Proceedings of Int Computing Congress, ASCE, 330-341.
49. Meredith J. and Mantel S. (2003). Project management: a managerial approach. J. Wiley and Sons, Fifth Ed.
50. Mikolajczyk K., Tuytelaars T., Schmid C., Zisserman A., Matas J., Schaffalitzky F., Kadir T., and van Gool L. (2005). A comparison of affine region detectors, Int Journal of Computer Vision, Vol. 65, No. 1/2 , 43-72.
51. Moreels P. and Perona. P (2008). A Probabilistic cascade of detectors for individual object recognition. Proceedings of European Conference on Computer Vision, Part III, LNCS 5304, 426-438.
52. Navon R. and Sacks R. (2007). Assessing research in automated project performance control (APPC)", Journal of Automation in Construction, Vol. 16, No. 4, 474-484. (Pubitemid 46304214)
53. Navon R. (2006). Research in automated measurement of project performance indicators. Journal of Automation in Construction, Vol.16, No.7, 176-188.
54. Niebles J., Wang H., and Fei-Fei, L. (2006). Unsupervised learning of human action categories using spatialtemporal words. Proceedings, British Machine Vision Conference (BMVC), 2006.
55. Nistér D. (2004). An efficient solution to the five-point relative pose problem, IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), Vol.26, No.6, 756-770.
56. Nocedal J. and Wright S. (1999). Springer series in operations research. Numerical optimization. Springer.
57. Oglesby C., Parker H. and Howell G. (1989). Productivity improvement in construction, McGraw-Hill.
58. Poku S. and Arditi D. (2006). Construction scheduling and progress control using geographical information systems. Journal of Computing in Civil Engineering, Vol.20, No.5, 351-360.
59. Pollefeys M., van Gool L., Vergaumen M., Verbiest F., Cornelis K., Tops J. and Koch R. (2004), Visual modeling with a hand-held camera, International Journal of Computer Vision, Vol.59, No.3, 207-232.
60. Reinhardt J., Garrett J., and Scherer J. (2000). The preliminary design of a wearable computer for supporting Construction Progress Monitoring. Internationales, Kolloquium über die Anwendung der Informatik und der Mathematik in Architektur und Bauwesen, Weimar, Germany.
61. Rothganger F., Lazebnik S., Schmid C., and Ponce J.. (2006). 3D object modeling and recognition using local affine-invariant image descriptors and multi-view spatial constraints. International Journal on Computer Vision, Vol.66, No.3, 231-259.
62. Savarese S. and Fei-Fei L. (2007). 3D generic object categorization, localization and pose estimation. IEEE Intern. Conf. in Computer Vision (ICCV).-Brazil, October, 2007.
63. Seitz S. and Dyer C. (1996) View morphing. SIGGRAPH, 21-30.
64. Shih N. and Wang P. (2004). Point-cloud-based comparison between construction schedule and as-built progress: long-range three-dimensional laser scanner's approach. ASCE Journal of Architectural Engineering, Vol.10, No.3, 98-102.
65. Snavely N., Seitz S., and Szeliski R. (2008). Finding path through the world's photos. Proceedings of ACM Transactions on Graphics (SIGGRAPH 2008), Vol.27, No.3, 11-21.
66. Snavely N., Seitz S., and Szeliski R. (2007). Modeling the world from internet photo collections. International Journal of Computer Vision.
67. Snavely N., Seitz S., and Szeliski R. (2006). Photo tourism: exploring photo collections in 3D. Proceedings of ACM Transactions on Graphics, Vol.25, No.3, 835-846.
68. Soibelman L., Wu J., Caldas C., Brilakis I. and Lin K.Y. (2008). Management and analysis of unstructured construction data types. Journal of Advanced Engineering Informatics, Vol.22, 15-27.
69. Song K., Pollalis S., and Peña-Mora F. (2005). Project dashboard: concurrent visual representation method of project metrics on 3D building models. Proceedings of International Conference on Computing in Civil Engineering, Cancun, Mexico.
70. Songer A. and Heys B. (2003). A framework for multi-dimensional visualization of project control data. Proceedings of Construction Research Congress 2003, Honolulu, Hawaii, 121-130.
71. Staub-French S. and Khanzode A. (2007). 3D and 4D modeling for design and construction coordination: issues and lessons learned, ITCon, Vol.12, 381-407.
72. Su Y., Hashash Y., and Liu L.Y. (2006). Integration of construction as-built data via laser scanning with geotechnical monitoring of urban excavation. Journal of Construction Engineering and Management, Vol.132, No.12, 1234-1241.
73. Szeliski, R. (1996): Video mosaics for virtual environments. Computer Graphics and Applications. Vol.16, 22-30.
74. Teizer J., Kim C., Haas C., Liapi K., and Caldas C. (2005). Framework for real-time three-dimensional modelling of infrastructure. Geology and Properties of Earth Materials 2005, Transportation Research Board Natl Research Council, Washington, 177-186.
75. Tomasi C. and Kanade T. (1992). Shape and motion from image streams under orthography: a factorization method. International Journal of Computer Vision, Vol.9, No.2, 137-154.
76. Triggs B., McLauchlan P., Hartley R., and Fitzgibbon A. (1999). Bundle adjustment-a modern synthesis, Vision Algorithms: Theory and Practice. Intl Workshop on Vision Algorithms, Corfu, Greece, 153-177.
77. Trucco E. and Verri A. (1998). Introductory techniques for 3-D computer vision. Prentice Hall.
78. Tuytelaars T. and Mikolajczyk K. (2008). Local invariant feature detectors: A Survey., Foundations and Trends in Computer Graphics and Vision, Vol.3, No., 177-280.
79. Tuytelaars T. and Van Gool L. (2004). Matching widely separated views based on affine invariant regions. International Journal on Computer Vision, Vol.59, No.1, 61-85.
80. Wang X. and Dunston P. (2005). Heavy equipment operator training via virtual modeling technologies, Proceedings of Construction Research Congress, San Diego, CA, 618-622.
81. Williams M. (Bechtel Corp) (1996) Graphical simulation for project planning: 4D-Planner TM, Proceedings of the Third Congress on Computing in Civil Engineering. 404-409.
82. Woksepp S. and Olofsson T. (2006). Using virtual reality in a largescale industry projects. ITCon. 11, 627-640.
83. Wu Y. and Kim H. (2004). Digital imaging in assessment of construction project progress. Proceedings of the 21st International Symposium on automation and robotics in construction, Korean Inst of Construction Tech, Jeju, Korea, 537-542.