Automated progress monitoring using unordered daily construction photographs and IFC-based building information models

Journal of Computing in Civil Engineering

Volumn 29, Issue 1, 2015, Pages

  Golparvar Fard, Mani ^a   Peña Mora, Feniosky ^b   Savarese, Silvio ^c  

^a Virginia Polytechnic Institute and State University   (United States)

^b Fu Foundation School of Engineering and Applied Science   (United States)

^c UNIVERSITY OF MICHIGAN   (United States)

Author keywords

3D reconstruction; Automation; Computer vision; Industry foundation classes (IFC); Model based recognition; Multiple view geometry; Photogrammetry; Structure from motion

Indexed keywords

ARTIFICIAL INTELLIGENCE; AUTOMATION; BINDING SITES; COMPUTER VISION; CONSTRUCTION; DECISION MAKING; INFORMATION THEORY; LEARNING SYSTEMS; PHOTOGRAMMETRY; PHOTOGRAPHY; STEREO IMAGE PROCESSING; VISUALIZATION;

3D RECONSTRUCTION; INDUSTRY FOUNDATION CLASSES - IFC; MODEL-BASED RECOGNITION; MULTIPLE VIEW GEOMETRY; STRUCTURE FROM MOTION;

ARCHITECTURAL DESIGN;

EID: 84920815816     PISSN: 08873801     EISSN: None     Source Type: Journal    
DOI: 10.1061/(ASCE)CP.1943-5487.0000205     Document Type: Article

References (81)

1. Abeid, J. N., and, Arditi, D. (2002). " Time-lapse digital photography applied to project management." J. Constr. Eng. Manage., 10.1061/(ASCE)0733-9364(2002)128:6(530), 530-535. JCEMD4 0733-9364
2. Abeid, J., Allouche, E., Arditi, D., and, Hayman, M. (2003). " PHOTO-NET II: a computer-based monitoring system applied to project management." J. Autom. Constr., 12 (5), 603-616. 0926-5805 10.1016/S0926-5805(03)00042-6
3. Abudayyeh, O. Y. (1997). " Audio/visual information in construction project control." Adv. Eng. Software, 28 (2), 97-101. AESODT 0141-1195 10.1016/S0965-9978(96)00046-4
4. Agarwal, S., Snavely, N., Simon, I., Seitz, S. M., and, Szeliski, R. (2009). " Building Rome in a day." Proc., Int. Conf. on Computer Vision, IEEE, Kyoto, Japan.
5. Akinci, B., Boukamp, F., Gordon, C., Huber, D., Lyons, C., and, Park, K. (2006). " A formalism for utilization of sensor systems and integrated project models for active construction quality control." J. Autom. Constr., 15 (2), 124-138. 0926-5805 10.1016/j.autcon.2005.01.008
6. Alves, N., and, Bartolo, P. (2006). " Integrated computational tools for virtual and physical automatic construction." J. Autom. Constr., 15 (3), 257-271. 0926-5805 10.1016/j.autcon.2005.05.007
7. Arman, F., and, Aggarwal, J. K. (1993). " Model-based object recognition in dense-range images: A review." Comput. Surv., 25 (1), 5-43. CMSVAN 0010-4892 10.1145/151254.151255
8. Besl, P., and, McKay, N. (1992). " A method for registration of 3-d shapes." IEEE Trans. Pattern Anal. Mach. Intell., 14 (2), 239-256. 0162-8828 10.1109/34.121791
9. Bosché, F. (2010). " Automated recognition of 3D CAD model objects in laser scans and calculation of as-built dimensions for dimensional compliance control in construction." Adv. Eng. Inf., 24 (1), 107-118. 1474-0346 10.1016/j.aei.2009.08.006
10. Bosché, F., Haas, C. T., and, Akinci, B. (2009). " Automated recognition of 3D CAD objects in site laser scans for project 3d status visualization and performance control." J. Comput. Civ. Eng., 10.1061/(ASCE)0887-3801(2009)23:6(311), 311-318. JCCEE5 0887-3801
11. Chang, C.-C., and, Lin, C.-J. (2001). " LIBSVM: A library for support vector machines." http://www.csie.ntu.edu.tw/cjlin/libsvm (May 1, 2010).
12. Cordova, F., Sideris, D., Brilakis, I., and, Angelides, D. (2009). " Validation of vision tracking at Egnatia Odos Motorway. " Proc., ASCE Construction Research Congress, ASCE, Reston, VA.
13. Cornelis, N., Leibe, B., Cornelis, K., and, Gool, L. V. (2008). " 3D urban scene modeling integrating recognition and reconstruction." Int. J. Comput. Vision, 78 (2-3), 121-141. 1573-1405 10.1007/s11263-007-0081-9
14. Dai, F., and, Lu, M. (2008). " Photo-based 3D modeling of construction resources for visualization of operations Simulation: Case of modeling a precast façade." Proc., 2008 Winter Simulation Conf., Informs Simulation Society, Washington, DC, 2439-2446.
15. Debevec, P. E., Taylor, C. J., and, Malik, J. (1996). " Modeling and rendering architecture from photographs: A hybrid geometry and image-based approach." Proc., 23rd Annual Conf. on Computer Graphics and Interactive Techniques, ACM, New York, 11-20.
16. Du, S., Zheng, N., Ying, S., You, Q., and, Wu, Y. (2007). " An extension of the ICP algorithm considering scale factor." Vol. 5, IEEE Int. Conf. on Image Processing, IEEE, San Antonio, TX, 193-196.
17. Echeverry, D., and, Beltran, A. (1997). " Bar-code control of construction field personnel and construction materials." Proc., 4th Congress in Computing in Civil Engineering, Philadelphia, PA, ASCE, Reston, VA, 341-347.
18. Echeverry, D., Ibbs, C. W., and, Kim, S. (1991). " Sequence knowledge for construction scheduling." J. Constr. Eng. Manage., 10.1061/(ASCE)0733-9364(1991)117:1(118), 118-130. JCEMD4 0733-9364
19. El-Omari, S., and, Moselhi, O. (2008). " Integrating 3D laser scanning and photogrammetry for progress measurement of construction work." J. Autom. Constr., 18 (1), 1-9. 0926-5805 10.1016/j.autcon.2008.05.006
20. Ergen, E., Akinci, B., East, B., and, Kirby, J. (2007). " Tracking components and maintenance history within a facility utilizing radio frequency identification technology." J. Comput. Civ. Eng., 10.1061/(ASCE)0887-3801(2007)21:1(11), 11-20. JCCEE5 0887-3801
21. Everett, J., Halkali, H., and, Schlaff, T. (1998). " Time-lapse video applications for construction project management." J. Constr. Eng. Manage., 10.1061/(ASCE)0733-9364(1998)124:3(204), 204-209. JCEMD4 0733-9364
22. Fan, R. E., Chang, K. W., Hsieh, C. J., Wang, X. R., and, Lin, C. J. (2008). " LIBLINEAR: A library for large linear classification." J. Mach. Learn. Res., 9, 1871-1874.
23. Freund, Y., and, Schapire, R. E. (1999). " A short introduction to boosting." J. Jpn. Soc. Artif. Intell., 14 (5), 771-780.
24. Furukawa, Y., and, Ponce, J. (2006). " High-fidelity image based modeling." Technical Rep. 2006-02, Univ. of Illinois, Urbana,IL.
25. Furukawa, Y., and, Ponce, J. (2010). " Accurate, dense, and robust multi-view stereopsis." IEEE Trans. Pattern Anal. Mach. Intell., 32 (8), 1362-1376. ITPIDJ 0162-8828 10.1109/TPAMI.2009.161
26. Furukawa, Y., Curless, B., Seitz, S. M., and, Szeliski, R. (2009). " Reconstructing building interiors from images." Proc., Int. Conf. on Computer Vision, IEEE, Kyoto, Japan.
27. Gilligan, B., and, Kunz, J. (2007). " VDC use in 2007: Significant value, dramatic growth, and apparent business opportunity." CIFE Technical Rep. #TR171, Stanford University, Stanford, CA.
28. Golparvar-Fard, M., Peña-Mora, F., and, Savarese, S. (2011). " Integrated sequential as-built and as-planned representation with D4AR tools in support of decision-making tasks in the AEC/FM industry." J. Constr. Eng. Manage., 137 (12), 1099-1116. JCEMD4 0733-9364
29. Golparvar-Fard, M., Peña-Mora, F., and, Savarese, S. (2009 a). " D4AR- A 4-dimensional augmented reality model for automating construction progress data collection, processing and communication." J. Inf. Technol. Constr., 14, 129-153. 1874-4753
30. Golparvar-Fard, M., Peña-Mora, F., Arboleda, C. A., and, Lee, S. H. (2009 b). " Visualization of construction progress monitoring with 4D simulation model overlaid on time-lapsed photographs." J. Comput. Civ. Eng., 10.1061/(ASCE)0887-3801(2009)23:6(391), 391-404. JCCEE5 0887-3801
31. Golparvar-Fard, M., and, Peña-Mora, F. (2007). " Development of visualization techniques for construction progress monitoring." Proc., ASCE Int. Workshop on Computing in Civil Eng, ASCE, Reston,VA.
32. Gordon, C., Boukamp, F., Huber, D., Latimer, E., Park, K., and, Akinci, B. (2003). " Combining reality capture technologies for construction defect detection: A case study." Proc., 9th EuropIA Int. Conf. (EIA9), Istanbul, Turkey, 99-108.
33. Hartley, R., and, Zisserman, A. (2004). Multiple view geometry, Cambridge University Press, Cambridge, U.K.
34. Horn, B. (1987). " Closed-form solution of absolute orientation using unit quaternions." J. Optic. Soc. A, 4 (4), 629-642.
35. Huber, D., and, Hebert, M. (2003). " 3D modeling using a statistical sensormodel and stochastic search." Proc., Computer Vision and Pattern Recognition. 2003 IEEE Computer Society Conference on, Vol. 1, IEEE, Madison, WI, 858-865.
36. Huertas, A., and, Nevatia, R. (2000). " Detecting changes in aerial views of man-made structures." Image Vision Comput., 18 (8), 583-596. 10.1016/S0262-8856(99)00063-3
37. Ibrahim, Y. M., and, Kaka, A. P. (2008). " Review of photographic/imaging applications in construction." J. Built Human Environ. Rev., 1 (2008), 99-117.
38. Ibrahim, Y. M., Lukins, T. C., Zhang, X., Trucco, E., and, Kaka, A. P. (2009). " Towards automated progress assessment of workpackage components in construction projects using computer vision." Adv. Eng. Inf., 23 (1), 93-103. 1474-0346 10.1016/j.aei.2008.07.002
39. Jaselskis, E., and, El-Misalami, T. (2003). " Implementing radio frequency identification in the construction process." J. Constr. Eng. Manage., 10.1061/(ASCE)0733-9364(2003)129:6(680), 680-688. JCEMD4 0733-9364
40. Jung, Y., Chin, S., and, Cho, C. (2004). " Automated progress measurement framework using standard work packages." Proc., 4th Int. Conf. on Construction Project Management, ICCPM, Marina, Singapore, 472-436.
41. Kim, H., and, Kano, N. (2008). " Comparison of construction photograph and VR image in construction progress." J. Autom. Constr., 17 (2), 137-143. 0926-5805 10.1016/j.autcon.2006.12.005
42. Kiziltas, S., Akinci, B., Ergen, E., and, Tang, P. (2008). " Technological assessment and process implications of field data capture technologies for construction and facility/infrastructure management." J. Inf. Technol. Constr., 13, 134-154. 1874-4753
43. Koo, B., and, Fischer, M. (2000). " Feasibility study of 4D in commercial construction." J. Constr. Eng. Manage., 10.1061/(ASCE)0733-9364(2000)126:4(251), 251-260. JCEMD4 0733-9364
44. Koo, B., Fischer, M., and, Kunz, J. (2007). " Formalization of construction sequencing rationale and classification mechanism to support rapid generation of sequencing alternatives." J. Comput. Civ. Eng., 10.1061/(ASCE)0887-3801(2007)21:6(423), 423-433. JCCEE5 0887-3801
45. Leung, S., Mak, S., and, Lee, B. (2008). " Using a real-time integrated communication system to monitor the progress and quality of construction works." J. Autom. Constr., 17 (6), 749-757. 0926-5805 10.1016/j.autcon.2008.02.003
46. Levoy, M., et al. (2000). " The digital Michelangelo project: 3D scanning of large statues." Proc., ACM SIGGRAPH 2000, ACM, New York, 131-144.
47. Lowe, D. (2004). " Distinctive image features from scale-invariant keypoints." Int. J. Comput. Vision, 60 (2), 91-110. 1573-1405 10.1023/B:VISI.0000029664.99615.94
48. Lukins, T., and, Trucco, E. (2007). " Towards automated visual assessment of progress in construction Projects." Proc., British Machine Vision Conf., The British Machine Vision Association and Society for Pattern Recognition, Warwick, U.K.
49. McGraw-Hill Construction. (2009). " The business value of BIM: Getting BIM to the bottom line."http://www.bim.construction.com/research/pdfs/2009-BIM-SmartMarket-Report.pdf (Oct. 7, 2009).
50. Meredith, J., and, Mantel, S. (2003). Project management: A managerial approach, 5th Ed., Wiley, New York.
51. Moore, J. F. A. (1992). Monitoring building structures, Nostrand Reinhold, New York.
52. Navon, R. (2007). " Research in automated measurement of project performance indicators." J. Autom. Constr., 16 (2), 176-188. 0926-5805 10.1016/j.autcon.2006.03.003
53. Navon, R., and, Sacks, R. (2007). " Assessing research in automated project performance control (APPC)." J. Autom. Constr., 16 (4), 474-484. 0926-5805 10.1016/j.autcon.2006.08.001
54. Nistér, D. (2004). " An efficient solution to the five-point relative pose problem." IEEE Trans. Pattern Anal. Mach. Intell., 26 (6), 756-770. ITPIDJ 0162-8828 10.1109/TPAMI.2004.17
55. Nuntasunti, S., and, Bernold, L. (2002). " Beyond WEBCAM: A site-Web-Site for building construction." Proc., Int. Symp. on Automation and Robotics in Constr., IAARC, Bratislava, Slovakia.
56. Ordonez, C., Arias, P., Herraez, J., Rodriguez, J., and, Martin, M. (2008). " Two photogrammetric methods for measuring flat elements in buildings under construction." J. Autom. Constr., 17 (5), 517-525. 0926-5805 10.1016/j.autcon.2007.11.003
57. Park, H. S., Lee, H. M., Adeli, H., and, Lee, I. (2007). " A new approach for health monitoring of structures: terrestrial laser scanning." Comput. Aided Civ. Infrastruct. Eng., 22 (1), 19-30. CCIEFR 1093-9687 10.1111/mice.2007.22.issue-1
58. Peterson, F., and, Fischer, M. (2009). " Project monitoring methods exploratory case analysis: industry responses." ASCE Int. Workshop on Computing in Civ. Eng., ASCE, Reston, VA.
59. Podbreznik, P., and, Rebolj, D. (2007). " Real-time activity tracking system-The development process." 24th W78 Conf.: Bringing ITC Knowledge to Work, Maribor, Slovenia.
60. Poku, S., and, Arditi, D. (2006). " Construction scheduling and progress control using geographical information systems." J. Comput. Civ. Eng., 10.1061/(ASCE)0887-3801(2006)20:5(351), 351-360. JCCEE5 0887-3801
61. Pollefeys, M., et al. (2008). " Detailed real-time urban 3D reconstruction from video." Int. J. Comput. Vision, 78 (2-3), 143-167. 1573-1405 10.1007/s11263-007-0086-4
62. Quiñones-Rozo, C., Hashash, Y., and, Liu, L. (2008). " Digital image reasoning for tracking excavation activities." J. Autom. Constr., 17 (5), 608-622. 0926-5805 10.1016/j.autcon.2007.10.008
63. Reinhardt, J., Garrett, J., and, Scherer, J. (2000). " The preliminary design of a wearable computer for supporting construction progress monitoring." Internationales, Kolloquium über die Anwendung der Informatik und der Mathematik in Architektur und Bauwesen, Univ. of Weimar, Weimar, Germany.
64. Schindler, G., Krishnamurthy, P., Lublinerman, R., Liu, Y., and, Dellaert, F. (2008). " Detecting and matching repeated patterns for automatic geo-tagging in urban environments." Proc., Computer Vision and Pattern Recognition, IEEE, Anchorage, AK.
65. Seitz, S. M., and, Dyer, C. R. (1999). " Photorealistic scene reconstruction by voxel coloring." Int. J. Comput. Vision, 35 (2), 151-173. 1573-1405 10.1023/A:1008176507526
66. Shih, N., and, Wang, P. (2004). " Point cloud-based comparison between construction schedule and as-built progress: Long-range three-dimensional laser scanner's approach." J. Archit. Eng., 10.1061/(ASCE)1076-0431(2004)10:3(98), 98-102. JAEIED 1076-0431
67. Shih, N., Lai, J., and, Tsai, Y. L. (2006). " The application of a panorama image database management system (pidms) for information integration on construction sites." ITcon, 11, 641-654. 1874-4753
68. Sinha, S., Steedly, D., Szeliski, R., Agrawala, M., and, Pollefeys, M. (2008). " Interactive 3D architectural modeling from unordered photo collections." Proc., SIGGRAPH Asia 2008, ACM, New York, 1-10.
69. Snavely, N., Seitz, S. M., and, Szeliski, R. (2006). " Photo tourism: Exploring photo collections in 3D." ACM Trans. Graph. (SIGGRAPH Proc.), 25 (3), 835-846.
70. Snavely, N., Seitz, S. M., and, Szeliski, R. (2008). " Modeling the world from internet photo collections." Int. J. Comput. Vision, 80 (2), 189-210. 1573-1405 10.1007/s11263-007-0107-3
71. Soibelman, L., Wu, J., Caldas, C., Brilakis, I., and, Lin, K. Y. (2008). " Management and analysis of unstructured construction data types." J. Adv. Eng. Inf., 22 (1), 15-27. 10.1016/j.aei.2007.08.011
72. Song, L. (2007). " Progress measurement using CAD-based vision system." Proc., 2007 Construction Research Congress, ASCE, Reston, VA.
73. Su, Y., Hashash, Y., and, Liu, L. Y. (2006). " Integration of construction as-built data via laser scanning with geotechnical monitoring of urban excavation." J. Constr. Eng. Manage., 10.1061/(ASCE)0733-9364(2006)132:12(1234), 1234-1241. JCEMD4 0733-9364
74. Teizer, J., Kim, C., Haas, C., Liapi, K., and, Caldas, C. (2005). " Framework for real-time three-dimensional modelling of infrastructure." Geology and properties of earth materials 2005, Transportation Research Board National Research Council, Washington, DC, 177-186.
75. Triggs, B., McLauchlan, P., Hartley, R., and, Fitzgibbon, A. (1999). " Bundle adjustment-A modern synthesis." Int. Workshop on Vision Algorithms, Springer, Berlin, Heidelberg, 153-177.
76. Trupp, T., Marulanda, C., Hashash, Y., Liu, L., and, Ghaboussi, J. (2004). " Novel technologies for tracking construction progress of deep excavations." Proc., Geotechnical Engineering for Transportation Projects, ASCE, Reston, VA, 2254-2262.
77. Uffenkamp, V. (1993). " State of the art of high precision industrial photogrammetry." Proc., 3rd Int. Workshop on Accelerator Alignment, Springer, Berlin, Heidelberg.
78. Wu, Y., and, Kim, H. (2004). " Digital imaging in assessment of construction project progress." Proc., 21st Int. Symp. on Automation and Robotics in Construction, IAARC, Bratislava, Slovakia.
79. Yoders, J. (2009). " Wisconsin becomes the first state to require BIM on large, public projects." http://www.bdcnetwork.com/wisconsin-becomes-first-state-require-bim-public-projects (Jul. 20, 2009).
80. Zhang, X., et al. (2009). " Automating progress measurement of construction projects." J. Autom. Constr., 18 (3), 294-301. 0926-5805 10.1016/j.autcon.2008.09.004
81. Zebedin, L., Bauer, J., Karner, K., and, Bischof, H. (2008). " Fusion of feature- and area-based information for urban buildings modeling from aerial imagery." Comput. Vision-ECCV, 5305, 873-886. 10.1007/978-3-540-88693-8-64