ConstructAide: Analyzing and visualizing construction sites through photographs and building models

ACM Transactions on Graphics

Volumn 33, Issue 6, 2014, Pages

  Karsch, Kevin ^a   Golparvar Fard, Mani ^a   Forsyth, David ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Architectural visualization; Augmented reality; Image based rendering; Progress monitoring; Structure from motion

Indexed keywords

ARCHITECTURE; AUGMENTED REALITY; PROJECT MANAGEMENT; RENDERING (COMPUTER GRAPHICS); SEMANTICS; VISUALIZATION;

3D BUILDING MODELS; AUTOMATIC REASONING; CONSTRUCTION DATA; CONSTRUCTION SITES; IMAGE BASED RENDERING; NOVEL STRUCTURES; PHOTO COLLECTIONS; STRUCTURE FROM MOTION;

IMAGE ANALYSIS;

EID: 84914680391     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2661229.2661256     Document Type: Conference Paper

References (50)

1. ACHANTA, R., SHAJI, A., SMITH, K., LUCCHI, A., FUA, P., AND SSSTRUNK, S. 2012. Slic superpixels compared to state-of-the-art superpixel methods. IEEE TPAMI 34, 11, 2274-2282.
2. AGARWAL, S., FURUKAWA, Y., SNAVELY, N., SIMON, I., CURLESS, B., SEITZ, S. M., AND SZELISKI, R. 2011. Building rome in a day. Commun 54, 105-112.
3. AUBRY, M., RUSSELL, B. C., AND SIVIC, J. 2014. Painting-to-3d model alignment via discriminative visual elements. ACM Trans. Graph. 33, 2 (Apr.), 14:1-14:14.
4. BAE, S., AGARWALA, A., AND DURAND, F. 2010. Computational rephotography. ACM Trans. Graph. 29, 3, 24:1-24:15.
5. BEHZADAN, A. H., AND KAMAT, V. R. 2005. Visualization of construction graphics in outdoor augmented reality. In Winter Sim, WSC '05, 1914-1920.
6. COLBURN, A., AGARWALA, A., HERTZMANN, A., CURLESS, B., AND COHEN, M. F. 2013. Image-based remodeling. IEEE TVCG 19, 1, 56-66.
7. CÔTÊ, S., TRUDEL, P., DESBIENS, M., GIGUÈRE, M., AND SNYDER, R. 2013. Live mobile panoramic high accuracy augmented reality for engineering and construction. Proc., the Construction Applications of Virtual Reality.
8. CRANDALL, D., OWENS, A., SNAVELY, N., AND HUTTEN-LOCHER, D. to appear. SfM with MRFs: Discrete-continuous optimization for large-scale reconstruction. IEEE Transactions on Pattern Analysis and Machine Intelligence.
9. DEBEVEC, P. E., TAYLOR, C. J., AND MALIK, J. 1996. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. In SIGGRAPH, ACM, New York, NY, USA, 11-20.
10. DELLEPIANE, M., CAVARRETTA, E., CIGNONI, P., AND SCOPIGNO, R. 2013. Assisted multi-view stereo reconstruction. In 3DV-Conference, 2013 International Conference on, 318-325.
11. DUNSTON, P., WANG, X., BILLINGHURST, M., HAMPSON, B., ET AL. 2003. Mixed reality benefits for design perception. In Proc., ISARC, 191-196.
12. FRANKEN, T., DELLEPIANE, M., GANOVELLI, F., CIGNONI, P., MONTANI, C., AND SCOPIGNO, R. 2005. Minimizing user intervention in registering 2d images to 3d models. The Visual Computer 21, 8-10, 619-628.
13. FURUKAWA, Y., AND PONCE, J. 2010. Accurate, dense, and robust multiview stereopsis. IEEE Transactions on PAMI 32, 8, 1362-1376.
14. FURUKAWA, Y., AND PONCE, J. 2010. Accurate, dense, and robust multiview stereopsis. IEEE Trans. Pattern Anal. Mach. Intell. 32, 8 (Aug.), 1362-1376.
15. GOLPARVAR-FARD, M., SRIDHARA, A., LEE, S., AND PEÑA-MORA, F. 2007. Visual representation of construction progress monitoring metrics on time-lapse photographs. In Int. Conf. on Constr Mgmt & Economics, 1-10.
16. GOLPARVAR-FARD, M., PEÑA-MORA, F., ARBOLEDA, C. A., AND LEE, S. 2009. Visualization of construction progress monitoring with 4d simulation model overlaid on time-lapsed photographs. J. Computing in Civil Eng. 23, 6, 391-404.
17. GOLPARVAR-FARD, M., PEA-MORA, F., AND SAVARESE, S. 2011. Integrated sequential as-built and as-planned representation with tools in support of decision-making tasks in the aec/fm industry. J. Constr. Eng. & Mgmt 137, 12, 1099-1116.
18. HAKKARAINEN, M., WOODWARD, C., AND RAINIO, K. 2009. Software architecture for mobile mixed reality and 4d bim interaction. In Proc. CIB W78, 1-8.
19. HAMMAD, A., WANG, H., AND MUDUR, S. P. 2009. Distributed augmented reality for visualizing collaborative construction tasks. J Comp Civil Eng 23, 6, 418-427.
20. HUTTENLOCHER, D. P., AND ULLMAN, S. 1987. Object recognition using alignment. In ICCV.
21. IRIZARRY, J., GHEISARI, M., WILLIAMS, G., AND WALKER, B. N. 2012. Infospot: A mobile augmented reality method for accessing building information through a situation awareness approach. Automation in Construction.
22. KAHKONEN, K., HYVAKKA, J., PORKKA, J., SILTANEN, S., AND C., W. 2007. Integrating building product models with live video stream. In 7th Int. Conf. on Construction Applications of Virtual Reality, 176-188.
23. KARSCH, K., HEDAU, V., FORSYTH, D., AND HOIEM, D. 2011. Rendering synthetic objects into legacy photographs. In Proc.,SIGGRAPH Asia, SA '11, 157:1-12.
24. KOPF, J., NEUBERT, B., CHEN, B., COHEN, M. F., COHEN-OR, D., DEUSSEN, O., UYTTENDAELE, M., AND LISCHINSKI, D. 2008. Deep photo: Model-based photograph enhancement and viewing. SIGGRAPH Asia 27, 5, 116:1-116:10.
25. LEE, S., AND AKIN, Ö. 2011. Augmented reality-based computational fieldwork support for equipment operations and maintenance. AutoCON 20, 4, 338-352.
26. LOWE, D. 1987. The viewpoint consistency constraint. IJCV.
27. PARIS, S., AND DURAND, F. 2009. A fast approximation of the bilateral filter using a signal processing approach. Int. J. Comput. Vision 81, 1 (Jan.), 24-52.
28. PINTUS, R., GOBBETTI, E., AND COMBET, R. 2011. Fast and robust semi-automatic registration of photographs to 3d geometry. In The 12th International Symposium on Virtual Reality, Archaeology and Cultural Heritage, 9-16.
29. RUSSELL, B. C., SIVIC, J., PONCE, J., AND DESSALES, H. 2011. Automatic alignment of paintings and photographs depicting a 3d scene. In 3DRR.
30. SCHINDLER, G., AND DELLAERT, F. 2012. 4d cities: Analyzing, visualizing, and interacting with historical urban photo collections. J Multimedia 7, 2, 124-131.
31. SEITZ, S., CURLESS, B., DIEBEL, J., SCHARSTEIN, D., AND SZELISKI, R. 2006. A comparison and evaluation of multi-view stereo reconstruction algorithms. In Computer Vision and Pattern Recognition, vol. 1, 519-528.
32. SHIN, D. H., AND DUNSTON, P. S. 2010. Technology development needs for advancing augmented reality-based inspection. AutoCON 19, 2, 169-182.
33. SINHA, S. N., STEEDLY, D., SZELISKI, R., AGRAWALA, M., AND POLLEFEYS, M. 2008. Interactive 3d architectural modeling from unordered photo collections. SIGGRAPH Asia 27, 5, 159:1-159:10.
34. SNAVELY, N., SEITZ, S. M., AND SZELISKI, R. 2006. Photo tourism: Exploring photo collections in 3d. In SIGGRAPH, ACM, New York, NY, USA, 835-846.
35. SNAVELY, N., SEITZ, S. M., AND SZELISKI, R. 2008. Modeling the world from Internet photo collections. IJCV 80, 2, 189-210.
36. SNAVELY, N., GARG, R., SEITZ, S. M., AND SZELISKI, R. 2008. Finding paths through the world's photos. SIGGRAPH 27, 3, 11-21.
37. SUN, M., SCHINDLER, G., KANG, S. B., AND DELLAERT, F. 2007. 4d view synthesis: Navigating through time and space. In SIGGRAPH, ACM.
38. TURKAN, Y., BOSCHE, F., HAAS, C. T., AND HAAS, R. 2012. Automated progress tracking using 4d schedule and 3d sensing technologies. AutoCON 22, 414-421.
39. VAN DEN HENGEL, A., DICK, A., THORMÄHLEN, T.,WARD, B., AND TORR, P. H. S. 2007. Videotrace: Rapid interactive scene modelling from video. ACM Trans. Graph. 26, 3 (July).
40. VEDALDI, A., AND FULKERSON, B., 2008. VLFeat: An open and portable library of computer vision algorithms.
41. WAN, G., SNAVELY, N., COHEN-OR, D., ZHENG, Q., CHEN, B., AND LI, S. 2012. Sorting unorganized photo sets for urban reconstruction. Graphical Models 74, 1.
42. WANG, X. 2009. Augmented reality in architecture and design: potentials and challenges for application. Int. Journal of Architectural Computing 7, 2, 309-326.
43. WERNER, T., AND ZISSERMAN, A. 2002. New techniques for automated architectural reconstruction from photographs. In EECV, 541-555.
44. WOODWARD, C., HAKKARAINEN, M., KORKALO, O., KANTONEN, T., AITTALA, M., RAINIO, K., AND KÄHKÖNEN, K. 2010. Mixed reality for mobile construction site visualization and communication. In CONVR, 35-44.
45. WU, C., AGARWAL, S., CURLESS, B., AND SEITZ, S. M. 2011. Multicore bundle adjustment. In CVPR, 3057-3064.
46. WU, C. 2013. Towards linear-time incremental structure from motion. In 3DV.
47. XU, K., ZHENG, H., ZHANG, H., COHEN-OR, D., LIU, L., AND XIONG, Y. 2011. Photo-inspired model-driven 3d object modeling. SIGGRAPH 30, 4, 80:1-10.
48. YABUKI, N., LIMSUPREEYARAT, P., AND TONGTHONG, T. 2010. Collaborative and visualized safety planning for construction performed at high elevation. In Cooperative Design, Visualization, and Engineering. Springer, 282-285.
49. ZOLLMANN, S., KALKOFEN, D., MENDEZ, E., AND REITMAYR, G. 2010. Image-based ghostings for single layer occlusions in augmented reality. In ISMAR, 19-26.
50. ZOLLMANN, S., KALKOFEN, D., HOPPE, C., KLUCKNER, S., BISCHOF, H., AND REITMAYR, G. 2012. Interactive 4d overview and detail visualization in augmented reality. ISMAR.