Automated 2D detection of construction equipment and workers from site video streams using histograms of oriented gradients and colors

Automation in Construction

Volumn 32, Issue , 2013, Pages 24-37

  Memarzadeh, Milad ^a   Golparvar Fard, Mani ^b   Niebles, Juan Carlos ^c  

^a State University   (United States)

^b University of Illinois at Urbana Champaign   (United States)

^c UNIVERSIDAD DEL NORTE   (Colombia)

Author keywords

Histogram of oriented gradients; HSV colors; Performance monitoring; Resource tracking; Support vector machine

Indexed keywords

AUTOMATION; CAMERAS; COLOR; COMPUTER HARDWARE DESCRIPTION LANGUAGES; CONSTRUCTION EQUIPMENT; GRAPHIC METHODS; SUPPORT VECTOR MACHINES; TRUCKS; VIDEO CAMERAS; VIDEO STREAMING;

BINARY SUPPORT VECTOR MACHINES; FREQUENCY OF APPEARANCE; HISTOGRAM OF ORIENTED GRADIENTS; HISTOGRAMS OF ORIENTED GRADIENTS; PERFORMANCE MONITORING; SEMI-AUTOMATED DETECTION; SLIDING DETECTION WINDOWS; STATE-OF-THE-ART ALGORITHMS;

EQUIPMENT;

EID: 84878369658     PISSN: 09265805     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.autcon.2012.12.002     Document Type: Article

References (45)

1. E. Rezazadeh Azar, B. McCabe, Automated Visual Recognition of Dump Trucks in Construction Videos, J. Comput. Civ. Eng. 26 (6) (2012) 769-781, http://dx.doi.org/10.1061/(ASCE)CP.1943-5487.0000179.
2. H. Bay, A. Ess, T. Tuytelaars, L.v. Gool, SURF: speeded up robust features, Computer Vision and Image Understanding 110 (3) (2008) 346-359.
3. I. Brilakis, M. Park, G. Jog, Automated vision tracking of project related entities, Advanced Engineering Informatics 25 (2011) 713-724.
4. C.H. Caldas, D. Grau, C.T. Haas, Using global positioning system to improve materials-locating processes on industrial projects, ASCE Journal of Construction Engineering and Management 132 (7) (2006) 741-750.
5. T. Cheng, M. Venugopal, J. Teizer, P.A. Vela, Performance evaluation of ultra wideband technology for construction resource location tracking in harsh environments, Automation in Construction 20 (2011) 1173-1184.
6. S. Chi, C.H. Caldas, Automated object identification using optical video cameras on construction sites, Computer-Aided Civil & Infrastructure Engineering 26 (2011) 368-380.
7. J.C. Christopher, A. Burges, A tutorial on support vector machines for pattern recognition, Data Mining and Knowledge Discovery 2 (1998) 121-167.
8. N. Dalal, Finding people in images and videos, PhD Dissertation Institute National Polytechnique De Grenoble (2006).
9. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: Proc. IEEE CVPR, San Diego, CA, 2, 2005, pp. 886-893. (Pubitemid 43897286)
10. N. Dalal, B. Triggs, C. Schmid, Human detection using oriented histograms of flow and appearance, in: Proc. ECCV, 2, 2006, pp. 428-441. (Pubitemid 44029745)
11. S. El-Omari, O. Moselhi, Integrating automated data acquisition technologies for progress reporting of construction projects, in: 26th International Symposium on Automation and Robotics in Construction, Austin TX, 2009.
12. ENR, Don't blame the workers, engineering news-record, 2011.
13. E. Ergen, B. Akinci, R. Sacks, Tracking and locating components in precast storage yard utilizing RIFD technology and GPS, Automation in Construction 16 (3) (2007) 354-367. (Pubitemid 46205287)
14. P.F. Felzenszwalb, R.B. Girshick, D. McAllester, D. Ramanan, Object detection with discriminatively trained part-based models, TPAMI 32 (9) (2010) 1627-1645.
15. R.J. Fontana, S.J. Gunderson, Ultra-wideband precision asset location system, in: IEEE Conference on Ultra Wideband Systems and Technologies, Baltimore MD, 2002.
16. M. Golparvar-Fard, F. Pena-Mora, C.A. Arboleda, S. Lee, Visualization of construction progress monitoring with 4D simulation model overlaid on time-lapsed photographs, ASCE Journal of Computing in Civil Engineering 23 (6) (2009) 391-404.
17. M. Golparvar-Fard, F. Pena-Mora, S. Savarese, Application of D4AR - a 4-dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication, ITcon 14 (2009) 129-153.
18. M. Golparvar-Fard, F. Pena-Mora, S. Savarese, Integrated sequential as-built and as-planned representation with D4AR tools in support of decision-making tasks in the AEC/FM industry, ASCE Journal of Construction Engineering and Management 137 (12) (2011) 1099-1116.
19. J. Gong, C.H. Caldas, Computer vision-based video interpretation model for automated productivity analysis of construction operations, ASCE Journal of Computing in Civil Engineering 24 (2010) 252-263.
20. J. Gong, C.H. Caldas, Construction site vision workbench: a software framework for real-time process analysis of cyclic construction operations, in: Proc. ASCE Int. Workshop on Computing in Civil Engineering, Auton, TX, 2009, pp. 64-73.
21. J. Gong, C.H. Caldas, Data processing for real-time construction site spatial modeling, Automation in Construction 17 (2008) 526-535. (Pubitemid 351375079)
22. J. Gong, C.H. Caldas, An object recognition, tracking and contextual reasoning-based video interpretation method for rapid productivity analysis of construction operations, Automation in Construction 20 (2011) 1211-1226.
23. P. Goodrum, C.T. Haas, C.H. Caldas, D. Zhai, J. Yeiser, D. Homm, Model to predict the impact of a technology on construction productivity, ASCE Journal of Construction Engineering and Management 137 (678) (2011).
24. D. Grau, C.H. Caldas, C.T. Haas, P.M. Goodrum, J. Gong, Assessing the impact of materials tracking technologies on construction craft productivity, Automation in Construction 18 (2009) 903-911.
25. J. Teizer, D. Lao, M. Sofer, Rapid automated monitoring of construction site activities using ultra-wideband, in: Proc. of 24th Int. ISARC, Kerala, India, 2007, pp. 23-28.
26. V.R. Kamat, M. Akula, Integration of global positioning system and inertial navigation for ubiquitous context-aware engineering applications, in: Proc. National Science Foundation Grantee Conference, Atlanta GA, 2011.
27. I. Laptev, Improvements of Object Detection using Boosted Histograms, BMVC, 2006.
28. D.G. Lowe, Distinctive image features from scale-invariant keypoints, International Journal of Computer Vision 60 (2) (2004) 91-110.
29. A. Martin, G. Doddington, T. Kamm, M. Ordowski, M. Przybocki, The DET Curve in Assessment of, Detection Task Performance, NIST, 1997.
30. M. Memarzadeh, A. Heydarian, M. Golparvar-Fard, J. Niebles, Real-Time and Automated Recognition and 2D Tracking of Construction Workers and Equipment from Site Video Streams, Computing in Civil Engineering (June 2012) 429-436.
31. R. Navon, Automated project performance control (appc) of construction projects, Automation in Construction 14 (4) (2005) 467-476. (Pubitemid 40305009)
32. R. Navon, R. Sacks, Assessing research in automated project performance control (APPC), Automation in Construction 16 (4) (2007) 474-484.
33. NIST, Criteria for Performance Excellence, National Institute of Science and Technology, 2011-2012.
34. C.H. Oglesby, H.W. Parker, G.A. Howell, Productivity Improvement in Construction, McGraw-Hill, New York, NY, 1989.
35. M-W. Park, C. Koch, I. Brilakis, 3D Tracking of Construction Resources Using an On-site Camera System, Journal of Computing in Civil Engineering 26 (4) (2012) 541-549.
36. M-W. Park, I. Brilakis, Construction worker detection in video frames for initializing vision trackers, Automation in Construction (ISSN: 0926-5805) 28 (2012) 15-25, http://dx.doi.org/10.1016/j.autcon.2012.06.001, (http://www.sciencedirect.com/science/article/pii/S0926580512001136).
37. J. Song, C.H. Caldas, E. Ergen, C.T. Haas, B. Akinci, Field trials of RFID technology for tracking pre-fabricated pipe spools, in: Proc. of the 21st International Symposium on Automation and Robotics in Construction, 2004.
38. J. Song, C.T. Haas, C.H. Caldas, Tracking the location of materials on construction job sites, ASCE Journal of Construction Engineering and Management 132 (9) (2006) 911-918.
39. Y. Su, L. Liu, Real-time construction operation tracking from resource positions, in: ASCE Int. Workshop on Computing in Civil Engineering, Pittsburg, PA, 2007, pp. 200-207.
40. P. Viola, M. Jones, Rapid object detection using boosted cascade of simple features, in: IEEE CVPR, Kauai HI, 1, 2001, pp. 1-9.
41. J.v.d. Weijer, C. Schmid, Coloring local feature extraction, in: Proc. ECCV, 2, 2006, pp. 332-348.
42. J. Yang, P.A. Vela, J. Teizer, Z.K. Shi, Vision-based crane tracking for understanding construction activity, in: Proc. ASCE Int. Workshop on Computing in Civil Engineering, Miami FL, 2011, pp. 258-265.
43. Y. Yang, D. Ramanan, Articulated pose estimation with flexible mixtures-of-parts, in: IEEE CVPR, 2011, pp. 1385-1392.
44. J. Zou, H. Kim, Using hue, saturation, and value color space for hydraulic excavator idle time analysis, ASCE Journal of Computing in Civil Engineering 21 (2007) 238-246. (Pubitemid 46935005)
45. D. Forsyth, J. Ponce, Computer Vision: A Modern Approach, Second edition Pearson Education Inc., 2011.