Learning and classifying actions of construction workers and equipment using Bag-of-Video-Feature-Words and Bayesian network models

Advanced Engineering Informatics

Volumn 25, Issue 4, 2011, Pages 771-782

  Gong, Jie ^a   Caldas, Carlos H ^b   Gordon, Chris ^a  

^a SOUTHERN ILLINOIS UNIVERSITY EDWARDSVILLE   (United States)

^b The University of Texas at Austin   (United States)

Author keywords

Action recognition; Automated data collection; Bag of Words; Bayesian network models; Computer vision; Productivity analysis

Indexed keywords

ACTION RECOGNITION; AUTOMATED DATA COLLECTION; BAG-OF-WORDS; BAYESIAN NETWORK MODELS; PRODUCTIVITY ANALYSIS;

BAYESIAN NETWORKS; COMPUTER VISION; CONSTRUCTION INDUSTRY; EQUIPMENT TESTING; FEATURE EXTRACTION; IMAGE SEGMENTATION; MOTION ESTIMATION; STATISTICAL TESTS; VIDEO RECORDING;

CONSTRUCTION EQUIPMENT;

EID: 80053611627     PISSN: 14740346     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.aei.2011.06.002     Document Type: Article

References (43)

1. B. Akinci, F. Boukamp, C. Gordon, D. Huber, C. Lyons, and K. Park A formalism for utilization of sensor systems and integrated project models for active construction quality control Automation in Construction 15 2 2006 124 138 (Pubitemid 41817142)
2. J. Song, C.T. Haas, and C.H. Caldas A proximity-based method for locating RFID tagged objects Advanced Engineering Informatics 21 4 2007 367 376 (Pubitemid 47532787)
3. R. Navon Automated project performance control of construction projects Automation in Construction 14 2005 467 476 (Pubitemid 40305009)
4. J. Yang, O. Arif, P.A. Vela, J. Teizer, and Z. Shi Tracking multiple workers on construction sites using video cameras Advanced Engineering Informatics 24 4 2007 428 434
5. J. Gong, and C.H. Caldas Data processing for real-time construction site spatial modeling Automation in Construction 17 5 2008 526 535 (Pubitemid 351375079)
6. I. Brilakis, L. Soibelman, and Y. Shinagawa Material-based construction site image retrieval Journal of Computing in Civil Engineering 19 4 2005 341 355 (Pubitemid 41441365)
7. L. Soibelman, J. Wu, C. Caldas, I. Brilakis, and K.Y. Lin Management and analysis of unstructured construction data types Advanced Engineering Informatics 22 1 2008 15 27 (Pubitemid 351273678)
8. F. Bosche, and C.T. Haas Automated retrieval of 3D CAD model objects in construction range images Automation in Construction 17 4 2008 499 512 (Pubitemid 351173673)
9. E.J. Jaselskis, Z. Gao, and R.C. Walters Improving Transportation Projects Using Laser Scanning Journal of Construction Engineering and Management 131 3 2005 377 384 (Pubitemid 40303946)
10. X. Luo, W.J. O'Brien, and C.L. Julien Comparative evaluation of Received Signal-Strength Index (RSSI) based indoor localization techniques for construction jobsites Advanced Engineering Informatics 24 2 2011 355 363
11. J. Gong, and C.H. Caldas Computer vision-based video interpretation model for automated productivity analysis of construction operations ASCE Journal of Computing in Civil Engineering 24 3 2010 252 263
12. J. Abeid, and D. Arditi Linking time-lapse digital photography and dynamic scheduling of construction operations Journal Computing in Civil Engineering 16 2002 269 279 (Pubitemid 40475483)
13. C.A. Quinones-Rozo, Y.M.A. Hashash, and L.Y. Liu Digital image reasoning for tracking excavation activities Automation in Construction 17 5 2008 608 622
14. G.M. Jog, I.K. Brilakis, and D.C. Angelides Testing in harsh conditions: Tracking resources on construction sites with machine vision Automation in Construction 20 4 2011 328 337
15. A. Peddi, L. Huan, Y. Bai, S. Kim, Development of human pose analyzing algorithms for the determination of construction productivity in real-time, in: Construction Research Congress 2009, vol. 1, ASCE, Seattle, WA, 2009, pp. 11-20.
16. T.I.P. Weerasinghe, J.Y. Ruwanpura, Automated multiple objects tracking system (AMOTS), in: Construction Research Congress, vol. 1, ASCE, Banff, Canada, 2010, pp. 11-20.
17. D. Grau, C.H. Caldas, C.T. Haas, P.M. Goodrum, and J. Gong Assessing the impact of materials tracking technologies on construction craft productivity Automation in Construction 18 7 2009 903 911
18. N. Lee, E.M. Rojas, Defining high-level project control data for visual information systems, in: Construction Research Congress 2010, vol. 1, ASCE, Banff, Canada, 2010, pp. 518-527.
19. J. Zou, and H. Kim Using hue, saturation, and value color space for hydraulic excavator idle time analysis Journal Computing in Civil Engineering 21 2007 238 246 (Pubitemid 46935005)
20. C. Cedras, and M. Shah Action-based recognition a survey Image and Vision Computing 13 2 1995 129 155
21. D.M. Gavrila The Visual Analysis of Human Movement: A Survey 1 Computer Vision and Image Understanding 73 1 1999 82 98
22. J.K. Aggarwal, and Q. Cai Human action analysis: A review, in: Workshop on Action of Non-Rigid and Articulated Objects 2002 IEEE Austin, Texas (pp. 90-102)
23. W. Hu, T. Tan, L. Wang, and S. Maybank A survey on visual surveillance of object action and behaviors Transactions on Systems, Man, and Cybernetics - Part C: Applications and Reviews 34 3 2004 334 352
24. T.B. Moeslund, A. Hilton, and V. Krüger A survey of advances in vision-based human action capture and analysis Computer Vision and Image Understanding 104 2-3 2006 90 126 (Pubitemid 44573873)
25. J.C. Niebles, H. Wang, and L. Fei-Fei Unsupervised learning of human action categories using spatial-temporal words International Journal of Computer Vision 79 3 2008 299 318
26. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld Learning realistic human actions from movies, Computer Vision and Pattern Recognition CVPR 2008 IEEE (pp. 1-8)
27. R. Gonsalves, J. Teizer, Human Action Analysis Using 3D Range Imaging Technology, 26th International Symposium on Automation and Robotics in Construction Austin, Texas, 2009.
28. J. Sivic, B.C. Russell, A.A. Efros, A. Zisserman, W.T. Freeman, Discovering objects and their location in images, in: International Conference on Computer Vision, vol. 1, IEEE, 2005, pp. 370-377. (Pubitemid 44054982)
29. K. Grauman, and T. Darrell The pyramid match kernel: Discriminative classification with sets of image features, in: International Conference on Computer Vision 2005 IEEE Computer Society
30. T. Tuytelaars, and K. Mikolajczyk Local invariant feature detectors: A survey Foundations and Trends in Computer Graphics and Vision 3 3 2008 177 280
31. I. Laptev On space-time interest points International Journal of Computer Vision 64 2 2005 107 123 (Pubitemid 41314645)
32. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, CVPR 2005, vol. 1, IEEE, pp. 886-893.
33. B.K.P. Horn, and B.G. Schunck Determining optical flow Artificial Intelligence 17 1-3 1981 185 203
34. J. Pearl, Probabilistic reasoning in intelligent systems: networks of plausible inference, Morgan Kaufmann, 1988.
35. D. Koller, N. Friedman, Probabilistic Graphical Models: Principles and Techniques, The MIT Press, 2009.
36. T. Hofmann, Probabilistic latent semantic indexing, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval ACM, 1999, pp. 50-57.
37. L. Fei-Fei, and P. Perona A Bayesian hierarchical model for learning natural scene categories, CVPR IEEE 2 2005 524 531
38. R. Fergus, P. Perona, A. Zisserman, Object class recognition by unsupervised scale-invariant learning, CVPR2003, Published by the IEEE Computer Society, 2003.
39. D.G. Lowe Distinctive image features from scale-invariant keypoints International Journal of Computer Vision 60 2 2004 91 110
40. C. Harris, and M. Stephens A combined corner and edge detector, in: Alvey vision conference, vol. 15 1988 Manchester UK (p. 50)
41. S. Belongie, J. Malik, and J. Puzicha Shape matching and object recognition using shape contexts IEEE Transactions on Pattern Analysis and Machine Intelligence 24 4 2002 509 522 (Pubitemid 34448769)
42. W. Freeman, and E. Adelson The design and use of steerablelters IEEE Transactions on Pattern Analysis and Machine Intelligence 13 9 1991 891 906
43. I., Brilakis, M.W. Park, G. Jog, Automated vision tracking of project related entities, Journal of Advanced Engineering Informatics, Elsevier, in press.