A Hierarchical Pose-Based Approach to Complex Action Understanding Using Dictionaries of Actionlets and Motion Poselets

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 1981-1990

  Lillo, Ivan ^a   Niebles, Juan Carlos ^b,c   Soto, Alvaro ^a  

^a PONTIFICIA UNIVERSIDAD CATÓLICA DE CHILE   (Chile)

^b STANFORD UNIVERSITY   (United States)

^c UNIVERSIDAD DEL NORTE   (Colombia)

Author keywords

[No Author keywords available]

Indexed keywords

ATOMS; BENCHMARKING; COMPUTER VISION; GESTURE RECOGNITION; HIERARCHICAL SYSTEMS; IMAGE RECOGNITION; MOTION ESTIMATION;

ACTION RECOGNITION; COMPLEX ACTIONS; HIERARCHICAL MODEL; HUMAN-ACTION RECOGNITION; JOINT LOCATIONS; POSE ESTIMATION ERRORS; SPATIO TEMPORAL; STATE OF THE ART;

PATTERN RECOGNITION;

EID: 84986253374     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.218     Document Type: Conference Paper

References (41)

1. J. K. Aggarwal and M. S. Ryoo. Human activity analysis. ACM Computing Surveys, 43(3):16:1-16:43, Apr. 2011.
2. L. Bourdev, S. Maji, T. Brox, and J. Malik. Detecting people using mutually consistent poselet activations. In ECCV, pages 168-181, 2010.
3. L. Bourdev and J. Malik. Poselets: Body part detectors trained using 3D human pose annotations. In ICCV, pages 1365-1372, 2009.
4. C. Cao, Y. Zhang, and H. Lu. Spatio-temporal triangularchain crf for activity recognition. In Proceedings of the 23rd Annual ACM Conference on Multimedia Conference, pages 1151-1154. ACM, 2015.
5. G. Chéron, I. Laptev, and C. Schmid. P-CNN: Pose-based CNN Features for Action Recognition. ICCV, pages 3218-3226, 2015.
6. Y. Du, W. Wang, and L. Wang. Hierarchical Recurrent Neural Network for Skeleton Based Action Recognition. In CVPR, pages 1110-1118, 2015.
7. V. Escorcia, M. A. Davila, M. Golparvar-Fard, and J. C. Niebles. Automated vision-based recognition of construction worker actions for building interior construction operations using RGBD cameras. In Construction Research Congress, pages 879-888, 2012.
8. X. Feng and P. Perona. Human action recognition by sequence of movelet codewords. In 3DPVT, volume 16, pages 717-721. IEEE, 2002.
9. J.-F. Hu, W.-S. Zheng, J. Lai, and J. Zhang. Jointly learning heterogeneous features for RGB-D activity recognition. In CVPR, pages 5344-5352, 2015.
10. N. Hu, G. Englebienne, Z. Lou, and B. Krose. Learning latent structure for activity recognition. In ICRA, 2014.
11. H. Jhuang, J. Gall, S. Zuffi, C. Schmid, and M. J. Black. Towards understanding action recognition. In ICCV, pages 3192-3199, 2013.
12. T. Joachims, T. Finley, and C. Yu. Cutting-plane training of structural SVMs. Machine Learning, 77(1):27-59, 2009.
13. G. Johansson. Visual perception of biological motion and a model for its analysis. Perception & Psychophysics, 14(2):201-211, 1973.
14. Y. Kong and Y. Fu. Bilinear heterogeneous information machine for RGB-D action recognition. In CVPR, pages 1054-1062, 2015.
15. M. P. Kumar, B. Packer, and D. Koller. Self-paced learning for latent variable models. In NIPS, pages 1189-1197, 2010.
16. T. Lan, Y. Zhu, A. R. Zamir, and S. Savarese. Action recognition by hierarchical mid-level action elements. In ICCV, pages 4552-4560, 2015.
17. W. Li, Z. Zhang, and Z. Liu. Action recognition based on a bag of 3D points. In CVPR, pages 9-14, 2010.
18. I. Lillo, A. Soto, and J. C. Niebles. Discriminative hierarchical modeling of spatio-temporally composable human activities. In CVPR, pages 812-819, 2014.
19. S. Maji, L. Bourdev, and J. Malik. Action recognition from a distributed representation of pose and appearance. In CVPR, pages 3177-3184, 2011.
20. B. X. Nie, C. Xiong, and S.-c. Zhu. Joint action recognition and pose estimation from video. In CVPR, pages 1293-1301, 2015.
21. R. Poppe. A survey on vision-based human action recognition. Image and Vision Computing, 28(6):976-990, 2010.
22. D. Ramanan and D. A. Forsyth. Automatic annotation of everyday movements. In NIPS, 2003.
23. M. Raptis, I. Kokkinos, and S. Soatto. Discovering discriminative action parts from mid-level video representations. CVPR, pages 1242-1249, 2012.
24. M. Rohrbach, S. Amin, M. Andriluka, and B. Schiele. A database for fine grained activity detection of cooking activities. In CVPR, pages 1194-1201, 2012.
25. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake. Real-time human pose recognition in parts from a single depth image. In Communications of the ACM, pages 116-124, 2011.
26. L. Tao and R. Vidal. Moving Poselets : A Discriminative and Interpretable Skeletal Motion Representation for Action Recognition. In IEEE International Conference on Computer Vision Workshops, pages 61-69, 2015.
27. C. Thurau and V. Hlavac. Pose primitive based human action recognition in videos or still images. In CVPR, pages 1-8, 2008.
28. R. Vemulapalli, F. Arrate, and R. Chellappa. Human Action Recognition by Representing 3D Skeletons as Points in a Lie Group. In CVPR, pages 588-595, 2014.
29. S. Vishwakarma and A. Agrawal. A survey on activity recognition and behavior understanding in video surveillance. The Visual Computer, 29(10):983-1009, 2013.
30. C. Wang, Y. Wang, and A. L. Yuille. An approach to posebased action recognition. In CVPR, pages 915-922, 2013.
31. H.Wang, A. Klaser, C. Schmid, and C.-L. Liu. Action recognition by dense trajectories. In CVPR, pages 3169-3176, 2011.
32. J. Wang, Z. Liu, Y. Wu, and J. Yuan. Mining actionlet ensemble for action recognition with depth cameras. In CVPR, pages 1290-1297, 2012.
33. L. Wang, Y. Qiao, and X. Tang. Video Action Detection with Relational Dynamic-Poselets. In ECCV, pages 565-580, 2014.
34. Y. Wang and G. Mori. Learning a discriminative hidden part model for human action recognition. In NIPS, pages 1721-1728, 2008.
35. P.Wei, N. Zheng, Y. Zhao, and S.-C. Zhu. Concurrent action detection with structural prediction. In ICCV, pages 3136-3143, 2013.
36. D. Weinland, R. Ronfard, and E. Boyer. A survey of visionbased methods for action representation, segmentation and recognition. Journal of Computer Vision and Image Understanding, 115(2):224-241, 2011.
37. B. Yao and L. Fei-Fei. Modeling Mutual Context of Object and Human Pose in Human-Object Interaction Activities. In CVPR, pages 17-24. IEEE, 2010.
38. S. Yeung, O. Russakovsky, N. Jin, M. Andriluka, G. Mori, and L. Fei-Fei. Every Moment Counts: Dense Detailed Labeling of Actions in Complex Videos. arXiv:1507.05738, 2015.
39. C. Yu and T. Joachims. Learning structural svms with latent variables. In ICML, pages 1169-1176, 2009.
40. A. Yuille and A. Rangarajan. The concave-convex procedure. Neural Computation, 15(4):915-936, 2003.
41. M. Zanfir, M. Leordeanu, and C. Sminchisescu. The Moving Pose: An Efficient 3D Kinematics Descriptor for Low-Latency Action Recognition and Detection. In ICCV, pages 2752-2759, 2013.