Informative joints based human action recognition using skeleton contexts

Signal Processing: Image Communication

Volumn 33, Issue , 2015, Pages 29-40

  Jiang, Min ^a   Kong, Jun ^a,b   Bebis, George ^c   Huo, Hongtao ^d  

^a JIANGNAN UNIVERSITY   (China)

^b XINJIANG UNIVERSITY   (China)

^c University of Nevada   (United States)

^d PEOPLE S PUBLIC SECURITY UNIVERSITY OF CHINA   (China)

Author keywords

Action recognition; Affinity propagation; CRFs; Informative joints; Kinect; Skeleton contexts

Indexed keywords

IMAGE COMMUNICATION SYSTEMS; SIGNAL PROCESSING;

ACTION RECOGNITION; AFFINITY PROPAGATION; CRFS; KINECT; SKELETON CONTEXTS;

MUSCULOSKELETAL SYSTEM;

EID: 84926151602     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.image.2015.02.004     Document Type: Article

References (29)

1. A. Gaidon, Z. Harchaoui, C. Schmid, Actom sequence models for efficient action detection, in: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, pp. 3201-3208.
2. M.A.R. Ahad, J.K. Tan, H. Kim, and S. Ishikawa Motion history image its variants and applications Mach. Vis. Appl. 23 2 2012 255 281
3. T.-K. Kim, and R. Cipolla Canonical correlation analysis of video volume tensors for action categorization and detection IEEE Trans. Pattern Anal. Mach. Intell. 31 8 2009 1415 1428
4. C. Schuldt, I. Laptev, B. Caputo, Recognizing human actions: a local SVM approach, in: Proceedings of the 17th International Conference on Pattern Recognition (ICPR), vol. 3, 2004, pp. 32-36.
5. M. Marszalek, I. Laptev, C. Schmid, Actions in context, in: 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), 2009, pp. 2929-2936.
6. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, A. Blake, Real-time human pose recognition in parts from single depth images, in: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, pp. 1297-1304.
7. A. Kurakin, Z. Zhang, Z. Liu, A real time system for dynamic hand gesture recognition with a depth sensor, in: The 20th European Signal Processing Conference (EUSIPCO), 2012, pp. 1975-1979.
8. H. Benko, A. Wilson, Depthtouch: Using Depth-Sensing Camera to Enable Freehand Interactions on and Above the Interactive Surface, Technical Report MSR-TR-2009-23, March 2009.
9. J. Shotton, R. Girshick, A. Fitzgibbon, T. Sharp, M. Cook, M. Finocchio, R. Moore, P. Kohli, A. Criminisi, A. Kipman, and A. Blake Efficient human pose estimation from single depth images Pattern Anal. Mach. Intell. 35 12 2013 2821 2840
10. L.A. Schwarz, D. Mateus, V. Castaeda, N. Navab, Manifold learning for ToF-based human body tracking and activity recognition, in: The 21st British Machine Vision Conference (BMVC), 2010, pp. 1-11.
11. L. Xia, J.K. Aggarwal, Spatio-temporal depth cuboid similarity feature for activity recognition using depth camera, in: The 26th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013, pp. 2834-2841.
12. O. Oreifej, Z. Liu, HON4D: Histogram of oriented 4D normals for activity recognition from depth sequences, in: The 26th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013, pp. 716-723.
13. W. Li, Z. Zhang, Z. Liu, Action recognition based on a bag of 3D points, in: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2010, pp. 9-14.
14. R. Dubey, B. Ni, P. Moulin, A depth camera based fall recognition system for the elderly, in: The Ninth International Conference on Image Analysis and Recognition (ICIAR), vol. 7325, 2012, pp. 106-113.
15. E. Ohn-Bar, M.M. Trivedi, Joint angles similarities and HOG2 for action recognition, in: 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2013, pp. 465-470.
16. X. Lu, C. Chia-Chih, J.K. Aggarwal, View invariant human action recognition using histograms of 3D joints, in: 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2012, pp. 20-27.
17. F. Ofli, R. Chaudhry, G. Kurillo, R. Vidal, and R. Bajcsy Sequence of the most informative joints (SMIJ): A new representation for human skeletal action recognition J. Vis. Commun. Image Represent. 25 1 2014 24 38
18. G. Evangelidis, G. Singh, R. Horaud, Skeletal Quads: Human action recognition using joint quadruples, in: The 22nd International Conference on Pattern Recognition (ICPR), 2014, p. NA.
19. R. Chaudhry, F. Ofli, G. Kurillo, R. Bajcsy, R. Vidal, Bio-inspired dynamic 3D discriminative skeletal features for human action recognition, in: 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2013, pp. 471-478.
20. C. Plagemann, V. Ganapathi, D. Koller, S. Thrun, Real-time identification and localization of body parts from depth images, in: 2010 IEEE International Conference on Robotics and Automation (ICRA), 2010, pp. 3108-3113.
21. B.J. Frey, and D. Dueck Clustering by passing messages between data points Science 315 5814 2007 972 976
22. S. Jaeyong, C. Ponce, B. Selman, A. Saxena, Unstructured human activity detection from RGBD images, in: 2012 IEEE International Conference on Robotics and Automation (ICRA), 2012, pp. 842-849.
23. L. Shih-Yao, S. Chuen-Kai, C. Shen-Chi, L. Ming-Sui, H. Yi-Ping, Human action recognition using action trait code, in: The 21st International Conference on Pattern Recognition (ICPR), 2013, pp. 3456-3459.
24. X. Yang, and Y. Tian Effective 3D action recognition using eigenjoints J. Vis. Commun. Image Represent. 25 1 2014 2 11
25. M. Devanne, H. Wannous, S. Berretti, P. Pala, M. Daoudi, A. Del Bimbo, Space-time pose representation for 3D human action recognition, in: ICIAP Workshop on Social Behaviour Analysis, 2013, pp. 456-464.
26. J. Wang, Z. Liu, Y. Wu, J. Yuan, Mining actionlet ensemble for action recognition with depth cameras, in: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012, pp. 1290-1297.
27. G. Johansson Visual perception of biological motion and a model for its analysis Percept. Psychophys. 14 2 1973 201 211
28. R. Vemulapalli, F. Arrate, R. Chellappa, Human action recognition by representing 3d skeletons as points in a Lie group, in: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.
29. Y. Zhu, W. Chen, G. Guo, Fusing spatiotemporal features and joints for 3D action recognition, in: 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2013, pp. 486-491.