Joint movement similarities for robust 3D action recognition using skeletal data

Journal of Visual Communication and Image Representation

Volumn 30, Issue , 2015, Pages 10-21

  Pazhoumand Dar, Hossein ^a   Lam, Chiou Peng ^a   Masek, Martin ^a  

^a EDITH COWAN UNIVERSITY   (Australia)

Author keywords

Discriminative features; Human action recognition; Kinect camera; Longest common subsequence algorithm; Motion capture system; Motion pattern; Similarity function; Trajectory modeling

Indexed keywords

ALGORITHMS; CAMERAS; GESTURE RECOGNITION; MOTION ESTIMATION; MUSCULOSKELETAL SYSTEM; OBJECT RECOGNITION; PATTERN RECOGNITION SYSTEMS;

DISCRIMINATIVE FEATURES; HUMAN-ACTION RECOGNITION; KINECT CAMERAS; LONGEST COMMON SUBSEQUENCES; MOTION CAPTURE SYSTEM; MOTION PATTERN; SIMILARITY FUNCTIONS; TRAJECTORY MODELING;

DATA MINING;

EID: 84925734320     PISSN: 10473203     EISSN: 10959076     Source Type: Journal    
DOI: 10.1016/j.jvcir.2015.03.002     Document Type: Article

References (53)

1. P. Antonakaki, D. Kosmopoulos, and S.J. Perantonis Detecting abnormal human behaviour using multiple cameras Signal Process. 89 9 2009 1723 1738
2. Y. Chen et al. Abnormal behavior detection by multi-SVM-based Bayesian network International Conference on Information Acquisition, 2007, ICIA'07 2007 IEEE
3. J.J. Corso et al. A practical paradigm and platform for video-based human-computer interaction Computer 41 5 2008 48 55
4. H. Seki, Fuzzy inference based non-daily behavior pattern detection for elderly people monitoring system, in: Conf. Proc. IEEE Eng. Med. Biol. Soc., 2009, 2009, pp. 6187-6192.
5. Kinect Camera, 2013. . < http://www.xbox.com/en-AU/Kinect > (cited 13.12.13).
6. K. Lai et al. Sparse distance learning for object recognition combining RGB and depth information IEEE International Conference on Robotics and Automation (ICRA), 2011 2011 IEEE
7. Kinect for Windows SDK, 2013. < http://msdn.microsoft.com/en-us/library/hh855347.aspx > (cited 13.12.13).
8. OpenNI, 2013. < http://www.openni.org/ > (cited 13.12.13).
9. J. Aggarwal, and L. Xia Human activity recognition from 3D data: a review Pattern Recogn. Lett. 2014
10. M. Vlachos, G. Kollios, and D. Gunopulos Discovering similar multidimensional trajectories Proceedings, 18th International Conference on Data Engineering, 2002 2002 IEEE
11. S. Almotairi, and E. Ribeiro Human action recognition using temporal sequence alignment International Conference on Computational Science and Computational Intelligence (CSCI), 2014 2014 IEEE
12. M. Vrigkas, Action recognition by matching clustered trajectories of motion vectors, in: VISAPP (1), 2013.
13. S.-Y. Jin, and H.-J. Choi Essential body-joint and atomic action detection for human activity recognition using longest common subsequence algorithm Computer Vision-ACCV 2012 Workshops 2013 Springer
14. I. Laptev On space-time interest points Int. J. Comput. Vis. 64 2-3 2005 107 123
15. P.-C. Chung, and C.-D. Liu A daily behavior enabled hidden Markov model for human behavior understanding Pattern Recogn. 41 5 2008 1572 1580
16. W.-L. Lu, and J.J. Little Simultaneous tracking and action recognition using the PCA-HOG descriptor The 3rd Canadian Conference on Computer and Robot Vision, 2006 2006 IEEE
17. B. Ni, G. Wang, and P. Moulin RGBD-HuDaAct: a color-depth video database for human daily activity recognition Consumer Depth Cameras for Computer Vision 2013 Springer 193 208
18. L. Xia, and J. Aggarwal Spatio-temporal depth cuboid similarity feature for activity recognition using depth camera IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013 2013 IEEE
19. X. Yang, C. Zhang, and Y. Tian Recognizing actions using depth motion maps-based histograms of oriented gradients Proceedings of the 20th ACM International Conference on Multimedia 2012 ACM
20. X. Yang, Y. Tian, Super normal vector for activity recognition using depth sequences, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014, 2014.
21. S. Hadfield, and R. Bowden Hollywood 3D: recognizing actions in 3D natural scenes IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013 2013 IEEE
22. G. Willems, T. Tuytelaars, and L. Van Gool An efficient dense and scale-invariant spatio-temporal interest point detector Computer Vision-ECCV 2008 2008 Springer 650 663
23. O. Oshin, A. Gilbert, and R. Bowden Capturing the relative distribution of features for action recognition IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), 2011 2011 IEEE
24. G. Johansson Visual perception of biological motion and a model for its analysis Percept. Psychophys. 14 2 1973 201 211
25. K. Lai, J. Konrad, and P. Ishwar A gesture-driven computer interface using Kinect IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI), 2012 2012 IEEE
26. T. Arici et al. Robust gesture recognition using feature pre-processing and weighted dynamic time warping Multimed. Tools Appl. 2013 1 18
27. X. Yang, and Y. Tian Effective 3D action recognition using eigenjoints J. Vis. Commun. Image Represent. 25 1 2014 2 11
28. V. Bloom, D. Makris, and V. Argyriou G3D: a gaming action dataset and real time action recognition evaluation framework IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2012 2012 IEEE
29. C. Zhang, and Y. Tian RGB-D camera-based daily living activity recognition J. Comput. Vis. Image Process. 2 4 2012 12
30. S.Z. Masood et al. Measuring and reducing observational latency when recognizing actions IEEE International Conference on Computer Vision Workshops (ICCV Workshops), 2011 2011 IEEE
31. J. Wang et al. Mining actionlet ensemble for action recognition with depth cameras IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012 2012 IEEE
32. J. Sung et al. Unstructured human activity detection from RGBD images IEEE International Conference on Robotics and Automation (ICRA), 2012 2012 IEEE
33. L. Xia, C.-C. Chen, and J. Aggarwal View invariant human action recognition using histograms of 3D joints IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2012 2012 IEEE
34. L. Han et al. Discriminative human action recognition in the learned hierarchical manifold space Image Vis. Comput. 28 5 2010 836 849
35. S. Sempena, N.U. Maulidevi, and P.R. Aryan Human action recognition using dynamic time warping International Conference on Electrical Engineering and Informatics (ICEEI), 2011 2011 IEEE
36. M. Reyes, G. Dominguez, and S. Escalera Featureweighting in dynamic timewarping for gesture recognition in depth data IEEE International Conference on Computer Vision Workshops (ICCV Workshops), 2011 2011 IEEE
37. F. Lv, and R. Nevatia Recognition and segmentation of 3-D human action using HMM and multi-class adaboost Computer Vision-ECCV 2006 2006 Springer 359 372
38. F. Ofli et al. Sequence of the most informative joints (SMIJ): a new representation for human skeletal action recognition J. Vis. Commun. Image Represent. 25 1 2014 24 38
39. M. Pierobon et al. Clustering of human actions using invariant body shape descriptor and dynamic time warping IEEE Conference on Advanced Video and Signal Based Surveillance, 2005, AVSS 2005 2005 IEEE
40. J. Wang, and H. Zheng View-robust action recognition based on temporal self-similarities and dynamic time warping IEEE International Conference on Computer Science and Automation Engineering (CSAE), 2012 2012 IEEE
41. A. Corradini Dynamic time warping for off-line recognition of a small gesture vocabulary Proceedings, IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems 2001 2001 IEEE
42. L.A. Shalabi, Z. Shaaban, and B. Kasasbeh Data mining: a preprocessing engine J. Comput. Sci. 2 9 2006 735
43. M. Raptis, D. Kirovski, and H. Hoppe Real-time classification of dance gestures from skeleton animation Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation 2011 ACM
44. S. Monir, S. Rubya, and H.S. Ferdous Rotation and scale invariant posture recognition using Microsoft Kinect skeletal tracking feature 12th International Conference on Intelligent Systems Design and Applications (ISDA), 2012 2012 IEEE
45. C.E. Shannon A mathematical theory of communication ACM SIGMOBILE Mobile Computing and Communications Review 5 1 2001 3 55
46. M. Müller, et al., Documentation Mocap Database HDM05, 2007.
47. W. Li, Z. Zhang, and Z. Liu Action recognition based on a bag of 3D points IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 2010 IEEE
48. A.W. Vieira et al. Stop: space-time occupancy patterns for 3D action recognition from depth map sequences Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications 2012 Springer 252 259
49. J. Wang et al. Robust 3d action recognition with random occupancy patterns Computer Vision-ECCV 2012 2012 Springer 872 885
50. O. Oreifej, and Z. Liu HON4D: histogram of oriented 4D normals for activity recognition from depth sequences IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013 2013 IEEE
51. C. Wang, Y. Wang, and A.L. Yuille An approach to pose-based action recognition IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013 2013 IEEE
52. C. Ellis et al. Exploring the trade-off between accuracy and observational latency in action recognition Int. J. Comput. Vis. 101 3 2013 420 436
53. M. Zanfir, M. Leordeanu, C. Sminchisescu, The moving pose: an efficient 3D kinematics descriptor for low-latency action recognition and detection, in: IEEE International Conference on Computer Vision (ICCV), 2013, 2013.