Skeleton Optical Spectra-Based Action Recognition Using Convolutional Neural Networks

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 28, Issue 3, 2018, Pages 807-811

  Hou, Yonghong ^a   Li, Zhaoyang ^a   Wang, Pichao ^b   Li, Wanqing ^b  

^a TIANJIN UNIVERSITY   (China)

^b UNIVERSITY OF WOLLONGONG   (Australia)

Author keywords

Action recognition; convolutional neural network (ConvNet); skeleton

Indexed keywords

CONVOLUTION; ENCODING (SYMBOLS); NEURAL NETWORKS;

ACTION RECOGNITION; COLOR TEXTURE IMAGES; CONVNET; CONVOLUTIONAL NEURAL NETWORK; DISCRIMINATIVE FEATURES; SKELETON; SPATIOTEMPORAL INFORMATION; SPECTRUM REPRESENTATION;

MUSCULOSKELETAL SYSTEM;

EID: 85042922293     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2016.2628339     Document Type: Article

References (26)

1. J. Shotton et al., "Real-time human pose recognition in parts from single depth images," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 1297-1304.
2. X. Yang and Y. Tian, "EigenJoints-based action recognition using Naïve-Bayes-Nearest-Neighbor," in Proc. Int. Workshop Human Activity Understand. 3D Data (HAU3D), Jun. 2012, pp. 14-19.
3. J. Wang, Z. Liu, Y. Wu, and J. Yuan, "Mining actionlet ensemble for action recognition with depth cameras," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 1290-1297.
4. L. Xia, C.-C. Chen, and J. K. Aggarwal, "View invariant human action recognition using histograms of 3D joints," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 20-27.
5. M. Zanfir, M. Leordeanu, and C. Sminchisescu, "The moving pose: An efficient 3D kinematics descriptor for low-latency action recognition and detection," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 2752-2759.
6. Z. Shao and Y. F. Li, "A new descriptor for multiple 3D motion trajectories recognition," in Proc. IEEE Int. Conf. Robot. Autom., May 2013, pp. 4749-4754.
7. M. A. Gowayyed, M. Torki, M. E. Hussein, and M. El-Saban, "Histogram of oriented displacements (HOD): Describing trajectories of human joints for action recognition," in Proc. Int. Joint Conf. Artif. Intell., Aug. 2013, pp. 1351-1357.
8. R. Chaudhry, F. Ofli, G. Kurillo, R. Bajcsy, and R. Vidal, "Bioinspired dynamic 3D discriminative skeletal features for human action recognition," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2013, pp. 471-478.
9. F. Ofli, R. Chaudhry, G. Kurillo, R. Vidal, and R. Bajcsy, "Sequence of the most informative joints (SMIJ): A new representation for human skeletal action recognition," J. Vis. Commun. Image Represent., vol. 25, no. 1, pp. 24-38, 2014.
10. R. Vemulapalli, F. Arrate, and R. Chellappa, "Human action recognition by representing 3D skeletons as points in a Lie group," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2014, pp. 588-595.
11. P. Wang, W. Li, P. Ogunbona, Z. Gao, and H. Zhang, "Mining mid-level features for action recognition based on effective skeleton representation," in Proc. Int. Conf. Digit. Image Comput., Techn., Appl., Nov. 2014, pp. 1-8.
12. R. Vemulapalli, F. Arrate, and R. Chellappa, "R3DG features: Relative 3D geometry-based skeletal representations for human action recognition," Comput. Vis. Image Understand., vol. 152, pp. 155-166, Nov. 2016.
13. R. Vemulapalli and R. Chellappa, "Rolling rotations for recognizing human actions from 3D skeletal data," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2016, pp. 4471-4479.
14. P. Wang, W. Li, Z. Gao, C. Tang, J. Zhang, and P. O. Ogunbona, "Convnets-based action recognition from depth maps through virtual cameras and pseudocoloring," in Proc. ACM Int. Conf. Multimedia, Oct. 2015, pp. 1119-1122.
15. P. Wang, W. Li, Z. Gao, J. Zhang, C. Tang, and P. O. Ogunbona, "Action recognition from depth maps using deep convolutional neural networks," IEEE Trans. Human-Mach. Syst., vol. 46, no. 4, pp. 498-509, Aug. 2016.
16. Y. Du, W. Wang, and L. Wang, "Hierarchical recurrent neural network for skeleton based action recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2015, pp. 1110-1118.
17. V. Veeriah, N. Zhuang, and G.-J. Qi, "Differential recurrent neural networks for action recognition," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2015, pp. 4041-4049.
18. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Proc. Annu. Conf. Neural Inf. Process. Syst., 2012, pp. 1106-1114.
19. S. Fothergill, H. Mentis, P. Kohli, and S. Nowozin, "Instructing people for training gestural interactive systems," in Proc. ACM Conf. Comput.-Human Interact., 2012, pp. 1737-1746.
20. V. Bloom, D. Makris, and V. Argyriou, "G3D: A gaming action dataset and real time action recognition evaluation framework," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 7-12.
21. C. Chen, R. Jafari, and N. Kehtarnavaz, "UTD-MHAD: A multimodal dataset for human action recognition utilizing a depth camera and a wearable inertial sensor," in Proc. IEEE Int. Conf. Image Process., Sep. 2015, pp. 168-172.
22. J. Zhang, W. Li, P. O. Ogunbona, P. Wang, and C. Tang, "RGB-D-based action recognition datasets: A survey," Pattern Recognit., vol. 60, pp. 86-105, Dec. 2016.
23. S. Yang, C. Yuan, W. Hu, and X. Ding, "A hierarchical model based on latent Dirichlet allocation for action recognition," in Proc. 22nd Int. Conf. Pattern Recognit., Aug. 2014, pp. 2613-2618.
24. L. Zhou, W. Li, Y. Zhang, P. Ogunbona, D. T. Nguyen, and H. Zhang, "Discriminative key pose extraction using extended LC-KSVD for action recognition," in Proc. Int. Conf. Digit. Image Comput., Techn. Appl., Nov. 2014, pp. 1-8.
25. M. E. Hussein, M. Torki, M. A. Gowayyed, and M. El-Saban, "Human action recognition using a temporal hierarchy of covariance descriptors on 3D joint locations," in Proc. Int. Joint Conf. Artif. Intell., Aug. 2013, pp. 2466-2472.
26. S. Nie, Z. Wang, and Q. Ji, "A generative restricted Boltzmann machine based method for high-dimensional motion data modeling," Comput. Vis. Image Understand., vol. 136, pp. 14-22, Jul. 2015.