Action recognition based on joint trajectory maps using Convolutional Neural Networks

MM 2016 - Proceedings of the 2016 ACM Multimedia Conference

Volumn , Issue , 2016, Pages 102-106

  Wang, Pichao ^a   Li, Zhaoyang ^b   Hou, Yonghong ^b   Li, Wanqing ^a  

^a UNIVERSITY OF WOLLONGONG   (Australia)

^b TIANJIN UNIVERSITY   (China)

Author keywords

Action recognition; Convolutional Neural Networks; Skeleton; Trajectory

Indexed keywords

COMPUTER VISION; CONVOLUTION; GESTURE RECOGNITION; IMAGE RECOGNITION; MOTION ESTIMATION; MUSCULOSKELETAL SYSTEM; NEURAL NETWORKS; TRAJECTORIES;

ACTION RECOGNITION; CONVOLUTIONAL NEURAL NETWORK; DISCRIMINATIVE FEATURES; HUMAN-ACTION RECOGNITION; JOINT TRAJECTORIES; SKELETON; SPATIOTEMPORAL INFORMATION; STATE OF THE ART;

OPTICAL CHARACTER RECOGNITION;

EID: 84994571080     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2964284.2967191     Document Type: Conference Paper

References (28)

1. V. Bloom, D. Makris, and V. Argyriou. G3D: A gaming action dataset and real time action recognition evaluation 105 framework. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pages 7-12, 2012.
2. C. Chen, R. Jafari, and N. Kehtarnavaz. Utd-mhad: A multimodal dataset for human action recognition utilizing a depth camera and a wearable inertial sensor. In Image Processing (ICIP), 2015 IEEE International Conference on, pages 168-172, 2015.
3. Y. Du, W. Wang, and L. Wang. Hierarchical recurrent neural network for skeleton based action recognition. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1110-1118, 2015.
4. S. Fothergill, H. M. Mentis, S. Nowozin, and P. Kohli. Instructing people for training gestural interactive systems. In ACM Conference on Computer-Human Interaction (ACM HCI), 2012.
5. M. A. Gowayyed, M. Torki, M. E. Hussein, and M. El-Saban. Histogram of oriented displacements (HOD): Describing trajectories of human joints for action recognition. In Proc. International Joint Conference on Artificial Intelligence (IJCAI), pages 1351-1357, 2013.
6. M. E. Hussein, M. Torki, M. A. Gowayyed, and M. El-Saban. Human action recognition using a temporal hierarchy of covariance descriptors on 3D joint locations. In Proc. International Joint Conference on Artificial Intelligence (IJCAI), pages 2466-2472, 2013.
7. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. B. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. In Proc. ACM international conference on Multimedia (ACM MM), pages 675-678, 2014.
8. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Proc. Annual Conference on Neural Information Processing Systems (NIPS), pages 1106-1114, 2012.
9. W. Li, Z. Zhang, and Z. Liu. Action recognition based on a bag of 3D points. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pages 9-14, 2010.
10. C. Lu, J. Jia, and C.-K. Tang. Range-sample depth feature for action recognition. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 772-779, 2014.
11. S. Nie, Z. Wang, and Q. Ji. A generative restricted boltzmann machine based method for high-dimensional motion data modeling. Computer Vision and Image Understanding, pages 14-22, 2015.
12. O. Oreifej and Z. Liu. HON4D: Histogram of oriented 4D normals for activity recognition from depth sequences. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 716-723, 2013.
13. A. Shahroudy, J. Liu, T.-T. Ng, and G. Wang. NTU RGB+ D: A large scale dataset for 3D human activity analysis. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
14. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake. Real-time human pose recognition in parts from single depth images. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1297-1304, 2011.
15. V. Veeriah, N. Zhuang, and G.-J. Qi. Differential recurrent neural networks for action recognition. In Proc. IEEE International Conference on Computer Vision (ICCV), pages 4041-4049, 2015.
16. R. Vemulapalli, F. Arrate, and R. Chellappa. Human action recognition by representing 3D skeletons as points in a lie group. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 588-595, 2014.
17. J. Wang, Z. Liu, Y. Wu, and J. Yuan. Mining actionlet ensemble for action recognition with depth cameras. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1290-1297, 2012.
18. P. Wang, W. Li, Z. Gao, C. Tang, J. Zhang, and P. O. Ogunbona. Convnets-based action recognition from depth maps through virtual cameras and pseudocoloring. In Proc. ACM international conference on Multimedia (ACM MM), pages 1119-1122, 2015.
19. P. Wang, W. Li, Z. Gao, J. Zhang, C. Tang, and P. Ogunbona. Action recognition from depth maps using deep convolutional neural networks. Human-Machine Systems, IEEE Transactions on, PP(99):1-12, 2015.
20. P. Wang, W. Li, P. Ogunbona, Z. Gao, and H. Zhang. Mining mid-level features for action recognition based on effective skeleton representation. In Proc. International Conference on Digital Image Computing: Techniques and Applications (DICTA), pages 1-8, 2014.
21. S. Yang, C. Yuan, W. Hu, and X. Ding. A hierarchical model based on latent dirichlet allocation for action recognition. In Pattern Recognition (ICPR), 2014 22nd International Conference on, pages 2613-2618. IEEE, 2014.
22. X. Yang and Y. Tian. Eigenjoints-based action recognition using Naive-Bayes-Nearest-Neighbor. In Proc. International Workshop on Human Activity Understanding from 3D Data (HAU3D) (CVPRW), pages 14-19, 2012.
23. X. Yang and Y. Tian. Super normal vector for activity recognition using depth sequences. In Proc. IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pages 804-811, 2014.
24. M. Zanfir, M. Leordeanu, and C. Sminchisescu. The moving pose: An efficient 3D kinematics descriptor for low-latency action recognition and detection. In Proc. IEEE International Conference on Computer Vision (ICCV), pages 2752-2759, 2013.
25. M. D. Zeiler and R. Fergus. Visualizing and understanding convolutional networks. In Proc. European Conference on Computer Vision (ECCV), pages 818-833. 2014.
26. J. Zhang, W. Li, P. O. Ogunbona, P. Wang, and C. Tang. RGB-D-based action recognition datasets: A survey. Pattern Recognition, 60:86-105, 2016.
27. L. Zhou, W. Li, Y. Zhang, P. Ogunbona, D. T. Nguyen, and H. Zhang. Discriminative key pose extraction using extended lc-ksvd for action recognition. In Proc. International Conference on Digital Image Computing: Techniques and Applications (DICTA), pages 1-8. IEEE, 2014.
28. W. Zhu, C. Lan, J. Xing, W. Zeng, Y. Li, L. Shen, and X. Xie. Co-occurrence feature learning for skeleton based action recognition using regularized deep LSTM networks. In The 30th AAAI Conference on Artificial Intelligence (AAAI), 2016.