Co-Occurrence feature learning for skeleton based action recognition using regularized deep LSTM networks

30th AAAI Conference on Artificial Intelligence, AAAI 2016

Volumn , Issue , 2016, Pages 3697-3703

  Zhu, Wentao ^a   Lan, Cuiling ^b   Xing, Junliang ^c   Zeng, Wenjun ^b   Li, Yanghao ^d   Shen, Li ^e   Xie, Xiaohui ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b MICROSOFT RESEARCH ASIA   (China)

^c INSTITUTE OF AUTOMATION   (China)

^d PEKING UNIVERSITY   (China)

^e UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; GESTURE RECOGNITION; IMAGE RECOGNITION; MUSCULOSKELETAL SYSTEM; RECURRENT NEURAL NETWORKS;

ACTION RECOGNITION; CO-OCCURRENCE FEATURES; FEATURE REPRESENTATION; HUMAN-ACTION RECOGNITION; LONG SHORT TERM MEMORY; OUTPUT RESPONSE; RECURRENT NEURAL NETWORK (RNNS); REGULARIZATION SCHEMES;

MOTION ESTIMATION;

EID: 85007199276     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. Cho, K., and Chen, X. 2014. Classifying and visualizing motion capture sequences using deep neural networks. In International Conference on Computer Vision Theory and Applications, 122-130.
2. CMU. 2003. CMU graphics lab motion capture database. http://mocap.cs.cmu.edu/.
3. Cotter, S. F.; Rao, B. D.; Engan, K.; and Kreutz-Delgado, K. 2005. Sparse solutions to linear inverse problems with multiple measurement vectors. IEEE Transactions on Signal Processing 53(7):2477-2488.
4. Du, Y.; Wang, W.; and Wang, L. 2015. Hierarchical recurrent neural network for skeleton based action recognition. In IEEE Conference on Computer Vision and Pattern Recognition, 1110-1118.
5. Graves, A., and Schmidhuber, J. 2005. Framewise phoneme classification with bidirectional lstm and other neural network architectures. Neural Networks 18(5):602-610.
6. Graves, A.; Mohamed, A.; and Hinton, G. 2013. Speech recognition with deep recurrent neural networks. In IEEE International Conference on Acoustics, Speech, and Signal Processing, 6645- 6649.
7. Graves, A. 2012. Supervised sequence labelling with recurrent neural networks, volume 385. Springer.
8. Ji, Y.; Ye, G.; and Cheng, H. 2014. Interactive body part contrast mining for human interaction recognition. In IEEE International Conference on Multimedia and Expo Workshops, 1-6.
9. Johansson, G. 1973. Visual perception of biological motion and a model for it is analysis. Perception and Psychophysics 14(2):201- 211.
10. Krizhevsky, A.; Sutskever, I.; and Hinton, G. E. 2012. ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, 1097-1105.
11. Lefebvre, G.; Berlemont, S.; Mamalet, F.; and Garcia, C. 2013. BLSTM-RNN based 3D gesture classification. In Proceedings of the International Conference on Artificial Neural Networks and Machine Learning, 381-388.
12. Müller, M.; Röder, T.; Clausen, M.; Eberhardt, B.; Krüger, B.; and Weber, A. 2007. Documentation mocap database HDM05. Technical Report CG-2007-2, Universiẗat Bonn.
13. Müller, M.; Röder, T.; and Clausen, M. 2005. Efficient contentbased retrieval of motion capture data. ACM Transactions on Graphic 24(3):677-683.
14. Ofli, F.; Chaudhry, R.; Kurillo, G.; Vidal, R.; and Bajcsy, R. 2013. Berkeley MHAD: A comprehensive multimodal human action database. In Proceedings of the IEEE Workshop on Applications on Computer Vision, 53-60.
15. Pham, V.; Bluche, T.; Kermorvant, C.; and Louradour, J. 2014. Dropout improves recurrent neural networks for handwriting recognition. In International Conference on Frontiers in Handwriting Recognition, 285-290.
16. Poppe, R. 2010. A survey on vision-based human action recognition. Image and Vision Computing 28(6):976-990.
17. Savitzky, A., and Golay, M. J. 1964. Smoothing and differentiation of data by simplified least squares procedures. Analytical chemistry 36(8):1627-1639.
18. Sminchisescu, C.; Kanaujia, A.; Li, Z.; and Metaxas, D. 2005. Conditional models for contextual human motion recognition. In IEEE Conference on Computer Vision, volume 2, 1808-1815.
19. Srivastava, N.; Hinton, G.; Krizhevsky, A.; Sutskever, I.; and Salakhutdinov, R. 2014. Dropout: A simple way to prevent neural networks from overfitting. Journal of Machine Learning Research 15:1929-1958.
20. Sung, J.; Ponce, C.; Selman, B.; and Saxena, A. 2011. Human activity detection from RGBD images. In AAAI workshop on Pattern, Activity and Intent Recognition, 47-55.
21. Sung, J.; Ponce, C.; Selman, B.; and Saxena, A. 2012. Unstructured human activity detection from RGBD images. In IEEE International Conference on Robotics and Automation, 842-849.
22. Szegedy, C.; Liu, W.; Jia, Y.; Sermanet, P.; Reed, S.; Anguelov, D.; Erhan, D.; Vanhoucke, V.; and Rabinovich, A. 2015. Going deeper with convolutions. In IEEE Conference on Computer Vision and Pattern Recognition, 1-9.
23. Wang, J.; Liu, Z.; and Junsong, Y. 2012. Mining actionlet ensemble for action recognition with depth cameras. In IEEE Conference on Computer Vision and Pattern Recognition, 1290-1297.
24. Weinland, D.; Ronfard, R.; and Boyerc, E. 2011. A survey of vision-based methods for action representation, segmentation and recognition. Computer Vision and Image Understanding 115(2):224-241.
25. Xia, L.; Chen, C.-C.; and Aggarwal, J. K. 2012. View invariant human action recognition using histograms of 3D joints. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Workshops, 20-27.
26. Yang, X., and Tian, Y. 2014. Effective 3D action recognition using EigenJoints. Journal of Visual Communication and Image Representation 25(1):2-11.
27. Yun, K.; Honorio, J.; Chattopadhyay, D.; Berg, T. L.; and Samaras, D. 2012. Two-person interaction detection using body pose features and multiple instance learning. In IEEE Conference on Computer Vision and Pattern Recognition Workshops, 28-35.
28. Zaremba, W.; Sutskever, I.; and Vinyals, O. 2014. Recurrent neural network regularization. arXiv preprint arXiv:1409.2329.