Spatio-temporal feature extraction and representation for RGB-D human action recognition

Pattern Recognition Letters

Volumn 50, Issue , 2014, Pages 139-148

  Luo, Jiajia ^a   Wang, Wei ^a   Qi, Hairong ^a  

^a University of Tennessee Knoxville   (United States)

Author keywords

Depth maps Sparse coding; Human action recognition; Spatio temporal feature extraction; Spatio temporal feature representation

Indexed keywords

HUMAN-ACTION RECOGNITION; SPARSE CODING; SPATIO-TEMPORAL FEATURE EXTRACTION AND REPRESENTATIONS; SPATIO-TEMPORAL FEATURES;

EID: 84908158515     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2014.03.024     Document Type: Article

References (38)

1. H. Bay, T. Tuytelaars, and L.V. Gool Surf: Speeded up robust features J. Comput. Vision Image Understanding 110 2006 346 359
2. C.C. Chang, and C.J. Lin LIBSVM: a library for support vector machines ACM Trans. Intel. Syst. Technol. 2 3 2011 27:1 27:27
3. N. Dalal, B. Triggs, 2005. Histograms of oriented gradients for human detection. in: Proc. of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 886-893.
4. P. Dollar, V. Rabaud, G. Cottrell, S. Belongie, 2005. Behavior recognition via sparse spatio-temporal features. 2nd Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, 65-72.
5. J. Gu, X. Ding, S. Wang, and Y. Wu Action and gait recognition from recovered 3d human joints IEEE Trans. Syst. Man Cybern. Part B: Cybern. 40 2010 1021 1033
6. L. Han, X. Wu, W. Liang, G. Hou, and Y. Jia Discriminative human action recognition in the learned hierarchical manifold space J. Image Vision Comput. 28 5 2010 836 849
7. M. Heikkila, M. Pietikainen, and C. Schmid Description of interest regions with center-symmetric local binary pattern J. Pattern Recognit. 42 2009 425 436
8. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, 2008. Learning realistic human actions from movies. in: Proc. of the 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1-8.
9. V. Kellokumpu, G. Zhao, M. Pietikainen, 2008. Human activity recognition using a dynamic texture based method. in: Proc. of the British Machine Vision Conference, 1-10.
10. J. Kittler, M. Hatef, R. Duin, and J. Matas On combining classifiers IEEE Trans. Pattern Anal. Mach. Intel. 20 3 1998 226 239
11. A. Klaser, M. Marszalek, C. Schmid, 2008. A spatio-temporal descriptor based on 3d gradients. in: Proc. of the British Machine Vision Conference, 995-1004.
12. T. Kobayashi, N. Otsu, 2004. Action and simultaneous multiple-person identification using cubic higher-order local auto-correlation. in: Proc. of the 17th International Conference on Pattern Recognition, 741-744.
13. T. Kobayashi, and N. Otsu Motion recognition using local auto-correlation of space-time gradients J. Pattern Recognit. Lett. 33 2012 1188 1195
14. D. Kosmopoulos, P. Doliotis, V. Athitsos, I. Maglogiannis, 2013. Fusion of color and depth video for human behavior recognition in an assistive environment. in: Proc. of the 15th International Conference on Human-Computer Interaction, 42-51.
15. I. Laptev, and T. Lindeberg On space-time interest points J. Comput. Vision 64 2005 107 123
16. H. Lee, A. Battle, R. Raina, A.Y. Ng., 2006. Efficient sparse coding algorithms. in: Proc. of the 2006 Conference on Advances in Neural Information Processing Systems, 801-808.
17. W. Li, Z. Zhang, Z. Liu, 2010. Action recognition based on a bag of 3d points. in: Proc. of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 9-14.
18. D. Lowe Distinctive image features from scale-invariant keypoints IEEE J. Comput.Vision 60 2004 91 110
19. F. Lv, R. Nevatia, 2006. Recognition and segmentation of 3d human action using hmm and multi-class adaboost. in: Proc. of the 9th European Conference on Computer Vision, 359-372.
20. J. Martens, I. Sutskever, 2011. Learning recurrent neural networks with hessian-free optimization. in: Proc. of the 28th International Conference on Machine Learning, 1033-1040.
21. Y. Ming, Q. Ruan, A.G. Hauptmann, 2012. Activity recognition from rgb-d camera with 3d local spatio-temporal features. in: Proc. of the 2012 IEEE International Conference on Multimedia and Expo, 344-349.
22. M. Muller, T. Roder, 2006. Motion templates for automatic classification and retrieval of motion capture data. in: Proc. of the 2006 ACM SIGGRAPH/ Eurographics symposium on Computer animation, 137-146.
23. B. Ni, G. Wang, P. Moulin, 2011. Rgbd-hudaact: A color-depth video database for human daily activity recognition. in: Proc. of the 2011 IEEE International Conference on Computer Vision Workshops, 1147-1153.
24. T. Ojala, M. Pietikainen, and T. Maenpaa Multiresolution gray-scale and rotation invariant texture classification with local binary patterns IEEE Trans. Pattern Anal. Mach. Intel. 24 7 2002 971 987
25. S. Sadanand, J. Corso, 2012. Action bank: A high-level representation of activity in video. in: Proc. of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1234-1241.
26. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, A. Blake, 2011. Real-time human pose recognition in parts from single depth images. in: Proc. of the 2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1297-1304.
27. J. Sung, C. Ponce, B. Selman, A. Saxena, 2012. Unstructured human activity detection from rgbd images. in: Proc. of 2012 IEEE International Conference on Robotics and Automation, 842-849.
28. A.W. Vieira, E.R. Nascimento, G. Oliveira, Z. Liu, M. Campos, 2012. Stop: space-time occupancy patterns for 3d action recognition from depth map sequences. in: Proc. of the 17th Iberoamerican Congress on Pattern Recognition, 252-259.
29. J. Wang, Z. Liu, J. Chorowski, Z. Chen, Y. Wu, 2012a. Robust 3d action recognition with random occupancy patterns. in: Proc. of the 12th European Conference on Computer Vision, 872-885.
30. J. Wang, Z. Liu, Y. Wu, J. Yuan, 2012b. Mining actionlet ensemble for action recognition with depth cameras. in: Proc. of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1290-1297.
31. G. Willems, T. Tuytelaars, L.V. Gool, 2008. An efficient dense and scaleinvariant spatio-temporal interest pint detector. in: Proc. of the 10th European Conference on Computer Vision, 650-663.
32. L. Xia, C.C. Chen, J.K. Aggarwal, 2012. View invariant human action recognition using histograms of 3d joints. in: Proc. of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 20-27.
33. J. Yang, K. Yu, Y. Gong, T. Huang, 2009. Linear spatial pyramid matching using sparse coding for image classification. in: Proc. of the 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1794-1801.
34. X. Yang, Y. Tian, 2012. Eigenjoints-based action recognition using naive-bayes-nearest-neighbor. in: Proc. of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 14-19.
35. L. Yeffet, L., Wolf, 2009. Local trinary patterns for human action recognition. in: Proc. of the 12th International Conference on Computer Vision, 492-497.
36. C. Yuan, X. Li, W. Hu, H. Wang, 2010. Human action recognition using pyramid vocabulary tree. in: Proc. of the 9th Asian Conference on Computer Vision, 527-537.
37. G. Zhao, and M. Pietikainen Dynamic texture recognition using local binary patterns with an application to facial expressions IEEE Trans. Pattern Anal. Mach. Intel. 29 6 2007 915 928
38. G. Zhao, and M. Pietikainen Dynamic texture recognition using local binary patterns with an application to facial expressions IEEE Trans. Pattern Anal. Mach. Intel. 29 2007 915 928