A unified spatio-temporal human body region tracking approach to action recognition

Neurocomputing

Volumn 161, Issue , 2015, Pages 56-64

  Al Harbi, Nouf ^a   Gotoh, Yoshihiko ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Action recognition; Human body volume; Object tracking; Regions of interest; Spatio temporal segmentation

Indexed keywords

COMPUTER APPLICATIONS; NEURAL NETWORKS;

ACTION CLASSIFICATIONS; ACTION RECOGNITION; HUMAN ACTION CLASSIFICATIONS; HUMAN BODIES; REGIONS OF INTEREST; SPATIO-TEMPORAL DESCRIPTORS; SPATIO-TEMPORAL SEGMENTATION; STATE-OF-THE-ART PERFORMANCE;

OBJECT TRACKING;

ANALYTIC METHOD; ARTICLE; BIOLOGICAL MODEL; BODY MOVEMENT; BODY REGIONS; CLASSIFICATION; MOTOR PERFORMANCE; MOVEMENT (PHYSIOLOGY); MOVEMENT PERCEPTION; OBJECT RELATION; PATTERN RECOGNITION; PRIORITY JOURNAL; RECOGNITION; SEMANTICS; TASK PERFORMANCE; VIDEORECORDING; VISUAL DISCRIMINATION;

EID: 84929046751     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2014.11.072     Document Type: Article

References (39)

1. M. Marszalek, I. Laptev, C. Schmid, Actions in context, in: Proceedings of CVPR, 2009.
2. M. Sridhar, A.G. Cohn, D.C. Hogg, Unsupervised learning of event classes from video, in: Proceedings of AAAI, 2010, pp. 1631-1638.
3. W. Brendel, A. Fern, S. Todorovic, Probabilistic event logic for interval-based event recognition, in: Proceedings of CVPR, 2011, pp. 3329-3336.
4. B. Packer, K. Saenko, D. Koller, A combined pose, object, and feature model for action understanding, in: Proceedings of CVPR, 2012, pp. 1378-1385.
5. N. Al Harbi, Y. Gotoh, Spatio-temporal human body segmentation from video stream, in: Computer Analysis of Images and Patterns, 2013, pp. 78-85.
6. N. Al Harbi, Y. Gotoh, Action recognition: spatio-temporal human body region tracking approach, in: Proceedings of the Second Workshop on Recognition and Action for Scene Understanding, CAIP, 2013.
7. M. Maire, S.X. Yu, P. Perona, Object detection and segmentation from joint embedding of parts and pixels, in: Proceedings of ICCV, 2011.
8. M. Al Ghamdi, N. Al Harbi, Y. Gotoh, Spatio-temporal video representation with locality-constrained linear coding, in: Computer Vision-ECCV 2012. Workshops and Demonstrations, 2012, pp. 101-110.
9. N. Ikizler-Cinbis, S. Sclaroff, Object, scene and actions: combining multiple features for human action recognition, in: Computer Vision-ECCV 2010, 2010, pp. 494-507.
10. P. Felzenszwalb, D. McAllester, D. Ramanan, A discriminatively trained, multiscale, deformable part model, in: IEEE Conference on Computer Vision and Pattern Recognition, 2008. CVPR 2008, 2008, pp. 1-8.
11. A. Gilbert, J. Illingworth, R. Bowden, Fast realistic multi-action recognition using mined dense spatio-temporal features, in: Proceedings of ICCV, 2009, pp. 925-931.
12. J. Liu, J. Luo, M. Shah, Recognizing realistic actions from videos in the wild, in: Proceedings of CVPR, 2009, pp. 1996-2003.
13. R. Messing, C. Pal, H. Kautz, Activity recognition using the velocity histories of tracked keypoints, in: Proceedings of ICCV, 2009, pp. 104-111.
14. J. Sun, X. Wu, S. Yan, L.F. Cheong, T.S. Chua, J. Li, Hierarchical spatio-temporal context modeling for action recognition, in: Proceedings of CVPR, 2009, pp. 2004-2011.
15. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, Learning realistic human actions from movies, in: Proceedings of CVPR, 2008, pp. 1-8.
16. Bobick A.F., Davis J.W. The recognition of human movement using temporal templates. IEEE Trans. Pattern Anal. Mach. Intell. 2001, 23(3):257-267.
17. Yacoob Y., Black M.J. Parameterized modeling and recognition of activities. Comput. Vis. Image Underst. 1999, 73(2):232-247.
18. Ali S., Shah M. Human action recognition in videos using kinematic features and multiple instance learning. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 32(2):288-303.
19. A.A. Efros, A.C. Berg, G. Mori, J. Malik, Recognizing action at a distance, in: Proceedings of ICCV, 2003.
20. Zelnik-Manor L., Irani M. Statistical analysis of dynamic actions. IEEE Trans. Pattern Anal. Mach. Intell. 2006, 28(9):1530-1535.
21. E. Shechtman, M. Irani, Matching local self-similarities across images and videos, in: IEEE Conference on Computer Vision and Pattern Recognition, 2007. CVPR[U+05F3]07, 2007, pp. 1-8.
22. P. Dollár, V. Rabaud, G. Cottrell, S. Belongie, Behavior recognition via sparse spatio-temporal features, in: Proceedings of the IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, 2005, pp. 65-72.
23. J. Choi, W.J. Jeon, S.C. Lee, Spatio-temporal pyramid matching for sports videos, in: Proceedings of the ACM International Conference on Multimedia Information Retrieval, 2008, pp. 291-297.
24. C. Schuldt, I. Laptev, B. Caputo, Recognizing human actions: a local SVM approach, in: Proceedings of ICPR, vol. 3, 2004, pp. 32-36.
25. M. Bregonzio, S. Gong, T. Xiang, Recognising action as clouds of space-time interest points, in: Proceedings of CVPR, 2009, pp. 1948-1955.
26. D. Parikh, C.L. Zitnick, T. Chen, Unsupervised learning of hierarchical spatial structures in images, in: Proceedings of CVPR, 2009, pp. 2743-2750.
27. T. Quack, V. Ferrari, B. Leibe, L. Van Gool, Efficient mining of frequent and distinctive feature configurations, in: Proceedings of ICCV, 2007, pp. 1-8.
28. H. Bilen, V.P. Namboodiri, L. Van Gool, Action recognition: a region based approach, in: Proceedings of IEEE Workshop on Applications of Computer Vision, 2011, pp. 294-300.
29. Felzenszwalb P.F., Girshick R.B., McAllester D., Ramanan D. Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 32(9):1627-1645.
30. Lowe D.G. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 2004, 91-110.
31. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, Y. Gong, Locality-constrained linear coding for image classification, in: Proceedings of CVPR, 2010, pp. 3360-3367.
32. Fan R.E., Chang K.W., Hsieh C.J., Wang X.R., Lin C.J. LIBLINEAR. a library for large linear classification. J. Mach. Learn. Res. 2008, 9:1871-1874.
33. M.D. Rodriguez, J. Ahmed, M. Shah, Action mach: a spatio-temporal maximum average correlation height filter for action recognition, in: Proceedings of CVPR, 2008.
34. H. Wang, M.M. Ullah, A. Klaser, I. Laptev, C. Schmid, Evaluation of local spatio-temporal features for action recognition, in: Proceedings of BMVC, 2009.
35. Q.V. Le, W.Y. Zou, S.Y. Yeung, A.Y. Ng, Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis, in: Proceedings of CVPR, 2011, pp. 3361-3368.
36. S. Sadanand, J.J. Corso, Action bank: a high-level representation of activity in video, in: Proceedings of CVPR, 2012, pp. 1234-1241.
37. A. Kovashka, K. Grauman, Learning a hierarchy of discriminative space-time neighborhood features for human action recognition, in: Proceedings of CVPR, 2010, pp. 2046-2053.
38. X. Wu, D. Xu, L. Duan, J. Luo, Action recognition using context and appearance distribution features, in: Proceedings of CVPR, 2011, pp. 489-496.
39. H. Zhang, W. Zhou, C. Reardon, L.E. Parker, Simplex-based 3d spatio-temporal feature description for action recognition, in: Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, 2014, pp. 2067-2074.