Evaluating spatiotemporal interest point features for depth-based action recognition

Image and Vision Computing

Volumn 32, Issue 8, 2014, Pages 453-464

  Zhu, Yu ^a   Chen, Wenbin ^a   Guo, Guodong ^a  

^a West Virginia University   (United States)

Author keywords

Action recognition; Descriptors; Detectors; Evaluation; Feature fusion; RGB D sensor; Spatiotemporal interest point (STIP); STIP feature refinement; STIP features

Indexed keywords

DETECTORS; GESTURE RECOGNITION; MUSCULOSKELETAL SYSTEM; USER INTERFACES; VIRTUAL REALITY;

ACTION RECOGNITION; DESCRIPTORS; EVALUATION; FEATURE FUSION; FEATURE REFINEMENT; RGB-D SENSORS; SPATIO-TEMPORAL INTEREST POINTS; STIP FEATURES;

MOTION ESTIMATION;

EID: 84901267217     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2014.04.005     Document Type: Article

References (38)

1. D.M. Gavrila The visual analysis of human movement: a survey Comput. Vis. Image Underst. 73 1999 82 98
2. R. Poppe A survey on vision-based human action recognition Image Vis. Comput. 28 2010 976 990
3. H. Wang, M.M. Ullah, A. Klaser, I. Laptev, and C. Schmid et al. Evaluation of local spatio-temporal features for action recognition BMVC British Machine Vision Conf 2009
4. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake Real-time human pose recognition in parts from single depth images IEEE Conf. on Computer Vision and, Pattern Recognition 2011 1297 1304
5. I. Laptev On space-time interest points Int. J. Comput. Vis. 64 2005 107 123 (Pubitemid 41314645)
6. P. Dollár, V. Rabaud, G. Cottrell, and S. Belongie Behavior recognition via sparse spatio-temporal features 2nd Joint IEEE Int'l Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance 2005 65 72 (Pubitemid 46178025)
7. H. Jhuang, T. Serre, L. Wolf, and T. Poggio A biologically inspired system for action recognition IEEE 11th Int'l Conf. on Computer Vision 2007 1 8
8. A. Oikonomopoulos, I. Patras, and M. Pantic Spatiotemporal salient points for visual recognition of human actions IEEE Trans. Syst. Man Cybern. B 36 2005 710 719
9. G. Willems, T. Tuytelaars, and L. Van Gool An Efficient Dense and Scale-Invariant Spatio-Temporal Interest Point Detector 2008 Springer 650 663
10. S.F. Wong, and R. Cipolla Extracting spatiotemporal interest points using global information IEEE 11th Int'l Conf. on Computer Vision 2007 1 8
11. I. Laptev, and T. Lindeberg Local descriptors for spatio-temporal recognition Spatial Coherence for Visual Motion Analysis 2006 91 103 (Pubitemid 44011429)
12. P. Scovanner, S. Ali, and M. Shah A 3-dimensional sift descriptor and its application to action recognition Proc. of the 15th Int'l Conf. on Multimedia 2007 357 360
13. W.Q. Li, Z.Y. Zhang, and Z.C. Liu Action recognition based on a bag of 3d points IEEE Conf. on Computer Vision and Pattern Recognition Workshops 2010 9 14
14. L. Xia, C. Chen, and J. Aggarwal View invariant human action recognition using histograms of 3d joints IEEE Conf. on Computer Vision and Pattern Recognition Workshops 2012 20 27
15. A. Vieira, E. Nascimento, G. Oliveira, Z.C. Liu, and M. Campos Stop: space-time occupancy patterns for 3d action recognition from depth map sequences Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications 2012 252 259
16. X.D. Yang, and Y.L. Tian Effective 3d action recognition using eigenjoints J. Vis. Commun. Image Represent. 25 2014 2 11
17. L. M., T. V., D. M., T. L., A. W. V., and M. F. M. C. Real-time gesture recognition from depth data through key poses learning and decision forests 25th SIBGRAPI Conf. on Graphics, Patterns and Images 0 2012 268 275
18. X.D. Yang, C.Y. Zhang, and Y.L. Tian Recognizing actions using depth motion maps-based histograms of oriented gradients Proc. of the 20th ACM Int'l Conf. on Multimedia 2012 1057 1060 (MM '12)
19. J. Wang, Z.C. Liu, Y. Wu, and J.S. Yuan Mining actionlet ensemble for action recognition with depth cameras IEEE Conf. on Computer Vision and, Pattern Recognition 2012 1290 1297
20. J. Sung, C. Ponce, B. Selman, and A. Saxena Unstructured human activity detection from rgbd images IEEE Int'l Conf. on Robotics and Automation 2012 842 849
21. J. Wang, Z.C. Liu, J. Chorowski, Z.Y. Chen, and Y. Wu Robust 3d action recognition with random occupancy patterns Computer Vision - ECCV 2012 Springer 872 885
22. O. Oreifej, Z.C. Liu, and W. Redmond Hon4d: Histogram of oriented 4d normals for activity recognition from depth sequences IEEE Conf. on Computer Vision and Pattern Recognition 2013
23. H. Koppula, R. Gupta, and A. Saxena Learning human activities and object affordances from rgb-d videos Int. J. Robot. Res. 32 2013 951 970
24. B.B. Ni, G. Wang, and P. Moulin Rgbd-hudaact: a color-depth video database for human daily activity recognition IEEE Int'l Conf. on Computer Vision Workshops 2011 1147 1153
25. Y. Zhao, Z.C. Liu, L. Yang, and H. Cheng Combing rgb and depth map features for human activity recognition Asia-Pacific Signal Information Processing Association Annual Summit and Conf. 2012 1 4
26. H. Zhang, and L.E. Parker 4-dimensional local spatio-temporal features for human activity recognition IEEE/RSJ Int'l Conf. on Intelligent Robots and Systems 2011 2044 2049
27. L. Xia, and J. Aggarwal Spatio-temporal depth cuboid similarity feature for activity recognition using depth camera IEEE Conf. on Computer Vision and, Pattern Recognition 2013 2834 2841
28. I. Laptev, and T. Lindeberg Velocity adaptation of space-time interest points Proc. of the IEEE Int'l Conf. on Pattern Recognition volume 1 2004 52 56
29. A. Klaser, M. Marszałek, and C. Schmid et al. A spatio-temporal descriptor based on 3d-gradients British Machine Vision Conf 2008
30. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld Learning realistic human actions from movies IEEE Conf. on Computer Vision and, Pattern Recognition 2008 1 8
31. A.H. Shabani, D.A. Clausi, and J.S. Zelek Evaluation of local spatio-temporal salient feature detectors for human action recognition IEEE Ninth Conf. on Computer and Robot Vision 2012 468 475
32. H. Bay, T. Tuytelaars, and L. Van Gool Surf: Speeded Up Robust Features 2006 Springer 404 417
33. Y. Zhu, W. Chen, and G. Guo Fusing spatiotemporal features and joints for 3d action recognition IEEE Conf. on Computer Vision and Pattern Recognition Workshops 2013 486 491
34. M. Devanne, H. Wannous, S. Berretti, P. Pala, M. Daoudi, and D. B. A. et al. Space-time pose representation for 3d human action recognition ICIAP Workshop on Social Behaviour, Analysis 2013 456 464
35. L. Breiman Random forests Mach. Learn. 45 2001 5 32 (Pubitemid 32933532)
36. E. Ohn-Bar, and M.M. Trivedi Joint angles similarities and hog2 for action recognition IEEE Conf. on Computer Vision and Pattern Recognition Workshops 2013 465 470
37. L. Seidenari, V. Varano, S. Berretti, P. Pala, and A. Del Bimbo Recognizing actions from depth cameras as weakly aligned multi-part bag-of-poses Proc. of CVPR Int. Workshop on Human Activity Understanding from 3D Data 2013 479 485
38. L. Liu, and L. Shao Learning discriminative representations from rgb-d video data Proc. Int. Joint Conf. on Artificial Intelligence 2013 1493 1500