Action Recognition Using Rate-Invariant Analysis of Skeletal Shape Trajectories

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 38, Issue 1, 2016, Pages 1-13

  Amor, Boulbaba Ben ^a   Su, Jingyong ^c   Srivastava, Anuj ^b  

^a ECOLE DES MINES DE DOUAI   (France)

^b FLORIDA STATE UNIVERSITY   (United States)

^c TEXAS TECH UNIVERSITY   (United States)

Author keywords

Action Recognition; Depth sensors; Manifold Trajectories; Riemannian geometry; Skeletal data

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL EFFICIENCY; GEOMETRY; MEDIAN FILTERS; MUSCULOSKELETAL SYSTEM; STATISTICAL METHODS; TIME DOMAIN ANALYSIS;

ACTION RECOGNITION; CLASSIFICATION RESULTS; COMPUTATIONAL TOOLS; DEPTH SENSORS; MEDIAN FILTERING; RIEMANNIAN GEOMETRY; SKELETAL DATA; TEMPORAL REGISTRATION;

TRAJECTORIES;

ALGORITHM; ANATOMY AND HISTOLOGY; AUTOMATED PATTERN RECOGNITION; HUMAN; MOVEMENT (PHYSIOLOGY); PROCEDURES; SKELETON; STATISTICAL MODEL; SUPPORT VECTOR MACHINE; THREE DIMENSIONAL IMAGING; VIDEORECORDING;

ALGORITHMS; HUMANS; IMAGING, THREE-DIMENSIONAL; MODELS, STATISTICAL; MOVEMENT; PATTERN RECOGNITION, AUTOMATED; SKELETON; SUPPORT VECTOR MACHINE; VIDEO RECORDING;

EID: 84961618626     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2015.2439257     Document Type: Article

References (36)

1. J. Su, S. Kurtek, E. Klassen, and A. Srivastava,, "Statistical analysis of trajectories on Riemannian manifolds: Bird migration, hurricane tracking, and video surveillance," Ann. Appl. Statist., vol. 8, no. 1, pp. 530-552, 2013.
2. J. Su, A. Srivastava, F. Souza, and S. Sarkar, "Rate-invariant analysis of trajectories on Riemannian manifolds with application in visual speech recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 620-627.
3. A. Kleinsmith and N. Bianchi-Berthouze, "Affective body expression perception and recognition: A survey," IEEE Trans. Affective Comput., vol. 4, no. 1, pp. 15-33, Jan.-Mar. 2013.
4. A. Mehrabian and M. Wiener, "Decoding of inconsistent communications," J. Personality Soc. Psychol., vol. 6, no. 1, pp. 109-114, 1967.
5. J. Aggarwal and M. Ryoo, "Human activity analysis: A review," ACM Comput. Surv., vol. 43, no. 3, pp. 16:1-16:43, 2011.
6. J. M. Chaquet, E. J. Carmona, and A. Fernandez-Caballero, "A survey of video datasets for human action and activity recognition," Comput. Vis. Image Understanding, vol. 117, no. 6, pp. 633-659, 2013.
7. S.-R. Ke, L. U. T. Hoang, Y.-J. Lee, J.-N. Hwang, J.-H. Yoo, and K.-H. Choi, "A review on video-based human activity recognition," Computers, vol. 2, no. 2, pp. 88-131, 2013.
8. A. Veeraraghavan, A. Srivastava, A. K. R. Chowdhury, and R. Chellappa, "Rate-invariant recognition of humans and their activities," IEEE Trans. Image Process., vol. 18, no. 6, pp. 1326-1339, Jun. 2009.
9. A. Srivastava, P. K. Turaga, and S. Kurtek, "On advances in differential-geometric approaches for 2D and 3D shape analyses and activity recognition," Image Vis. Comput., vol. 30, nos. 6/7, pp. 398-416, 2012.
10. M. F. Abdelkader, W. Abd-Almageed, A. Srivastava, and R. Chellappa, "Silhouette-based gesture and action recognition via modeling trajectories on Riemannian shape manifolds," Comput. Vis. Image Understanding, vol. 115, no. 3, pp. 439-455, 2011.
11. Z. Zhang, "Microsoft kinect sensor and its effect," IEEE Multimedia, vol. 19, no. 2, pp. 4-10, Apr.-Jun. 2012.
12. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake, "Real-time human pose recognition in parts from single depth images," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 1297-1304.
13. W. Li, Z. Zhang, and Z. Liu, "Action recognition based on a bag of 3D points," in Proc. IEEE Inter. Workshop CVPR Human Commun. Behavior Anal., 2010, pp. 914.
14. J. Wang, Z. Liu, Y. Wu, and J. Yuan, "Mining actionlet ensemble for action recognition with depth cameras," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 1290-1297.
15. O. Oreifej and Z. Liu, "Hon4d: Histogram of oriented 4d normals for activity recognition from depth sequences," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 716-723.
16. J. Sung, C. Ponce, B. Selman, and A. Saxena, "Unstructured human activity detection from RGBD images," in Proc. IEEE Int. Conf. Robot. Autom., 2012, pp. 842-849.
17. X. Yang, C. Zhang, and Y. Tian, "Recognizing actions using depth motion maps-based histograms of oriented gradients," in Proc. 20th ACM Int. Conf. Multimedia, 2012, pp. 1057-1060.
18. J. Wang, Z. Liu, Y. Wu, and J. Yuan, "Learning actionlet ensemble for 3D human action recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 5, pp. 914-927, May 2014.
19. X. Yang and Y. Tian, "Effective 3D action recognition using eigenjoints," J. Vis. Commun. Image Representation, vol. 25, no. 1, pp. 2-11, 2014.
20. C. Ellis, S. Z. Masood, M. F. Tappen, J. J. Laviola Jr., and R. Sukthankar, "Exploring the trade-off between accuracy and observational latency in action recognition," Int. J. Comput. Vis., vol. 101, no. 3, pp. 420-436, 2013.
21. M. Devanne, H. Wannous, S. Berretti, P. Pala, M. Daoudi, and A. D. Bimbo, "Space-time pose representation for 3D human action recognition," in Proc. ICIAP Workshops, 2013, pp. 456-464.
22. A. Srivastava, E. Klassen, S. H. Joshi, and I. H. Jermyn, "Shape analysis of elastic curves in Euclidean spaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 7, pp. 1415-1428, Jul. 2011.
23. L. Xia, C.-C. Chen, and J. K. Aggarwal, "View invariant human action recognition using histograms of 3D joints," in Proc. CVPR Workshops, 2012, pp. 20-27.
24. A. Veeraraghavan, R. Chellappa, and A. Roy-Chowdhury, "The function space of an activity," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2006, vol. 1, pp. 959-968.
25. A. Gritai, Y. Sheikh, C. Rao, and M. Shah, "Matching trajectories of anatomical landmarks under viewpoint, anthropometric and temporal transforms," Int. J. Comput. Vis., vol. 84, no. 3, pp. 325-343, 2009.
26. F. Lv and R. Nevatia, "Recognition and segmentation of 3-d human action using hmm and multi-class adaboost," in Proc. 9th Eur. Conf. Comput. Vis.-Volume Part IV, 2006, pp. 359-372.
27. P. K. Turaga, A. Veeraraghavan, A. Srivastava, and R. Chellappa, "Statistical computations on Grassmann and Stiefel manifolds for image and video-based recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 11, pp. 2273-2286, Nov. 2011.
28. R. Slama, H. Wannous, and M. Daoudi, "Grassmannian representation of motion depth for 3D human gesture and action recognition," in Proc. 22nd Int. Conf. Pattern Recog., Stockholm, Sweden, 2014, pp. 3499-3504.
29. M. Raptis and L. Sigal, "Poselet key-framing: A model for human activity recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 2650-2657.
30. M. Zanfir, M. Leordeanu, and C. Sminchisescu, "The moving pose: An efficient 3D kinematics descriptor for low-latency action recognition and detection," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 2752-2759.
31. I. Dryden and K. Mardia, Statistical Shape Analysis. New York, NY, USA: Wiley, 1998.
32. R. Vemulapalli, F. Arrate, and R. Chellappa, "Human action recognition by representing 3D skeletons as points in a lie group," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 588-595.
33. J. Martens and I. Sutskever, "Learning recurrent neural networks with Hessian-free optimization," in Proc. Int. Conf. Mach. Learn., 2011, pp. 1033-1040.
34. M. Müller and T. Roder, "Motion templates for automatic classification and retrieval of motion capture data," in Proc. ACM SIGGRAPH/ Eurographics Symp. Comput. Animation, 2006, pp. 137-146.
35. J. Wang, Z. Liu, J. Chorowski, Z. Chen, and Y. Wu, "Robust 3D action recognition with random occupancy patterns," in Proc. 12th Eur. Conf. Comput. Vis.-Volume II, 2012, pp. 872-885.
36. H. Koppula and A. Saxena, "Learning spatio-temporal structure from RGB-D videos for human activity detection and anticipation," in Proc. 30th Int. Conf. Mach. Learn., 2013, vol. 28, no. 3, pp. 792-800.