3D human action segmentation and recognition using pose kinetic energy

Proceedings of IEEE Workshop on Advanced Robotics and its Social Impacts, ARSO

Volumn 2015-January, Issue January, 2015, Pages 69-75

  Shan, Junjie ^a   Akella, Srinivas ^a  

^a University of North Carolina at Charlotte   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); GESTURE RECOGNITION; KINETIC ENERGY; KINETICS; ROBOTICS; SUPPORT VECTOR MACHINES;

ADDITIONAL EXPERIMENTS; HUMAN ACTION SEGMENTATIONS; HUMAN-ACTION RECOGNITION; MULTICLASS SVM; MULTIPLE CLASSIFIERS; NON-LINEAR STRETCHING; STATE-OF-THE-ART METHODS; TEMPORAL AND SPATIAL VARIATION;

ECONOMIC AND SOCIAL EFFECTS;

EID: 84937437713     PISSN: 21627568     EISSN: 21627576     Source Type: Conference Proceeding    
DOI: 10.1109/ARSO.2014.7020983     Document Type: Conference Paper

References (42)

1. Microsoft Kinect for Windows. http://www.microsoft.com/en-us/kinectforwindows/. Accessed: 2013-05-21.
2. J. K. Aggarwal and M. S. Ryoo. Human activity analysis: A review. ACM Computing Survey, 43(3):16, 2011.
3. C. M. Bishop. Pattern Recognition and Machine Learning. Springer, 2006.
4. S. Calinon and A. Billard. Recognition and reproduction of gestures using a probabilistic framework combining PCA, ICA and HMM. In International Conference on Machine Learning (ICML), pages 105-112, 2005.
5. S. Calinon, F. Guenter, and A. Billard. On learning, representing, and generalizing a task in a humanoid robot. IEEE Transactions on Systems, Man, and Cybernetics, Part B, 37(2):286-298, 2007.
6. C.-C. Chang and C.-J. Lin. LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2:27:1-27:27, 2011. Software available at http://www.csie.ntu.edu.tw/∼cjlin/libsvm.
7. L. Chen, H. Wei, and J. M. Ferryman. A survey of human motion analysis using depth imagery. Pattern Recognition Letters, 34:1995-2006, 2013.
8. T. Darrell and A. Pentland. Space-time gestures. In IEEE Conference on Computer Vision and Pattern Recognition, pages 335-340, 1993.
9. D. R. Faria, C. Premebida, and U. Nunes. A probabilistic approach for human everyday activities recognition using body motion from RGBD images. In IEEE RO-MAN'14: IEEE International Symposium on Robot and Human Interactive Communication, 2014.
10. V. Ganapathi, C. Plagemann, D. Koller, and S. Thrun. Real-time human pose tracking from range data. In European Conference on Computer Vision, pages 738-751, 2012.
11. D. M. Gavrila and L. S. Davis. Towards 3-d model-based tracking and recognition of human movement: A multi-view approach. In International workshop on automatic face-and gesture-recognition, pages 272-277, 1995.
12. R. K. Gupta, A. Y. S. Chia, and D. Rajan. Human activities recognition using depth images. In ACM Multimedia, pages 283-292, 2013.
13. M. Hoai, Z.-Z. Lan, and F. De la Torre. Joint segmentation and classification of human actions in video. In 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3265-3272. IEEE, 2011.
14. A. Jaiantilal. Classification and regression by randomforestmatlab. Available at https://code.google.com/p/randomforest-matlab, 2009.
15. O. C. Jenkins and M. J. Mataríc. Deriving action and behavior primitives from human motion data. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2002), volume 3, pages 2551-2556, Lausanne, Switzerland, Oct 2002.
16. H. Koppula, R. Gupta, and A. Saxena. Learning human activities and object affordances from RGB-D videos. International Journal of Robotics Research, 32(8):951-970, 2013.
17. V. Krüger, D. Herzog, S. Baby, A. Ude, and D. Kragic. Learning actions from observations. IEEE Robotics and Automation Magazine, 17(2):30-43, 2010.
18. W. Li, Z. Zhang, and Z. Liu. Action recognition based on a bag of 3D points. In 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pages 9-14, 2010.
19. C. D. Manning, P. Raghavan, and H. Schutze. Introduction to Information Retrieval. Cambridge University Press, Cambridge, UK, 2008.
20. D. Marr and L. Vaina. Representation and recognition of the movements of shapes. Proceedings of the Royal Society of London. Series B. Biological Sciences, 214(1197):501-524, 1982.
21. U. Maurer, A. Smailagic, D. P. Siewiorek, and M. Deisher. Activity recognition and monitoring using multiple sensors on different body positions. In International Workshop on Wearable and Implantable Body Sensor Networks, pages 113-116, 2006.
22. M. Munaro, G. Ballin, S. Michieletto, and E. Menegatti. 3D flow estimation for human action recognition from colored point clouds. Biologically Inspired Cognitive Architectures, 5:42-51, 2013.
23. B. Ni, P. Moulin, and S. Yan. Order-preserving sparse coding for sequence classification. In European Conference on Computer Vision (2), pages 173-187, 2012.
24. B. Ni, Y. Pei, P. Moulin, and S. Yan. Multilevel depth and image fusion for human activity detection. IEEE Transactions on Cybernetics, 43(5):1383-1394, Oct. 2013.
25. O. Oreifej and Z. Liu. HON4D: Histogram of oriented 4D normals for activity recognition from depth sequences. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 716-723, 2013.
26. C. Ott, D. Lee, and Y. Nakamura. Motion capture based human motion recognition and imitation by direct marker control. In 2008 8th International Conference on Humanoids, pages 399-405, Daejeon, S. Korea, Dec. 2008.
27. L. Piyathilaka and S. Kodagoda. Gaussian mixture based HMM for human daily activity recognition using 3D skeleton features. In 2013 8th IEEE Conference on Industrial Electronics and Applications (ICIEA), pages 567-572, 2013.
28. L. R. Rabiner. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2):257-286, Feb. 1989.
29. Z. Shao and Y. F. Li. A new descriptor for multiple 3D motion trajectories recognition. In IEEE International Conference on Robotics and Automation, pages 4734-4739, Karlsruhe, Germany, May 2013.
30. J. Shotton, T. Sharp, A. Kipman, A. W. Fitzgibbon, M. Finocchio, A. Blake, M. Cook, and R. Moore. Real-time human pose recognition in parts from single depth images. Communications of the ACM, 56(1):116-124, 2013.
31. J. Sung, C. Ponce, B. Selman, and A. Saxena. Unstructured human activity detection from RGBD images. In IEEE International Conference on Robotics and Automation, pages 842-849, 2012.
32. P. K. Turaga, R. Chellappa, V. S. Subrahmanian, and O. Udrea. Machine recognition of human activities: A survey. IEEE Transactions on Circuits and Systems for Video Technology, 18(11):1473-1488, 2008.
33. J. Wang, Z. Liu, J. Chorowski, Z. Chen, and Y. Wu. Robust 3d action recognition with random occupancy patterns. In European Conference on Computer Vision (2), pages 872-885, 2012.
34. J. Wang, Z. Liu, Y. Wu, and J. Yuan. Mining actionlet ensemble for action recognition with depth cameras. In 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1290-1297, 2012.
35. J. Wang, Z. Liu, Y. Wu, and J. Yuan. Learning actionlet ensemble for 3D human action recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36(5):914-927, May 2014.
36. J. Wang and Y. Wu. Learning maximum margin temporal warping for action recognition. In IEEE International Conference on Computer Vision (ICCV), pages 2688-2695, Dec 2013.
37. D. Weinland, R. Ronfard, and E. Boyer. A survey of visionbased methods for action representation, segmentation and recognition. Computer Vision and Image Understanding, 115(2):224-241, 2011.
38. S. Wu and Y. F. Li. On signature invariants for effective motion trajectory recognition. International Journal of Robotics Research, 27(8):895-917, 2008.
39. L. Xia, C.-C. Chen, and J. K. Aggarwal. View invariant human action recognition using histograms of 3D joints. In 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pages 20-27. IEEE, 2012.
40. X. Yang and Y. Tian. Effective 3D action recognition using Eigen-Joints. Journal of Visual Communication and Image Representation, 25(1):2-11, Jan. 2014.
41. C. Zhang and Y. Tian. RGB-D camera-based daily living activity recognition. Journal of Computer Vision and Image Processing, 2(4), Dec. 2012.
42. Y. Zhu, W. Chen, and G. Guo. Evaluating spatiotemporal interest point features for depth-based action recognition. Image and Vision Computing, 32(8):453-464, 2014.