Learning actionlet ensemble for 3D human action recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 36, Issue 5, 2014, Pages 914-927

  Wang, Jiang ^a   Liu, Zicheng ^b   Wu, Ying ^a   Yuan, Junsong ^c  

^a NORTHWESTERN UNIVERSITY   (United States)

^b MICROSOFT RESEARCH   (United States)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Computer vision; Gesture; Video analysis

Indexed keywords

COMPUTER VISION; DATA PROCESSING; GESTURE RECOGNITION; IMAGE RECOGNITION; THREE DIMENSIONAL;

EXPERIMENTAL EVALUATION; GESTURE; HUMAN-ACTION RECOGNITION; HUMAN-OBJECT INTERACTION; MOTION CAPTURE SYSTEM; MULTI-VIEW ACTION RECOGNITION; STATE-OF-THE-ART ALGORITHMS; VIDEO ANALYSIS;

MOTION ESTIMATION;

ACTIMETRY; ALGORITHM; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; HUMAN; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; MOVEMENT (PHYSIOLOGY); PHOTOGRAPHY; PHYSIOLOGY; PROCEDURES; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; THREE DIMENSIONAL IMAGING; VIDEORECORDING; WHOLE BODY IMAGING;

ACTIGRAPHY; ALGORITHMS; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; MOVEMENT; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE; VIDEO RECORDING; WHOLE BODY IMAGING;

EID: 84900557701     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2013.198     Document Type: Article

References (41)

1. CMU Graphics Lab Motion Capture Database [Online]. Available: http://mocap.cs.cmu.edu/
2. R. Agrawal and R. Srikant, "Fast algorithms for mining association rules," in Proc. 20th VLDB, vol. 1215. Santiago, Chile, 1994, pp. 487-499.
3. L. Bourdev and J. Malik, "Poselets: Body part detectors trained using 3D human pose annotations," in Proc. CVPR, Kyoto, Japan, 2009.
4. L. Campbell and A. Bobick, "Recognition of human body motion using phase space constraints," in Proc. 5th ICCV, Cambridge, MA, USA, 1995.
5. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee, "Choosing multiple parameters for support vector machines," Mach. Learn., vol. 46, no. 1, pp. 131-159, 2002. (Pubitemid 34129966)
6. R. Chaudhry, F. Ofli, G. Kurillo, R. Bajcsy, and R. Vidal, "Bioinspired dynamic 3D discriminative skeletal features for human action recognition," in Proc. HAU3D13, Portland, OR, USA, 2013.
7. H. Chen, H. Chen, Y. Chen, and S. Lee, "Human action recognition using star skeleton," in Proc. 4th ACM Int. Workshop Video Surveillance Sensor Networks, New York, NY, USA, 2006, pp. 171-178. (Pubitemid 47168338)
8. S. Dai, M. Yang, Y. Wu, and A. Katsaggelos, "Detector ensemble," in Proc. IEEE Conf. CVPR, Minneapolis, MN, USA, Jun. 2007, pp. 1-8.
9. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Computer Soc. Conf. CVPR, San Diego, CA, USA, 2005, pp. 886-893. (Pubitemid 43897286)
10. C. Desai and D. Ramanan, "Detecting actions, poses, and objects with relational phraselets," in Proc. 12th ECCV, Berlin, Germany, 2012.
11. M. A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, 1981.
12. J. H. Friedman and B. E. Popescu, "Predictive learning via rule ensembles," Ann. Appl. Statist., vol. 2, no. 3, pp. 916-954, Sept. 2008.
13. L. Han, X. Wu, W. Liang, G. Hou, and Y. Jia, "Discriminative human action recognition in the learned hierarchical manifold space," Image Vis. Comput., vol. 28, no. 5, pp. 836-849, May 2010.
14. H. S. Koppula, R. Gupta, and A. Saxena, "Learning human activities and object affordances from RGB-D videos," Int. J. Robot. Res., vol. 32, no. 8, pp. 951-970, 2013.
15. I. Laptev, "On space-time interest points," Int. J. Comput. Vis., vol. 64, no. 2-3, pp. 107-123, Sept. 2005. (Pubitemid 41314645)
16. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld, "Learning realistic human actions from movies," in Proc. IEEE Conf. CVPR, Anchorage, AK, USA, pp. 1-8, 2008.
17. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Comput. Soc. Conf. CVPR, vol 2. Washington, DC, USA, 2006.
18. L. Li and B. Prakash, "Time series clustering: Complex is simpler!" in Proc. 28th ICML, Bellevue, WA, USA, 2011.
19. W. Li, Z. Zhang, and Z. Liu, "Action recognition based on a bag of 3D points," in Proc. Human Communicative Behavior Analysis Workshop (in Conjunction with CVPR), 2010.
20. F. Lv and R. Nevatia, "Recognition and segmentation of 3-D human action using HMM and multi-class adaBoost," in Proc. 9th ECCV, 2006, pp. 359-372. (Pubitemid 44029643)
21. S. Maji, L. Bourdev, and J. Malik, "Action recognition from a distributed representation of pose and appearance," in Proc. IEEE Conf. CVPR, Providence, RI, USA, June 2011.
22. J. Martens and I. Sutskever, "Learning recurrent neural networks with hessian-free optimization," in Proc. 28th ICML, Bellevue, WA, USA, 2011.
23. M. Muller and T. Röder, "Motion templates for automatic classification and retrieval of motion capture data," in Proc. 2006 ACM SIGGRAPH/Eurographics Symp. Computer Animation, Aire-la-Ville, Switzerland, pp. 137-146.
24. H. Ning, W. Xu, Y. Gong, and T. Huang, "Latent pose estimator for continuous action recognition," in Proc. 10th ECCV, Marseille, France, 2008, pp. 419-433.
25. F. Ofli, R. Chaudhry, G. Kurillo, R. Vidal, and R. Bajcsy, "Sequence of the most informative joints (SMIJ): A new representation for human skeletal action recognition," J. Vis. Commun. Image Represent., vol. 25, no. 1, pp. 24-38, Jan. 2014.
26. A. V. Oppenheim, R. W. Schafer, and J. R. Buck, Discrete Time Signal Processing (Prentice Hall Signal Processing Series). Upper Saddle River, NJ, USA: Prentice Hall, 1999.
27. M. Raptis, D. Kirovski, and H. Hoppe, "Real-time classification of dance gestures from skeleton animation," in Proc. 2011 ACM SIGGRAPH/Eurographics SCA, New York, NY, USA, p. 147.
28. J. Shotton et al., "Real-time human pose recognition in parts from single depth images," in Proc. CVPR, Providence, RI, USA, 2011.
29. J. Sung, C. Ponce, B. Selman, and A. Saxena, "Unstructured human activity detection from RGBD images," in Proc. IEEE ICRA, Saint Paul, MN, USA, 2012.
30. A. W. Vieira, E. R. Nascimento, G. L. Oliveira, Z. Liu, and M. M. Campos, "STOP: Space-time occupancy patterns for 3D action recognition from depth map sequences," in Proc. 17th Iberoamerican Congr. Pattern Recognition Buenos Aires, Buenos Aires, Argentina, 2012.
31. J. Wang, Z. Liu, J. Chorowski, Z. Chen, and Y. Wu, "Robust 3D action recognition with random occupancy patterns," in Proc. 12th ECCV, Florence, Italy, 2012, pp. 1-14.
32. J. Wang, Z. Liu, Y. Wu, and J. Yuan, "Mining actionlet ensemble for action recognition with depth cameras," in Proc. IEEE Conf. CVPR, Providence, RI, USA, 2012.
33. J. Wang, J. Yuan, Z. Chen, and Y. Wu, "Spatial locality-aware sparse coding and dictionary learning," in Proc. ACML, 2012.
34. T.-F. Wu, C.-J. Lin, and R. C. Weng, "Probability estimates for multi-class classification by pairwise coupling," J. Mach. Learn. Res., vol. 5, pp. 975-1005, Aug. 2004.
35. L. Xia, C.-C. Chen, and J. K. Aggarwal, "View invariant human action recognition using histograms of 3D joints the University of Texas at Austin," in Proc. CVPR 2012 HAU3D Workshop.
36. X. Yang and Y. Tian, "EigenJoints-based action recognition using naïve-bayes-nearest-neighbor," in Proc. CVPR 2012 HAU3D Workshop.
37. X. Yang, C. Zhang, and Y. Tian, "Recognizing actions using depth motion maps-based histograms of oriented gradients," in Proc. 20th ACM Int. Conf. Multimedia, Nara, Japan, 2012.
38. B. Yao and L. Fei-Fei, "Grouplet: A structured image representation for recognizing human and object interactions," in Proc. IEEE Conf. CVPR, San Francisco, CA, USA, 2010.
39. J. Yuan, M. Yang, and Y. Wu, "Mining discriminative cooccurrence patterns for visual recognition," in Proc. IEEE Conf. CVPR, Providence, RI, USA, 2011.
40. K. Yun, J. Honorio, D. Chattopadhyay, T. L. Berg, D. Samaras, and S. Brook, "Two-person interaction detection using body-pose features and multiple instance learning," in Proc. IEEE Computer Soc. Conf. CVPR 2012 HAU3D Workshop, Providence, RI, USA.
41. L. L. Zhu, Y. Chen, Y. Lu, C. Lin, and A. Yuille, "Max margin and/or graph learning for parsing the human body," in Proc. IEEE Conf. CVPR, Anchorage, AK, USA, Jun. 2008.