Volumetric spatial feature representation for view-invariant human action recognition using a depth camera

Optical Engineering

Volumn 54, Issue 3, 2015, Pages

  Cho, Seong Sik ^a   Lee, A Reum ^a   Suk, Heung Il ^a   Park, Jeong Seon ^b   Lee, Seong Whan ^a  

^a Korea University   (South Korea)

^b Chonnam National University   (South Korea)

Author keywords

action recognition; depth camera; point clouds; view invariance; volumetric spatial feature representation

Indexed keywords

CAMERAS; FACE RECOGNITION; GESTURE RECOGNITION; IMAGE RECOGNITION; VIDEO RECORDING;

ACTION RECOGNITION; DEPTH CAMERA; POINT CLOUD; SPATIAL FEATURES; VIEW INVARIANCE;

MOTION ESTIMATION;

EID: 84923886781     PISSN: 00913286     EISSN: 15602303     Source Type: Journal    
DOI: 10.1117/1.OE.54.3.033102     Document Type: Article

References (28)

1. R. Poppe, "A survey on vision-based human action recognition," Image Vis. Comput. 28(6), 976-990 (2010).
2. D. Weinland, R. Ronfard, and E. Boyer, "A survey of vision-based methods for action representation, segmentation and recognition," Comput. Vis. Image Und. 115(2), 224-241 (2011).
3. J. Shotton et al., "Real-time human pose recognition in parts from a single depth image," in Proc. 2012 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition Workshops, IEEE (2011).
4. M. Holte et al., "A local 3-D motion descriptor for multi-view human action recognition from 4-D spatio-temporal interest points," IEEE J. Sel. Topics Signal Process. 6(5), 553-565 (2012).
5. I. Junejo et al., "View-independent action recognition from temporal self-similarities," IEEE Trans. Pattern Anal. Mach. Intell. 33(1), 172-185 (2011).
6. T. Kanungo et al., "An efficient k-means clustering algorithm: analysis and implementation," IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 881-892 (2002).
7. P. Huang, A. Hilton, and J. Starck, "Shape similarity for 3D video sequences of people," Int. J. Comput. Vis. 89(2-3), 362-381 (2010).
8. L. Xia, C.-C. Chen, and J. Aggarwal, "View invariant human action recognition using histograms of 3D joints," in Proc. 2012 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition Workshops, pp. 20-27, IEEE, Providence (2012).
9. M.-C. Roh, H.-K. Shin, and S.-W. Lee, "View-independent human action recognition with volume motion template on single stereo camera," Pattern Recognit. Lett. 31(7), 639-647 (2010).
10. Z. Cheng et al., "Human daily action analysis with multi-view and color-depth data," Lec. Notes Comput. Sci. 7584, 52-61 (2012).
11. C. Benabdelkader, R. Cutler, and L. Davis, "Gait recognition using image self-similarity," EURASIP J. Adv. Signal Process. 2004(4), 572-585 (2004).
12. E. Shechtman and M. Irani, "Matching local self-similarities across images and videos," in Proc. 2007 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 1-8, IEEE, Minneapolis (2007).
13. R. C. Gonzalez and R. E. Woods, Digital Image Processing, 3rd ed., Prentice-Hall, Inc., Upper Saddle River, New Jersey (2006).
14. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. 2005 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, Vol. 1, pp. 886-893, IEEE, San Diego (2005).
15. J. Niebles, H. Wang, and L. Fei-Fei, "Unsupervised learning of human action categories using spatial-temporal words," Int. J. Comput. Vis. 79(3), 299-318 (2008).
16. I. Laptev, B. Caputo, and T. Lindeberg, "Local velocity-adapted motion events for spatio-temporal recognition," Comput. Vis. Image Und. 108(3), 207-229 (2007).
17. H.-I. Suk and S.-W. Lee, "A novel Bayesian framework for discriminative feature extraction in brain-computer interfaces," IEEE Trans. on Pattern Anal. Mach. Intell. 35(2), 286-299 (2013).
18. C.-C. Chang and C.-J. Lin, "LIBSVM: a library for support vector machines," ACM Trans. on Intell. Syst. Technol. 2(3), 1-27 (2011).
19. J. Milgram, M. Cheriet, and R. Sabourin, "'One Against One' or 'One Against All': Which one is better for handwriting recognition with SVMs?," in Proc. Tenth Int. Workshop on Frontiers in Handwriting Recognition, SuviSoft, La Baule, France (2006).
20. G. Bradski, "OpenCV," Dr. Dobb's J. Software Tools (2000).
21. H. Wang et al., "Evaluation of local spatio-temporal features for action recognition," in Proc. British Machine Vision Conf., pp. 124. 1-124. 11, London, UK (2009). .
22. A. Vieira et al., "STOP: Space-time occupancy patterns for 3D action recognition from depth map sequences," Lec. Notes Comput. Sci. 7441, 252-259 (2012).
23. J. Wang et al., "Robust 3D action recognition with random occupancy patterns," Lec. Notes Comput. Sci. 872-885, (2012).
24. X. Lu and J. Aggarwal, "Spatio-temporal depth cuboid similarity feature for activity recognition using depth camera," in Proc. 2013 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 2834-2841, IEEE, Portland (2013).
25. O. Oreifej and Z. Liu, "HON4D: Histogram of oriented 4D normals for activity recognition from depth sequences," in Proc. 2013 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 716-723, Portland (2013).
26. J. Wang et al., "Mining actionlet ensemble for action recognition with depth cameras," in Proc. 2012 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 1290-1297, IEEE, Providence (2012).
27. P. Dollar et al., "Behavior recognition via sparse spatio-temporal features," in Proc. 2nd Joint IEEE Int. Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, 2005, pp. 65-72, IEEE, Washington (2005).
28. I. Laptev et al., "Learning realistic human actions from movies," in Proc. 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1-8, IEEE, Anchorage (2008).