Histogram of 3D Facets: A depth descriptor for human action and hand gesture recognition

Computer Vision and Image Understanding

Volumn 139, Issue , 2015, Pages 29-39

  Zhang, Chenyang ^a   Tian, Yingli ^a  

^a CITY COLLEGE OF NEW YORK   (United States)

Author keywords

Computer vision; Gesture and action recognition; Histogram of 3D Facets; RGBD image processing; Time sequence representation

Indexed keywords

COMPUTER VISION; DYNAMIC PROGRAMMING; ENCODING (SYMBOLS); GRAPHIC METHODS; IMAGE PROCESSING; MOTION ESTIMATION; PALMPRINT RECOGNITION;

ACTION RECOGNITION; ACTIVITY ANALYSIS; DEPTH DESCRIPTOR; DEPTH INFORMATION; HAND-GESTURE RECOGNITION; HISTOGRAM OF 3D FACETS; STATE-OF-THE-ART PERFORMANCE; TIME SEQUENCES;

GESTURE RECOGNITION;

EID: 84939772383     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2015.05.010     Document Type: Article

References (36)

1. N. Dalal, and B. Triggs Histogram of orientated gradients for human detection IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2005 IEEE 886 893
2. R. Francois, and G. Medioni Adaptive color background modeling for real-time segmentation of video streams International Conference on Imaging Science, Systems, and Technology 1999 Las Vegas, NA
3. I. Laptev On space-time interest points Int. J. Comput. Vis. 64 2 2005 107 123
4. W. Li, Z. Zhang, and Z. Liu Action recognition based on a bag of 3D points IEEE Workshop on CVPR for Human Communicative Behavior Analysis 2010
5. N. Pugeault, and R. Bowden Spelling it out: real-time asl fingerspelling recognition IEEE International Conference on Computer Vision Workshops 2011 1114 1119
6. Z. Ren, J. Yuan, and Z. Zhang Robust gesture recognition based on finger-Earth mover's distance with a commodity depth camera The 19th ACM international conference on Multimedia (ACM'MM) 2011 1093 1096
7. Z. Ren, J. Yuan, C. Li, W. Liu, Minimum near-convex decomposition for robust shape representation, in: IEEE International Conference on Computer Vision (ICCV), 2011, pp. 303-310.
8. L. Schwarz, A. Mkhitaryan, D. Mateus, and N. Navab Estimating human 3D pose from time-of-flight images on geodesic distance and optical flow IEEE International Conference on Automatic Face & Gesture Recognition (FG) 2011 700 706
9. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake Real-time pose recognition in parts from single depth images IEEE Conference on Computer Vision and Pattern Recognition (CVPR) vol. 2 2011 7
10. M.V.d. Bergh, and L.V. Gool Combining RGB and TOF cameras for real-time 3d hand gesture interaction IEEE Workshop on Applications of Computer Vision (WACV) 2011 66 72
11. J. Wang, Z. Liu, Y. Wu, and J. Yuan Mining actionlet ensemble for action recognition with depth cameras IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2012 1290 1297
12. Y. Wu, and T. Huang Vision-based gesture recognition: a review Gesture-based commun. in hum. comput. interact. 1999 103 115
13. X. Yang, C. Zhang, and Y. Tian Recognizing actions using depth motion maps-based histograms of oriented gradients ACM International Conference on Multimedia 2012
14. J. Wright, A.Y. Yang, A. Ganesh, S.S. Sastry, and Y. Ma Robust face recognition via sparse representation IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 31 2 2009
15. R. Bellman On the approximation of curves by line segments using dynamic programming Commun. ACM 4 6 1961 284
16. J. Wang, Z. Liu, J. Chorowski, Z. Chen, and Y. Wu Robust 3D action recognition with random occupancy patterns ECCV 2012
17. C. Maurer, R. Qi, and V. Raghavan A linear time algorithm for computing exact euclidean distance transforms of binary images in arbitrary dimensions IEEE Trans. Pattern Anal. Mach. Intell. 25 2 2003 265 270
18. O. Oreifej, and Z. Liu Hon4d: histogram of oriented 4D normals for activity recognition from depth sequences CVPR 2013
19. A. Klaser, M. Marszalek, and C. Schmid A spatio-temporal descriptor based on 3D-gradients British Machine Vision Conference, BMVC'08, Leeds, United Kingdom 2008
20. S. Tang, X. Wang, T. Han, J. Keller, M. Skubic, S. Lao, and Z. He Histogram of oriented normal vectors for object recognition with a depth sensor ACCV 2012
21. C. Zhang, X. Yang, and Y. Tian Histogram of 3D facet: a characteristic descriptor for hand gesture recognition IEEE Conference on Automatic Face and Gesture Recognition (FG) 2013
22. P. Brown, P. Desouza, R. Mercer, V. Pietra, and J. Lai Class-based N-gram models of natural language Computational Linguistics 1992 MIT Press
23. G. Pedrosa, and A. Traina From bag-of-visual-words to bag-of-visual-phrases using n-grams IEEE Conference on Graphics, Patterns and Images (SIBGRAPI) 2013
24. C. Keskin, F. KIraç, Y.E. Kara, and L. Akarun Hand pose estimation and hand shape classification using multi-layered randomized decision forests ECCV 2012
25. L. Xia, C. Chen, and J. Aggarwal View invariant human action recognition using histograms of 3D joints CVPR Workshop 2012
26. A. Vieira, E. Nascimento, G. Oliveira, Z. Liu, and M. Campos Stop: space-time occupancy patterns for 3d action recognition from depth map sequences CIARP 2012
27. J. Wang, Z. Liu, Y. Wu, and J. Yuan Mining actionlet ensemble for action recognition with depth cameras CVPR 2012
28. L. Xia, C. Chen, and J. Aggarwal View invariant human action recognition using histograms of 3D joints CVPR Workshop 2012
29. C. Wang, Y. Wang, and A. Yuille An approach to pose based action recognition CVPR 2013
30. A. Vedaldi, and B. Fulkerson Vlfeat: an open and portable library of computer vision algorithms Proceedings of the International Conference on Multimedia, ACM 2010
31. H. Pfister, M. Zwicker, J. van Baar, and M. Gross Surfels: surface elements as rendering primitives SIGGRAPH 2000
32. S. Belongie, J. Malik, J. Puzicha, Shape matching and object recognition using shape contexts, IEEE Trans. Pattern Anal. Mach. Intell. 24 (24): 509-521.
33. S. Hadfield, and R. Bowden Hollywood 3d: recognizing actions in 3d natural scenes Proceedings IEEE Conference on Computer Vision and Pattern Recognition 2013
34. C. Qian, X. Sun, Y. Wei, X. Tang, and J. Sun Realtime and robust hand tracking from depth CVPR 2014
35. H. Liang, J. Yuan, and D. Thalmann Parsing the hand in depth images IEEE Trans. on Multimedia (T-MM) 2014
36. F. Domino, M. Donadeo, and P. Zanuttigh Combining multiple depth based descriptors for hand gesture recognition Pattern Recognit. Lett. 50 2014 101 111