Real-time human pose estimation and gesture recognition from depth images using superpixels and SVM classifier

Sensors (Switzerland)

Volumn 15, Issue 6, 2015, Pages 2410-12427

  Kim, Hanguen ^a   Lee, Sangwon ^a   Lee, Dongsung ^b   Choi, Soonmin ^b   Ju, Jinsun ^b   Myung, Hyun ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^b Samsung Advanced Institute of Technology (SAIT)   (South Korea)

Author keywords

Depth information; Gesture recognition; Human pose estimation; Low cost platform

Indexed keywords

ALGORITHMS; MOTION ESTIMATION; PIXELS; PROGRAM PROCESSORS; SUPPORT VECTOR MACHINES;

DEPTH INFORMATION; GESTURE RECOGNITION ALGORITHM; HUMAN BODY MODELING; HUMAN POSE ESTIMATIONS; KEY-FRAME EXTRACTION; LOW COSTS; REAL ENVIRONMENTS; SVM(SUPPORT VECTOR MACHINE);

GESTURE RECOGNITION;

EID: 84930628902     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s150612410     Document Type: Article

References (23)

1. Zhang, Z. Microsoft Kinect sensor and its effect. IEEE Multimed. 2012, 19, 4–10.
2. Arieli, Y.; Freedman, B.; Machline, M.; Shpunt, A. Depth Mapping Using Projected Patterns. U.S. Patent 8,150,142, 3 April 2012.
3. Zhang, Z.; Soon Seah, H.; Kwang Quah, C.; Sun, J. GPU-accelerated real-time tracking of full-body motion with multi-layer search. IEEE Trans. Multimed. 2013, 15, 106–119.
4. Shotton, J.; Girshick, R.; Fitzgibbon, A.; Sharp, T.; Cook, M.; Finocchio, M.; Moore, R.; Kohli, P.; Criminisi, A.; Kipman, A.; et al. Efficient human pose estimation from single depth images. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 2013, 35, 2821–2840.
5. Hernández-Vela, A.; Zlateva, N.; Marinov, A.; Reyes, M.; Radeva, P.; Dimov, D.; Escalera, S.: Graph Cuts Optimization for Multi-limb Human Segmentation in Depth Maps. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), St. Paul, MN, USA, 14–18 May 2012; pp. 726–732.
6. Ganapathi, V.; Plagemann, C.; Koller, D.; Thrun, S.: Real Time Motion Capture Using a Single Time-of-flight Camera. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA, 13–18 June 2010; pp. 755–762.
7. Zhu, Y.; Fujimura, K. Constrained Optimization for Human Pose Estimation from Depth Sequences. In Proceedings of Asian Conference on Computer Vision (ACCV), Tokyo, Japan, 1–22 November 2007; pp. 408–418.
8. Grest, D.; Woetzel, J.; Koch, R.: Nonlinear Body Pose Estimation from Depth Images. In Pattern Recognition; Springer: Berlin/Heidelberg, Germany, 2005; pp. 285–292.
9. Ye, M.; Wang, X.; Yang, R.; Ren, L.; Pollefeys, M.: Accurate 3D Pose Estimation from a Single Depth Image. In Proceedings of IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain, 6–13 November 2011; pp. 731–738.
10. Siddiqui, M.; Medioni, G.: Human Pose Estimation from a Single View Point, Real-time Range Sensor. In Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), San Francisco, CA, USA, 13–18 June 2010; pp. 1–8.
11. Bellucci, A.; Malizia, A.; Diaz, P.; Aedo, I. Human-display interaction technology: Emerging remote interfaces for pervasive display environments. IEEE Pervasive Comput. 2010, 9, 72–76.
12. Wu, J.; Konrad, J.; Ishwar, P.: Dynamic Time Warping for Gesture-based User Identification and Authentication with Kinect. In Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, BC, Canada, 26–31 May 2013; pp. 2371–2375.
13. Biswas, K.; Basu, S.K. Gesture Recognition Using Microsoft KinectR. In Proceedings of International Conference on Automation, Robotics and Applications (ICARA), Wellington, New Zealand, 6–8 December 2011; pp. 100–103.
14. Megavannan, V.; Agarwal, B.; Babu, R.V.: Human Action Recognition Using Depth Maps. In Proceedings of International Conference on Signal Processing and Communications (SPCOM), Bangalore, India, 22–25 July 2012; pp. 1–5.
15. Kim, H.; Hong, S.H.; Myung, H.: Gesture recognition algorithm for moving Kinect sensor. In Proceedings of IEEE International Workshop on Robots and Human Interactive Communications (RO-MAN), Gyeongju, Korea, 26–29 August 2013; pp. 320–321.
16. Xia, L.; Chen, C.C.; Aggarwal, J.: View Invariant Human Action Recognition Using Histograms of 3D Joints. In Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Providence, RI, USA, 16–21 June 2012; pp. 20–27.
17. Poppe, R. A survey on vision-based human action recognition. Image Vision Comput. 2010, 28, 976–990.
18. Sigalas, M.; Baltzakis, H.; Trahanias, P.: Gesture Recognition based on Arm Tracking for Human-robot Interaction. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Taipei, Taiwan, 18–22 October 2010; pp. 5424–5429.
19. De Maesschalck, R.; Jouan-Rimbaud, D.; Massart, D.L. The mahalanobis distance. Chemom. Intell. Lab. Syst. 2000, 50, 1–18.
20. Achanta, R.; Shaji, A.; Smith, K.; Lucchi, A.; Fua, P.; Susstrunk, S. SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 2012, 34, 2274–2282.
21. ASUS Xtion pro. Available online: http://www.asus.com/Multimedia/Xtion_PRO/ (accessed on 26 February 2015).
22. OpenNI NiTE. Available online: http://www.openni.ru/files/nite/ (accessed on 26 February 2015).
23. IPi Mocap Studio. Available online: http://ipisoft.com/ (accessed on 26 February 2015).