Parsing the hand in depth images

IEEE Transactions on Multimedia

Volumn 16, Issue 5, 2014, Pages 1241-1253

  Liang, Hui ^a   Yuan, Junsong ^b   Thalmann, Daniel ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Depth context feature; hand parsing; Markov random field

Indexed keywords

GESTURE RECOGNITION; MARKOV PROCESSES;

ARTICULATED OBJECT; CONTINUOUS SEQUENCES; DEPTH-CONTEXT FEATURE; DISCRIMINATIVE FEATURES; HAND PARSING; HIGH LEVEL DESCRIPTION; MARKOV RANDOM FIELDS; TEMPORAL CONSTRAINTS;

STATISTICAL TESTS;

EID: 84904679343     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2014.2306177     Document Type: Article

References (40)

1. J. P. Wachs, M. Kolsch, H. Stern, and Y. Edan, "Vision-based handgesture applications," Commun. ACM, vol. 54, no. 2, pp. 60-71, Feb. 2011.
2. Z. Ren, J. Yuan, J. Meng, and Z. Zhang, "Robust part-based hand gesture recognition using Kinect sensor," IEEE Trans. Multimedia, vol. 15, no. 5, pp. 1110-1120, Aug. 2013.
3. Z. Li and R. Jarvis, "Real time hand gesture recognition using a range camera," in Proc. ACRA, 2009.
4. M. Van den Bergh, E. Koller-Meier, F. Bosche, and L. Van Gool, "Haarlet-based hand gesture recognition for 3D interaction," in Proc. WACV, 2009.
5. X. Shen, G. Hua, L. Williams, and Y. Wu, "Dynamic hand gesture recognition: An exemplar-based approach from motion divergence fields," Image Vision Comput., vol. 30, no. 3, pp. 227-235, Mar. 2012.
6. Y. Yao and Y. Fu, "Real-time hand pose estimation from RGB-D sensor," in Proc. ICME, 2012.
7. CyberGlove [Online]. Available: http://www. cyberglovesystems. com.
8. J. Shotton, A. Fitzgibbon,M. Cook, T. Sharp, andM. Finocchio, "Realtime human pose recognition in parts from single depth images," in Proc. CVPR, 2011.
9. J. Heikkila, "A four-step camera calibration procedure with implicit image correction," in Proc. CVPR, 1997.
10. L. Breiman, "Random forests," Mach. Learn., vol. 45, no. 1, pp. 5-32, 2001. (Pubitemid 32933532)
11. A. Erol, G. Bebis, M. Nicolescu, R. D. Boyle, and X. Twombly, "A Review on vision-based full DOF hand motion estimation," in Proc. CVPR, 2005.
12. J. Lin, W. Ying, and T. S. Huang, "Modeling the constraints of human hand motion," in Proc. HUMO, 2000.
13. J. P. Lewis, M. Cordner, and N. Fong, "Pose space deformation: A unified approach to shape interpolation and skeleton-driven deformation," in Proc. SIGGRAPH, 2000.
14. R. Y. Wang and J. Popovic, "Real-time hand-tracking with a color glove," ACM Trans. Graph., vol. 28, no. 3, Aug. 2009.
15. K. S. Arun, T. S. Huang, and S. D. Blostein, "Least-squares fitting of two 3-D point sets," IEEE Trans. Pattern Anal. Mach. Intell., vol. 9, no. 5, pp. 698-700, May 1987.
16. R. Kindermann and J. L. Snell, Markov Random Fields and Their Applications. Providence, RI, USA: Amer. Math. Soc., 1980.
17. M. Fauvel, J. Chanussot, and J. A. Benediktsson, "SVM- and MRF-based method for accurate classification of hyperspectral images," IEEE Geosci. Remote Sens. Lett., vol. 7, no. 4, pp. 736-740, Oct. 2010.
18. A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Susstrunk, "SLIC superpixels compared to state-of-the-art superpixel methods," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2274-2282, Nov. 2012.
19. X. Wang, "A new localized superpixel Markov random field for image segmentation," in Proc. ICME, 2009.
20. J. Besag, "On the statistical analysis of dirty pictures," J. Roy. Statist. Soc., ser. B, vol. 48, no. 3, pp. 259-302, 1986.
21. M. K. Bhuyan,V. V. Ramaraju, andY. Iwahori, "Hand gesture recognition and animation for local hand motions," Int. J. Mach. Learn. Cyber., Mar. 2013.
22. H. Wang, M. C. Leu, and C. Oz, "American sign language recognition using multi-dimensional hiddenMarkov models," J. Inf. Sci. Eng., 2006.
23. J. Choi, J. Park, H. Park, and J. Park, "iHand: An interactive bare-handbased augmented reality interface on commercialmobile phones," Opt. Eng., vol. 52, no. 2, Feb. 2013.
24. C. Kerdvibulvech and H. Saito, "Model-based hand tracking by chamfer distance and adaptive color learning using particle filter," in Proc. 2009 EURASIP.
25. S. Belongie, J. Malik, and J. Puzicha, "Shape matching and object recognition using shape contexts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 4, pp. 509-522, Apr. 2002. (Pubitemid 34448769)
26. S. Lu, D. Metaxas, D. Samaras, and J. Oliensis, "Using multiple cues for hand tracking and model refinement," in Proc. 2003 CVPR.
27. R. B. Rusu, N. Blodow, and M. Beetz, "Fast point feature histograms (FPFH) for 3D registration," in Proc. ICRA, Kobe, Japan, 2009.
28. C. Keskin, F. Kirac, Y. E. Kara, and L. Akarun, "Hand pose estimation and hand shape classification using multi-layered randomized decision forests," in Proc. ECCV, 2012.
29. M. Eichner, M. Marin-Jimenez, A. Zisserman, and V. Ferrari, "2D articulated human pose estimation and retrieval in (almost) unconstrained still images," Int. J. Comput. Vision, vol. 99, no. 2, pp. 190-214, 2012.
30. C. Keskin, F. Kirac, Y. E. Kara, and L. Akarun, "Real-time hand pose estimation using depth sensors," in Proc. ICCV, 2011.
31. B. Dorner, "Chasing the color glove: Visual hand tracking," Master's thesis, Simon Fraser Univ., Burnaby, BC, Canada, 1994.
32. A. Aristidou and J. Lasenby, "Motion capture with constrained inverse kinematics for real-time hand tracking," in Proc. ISCCSP, 2010.
33. A. Baak, M. Muller, G. Bharaj, H. P. Seidel, and C. Theobalt, "A data-driven approach for real-time full body pose reconstruction from a depth camera," in Proc. ICCV, 2011.
34. L. Bo, X. Ren, and D. Fox, "Depth kernel descriptors for object recognition," in Proc. IROS, 2011.
35. D. Ramanan, "Learning to parse images of articulated bodies," in Proc. NIPS, 2007.
36. L. Zhu, Y. Chen, Y. Lu, C. Lin, and A. Yuille, "Max margin AND/OR graph learning for parsing the human body," in Proc. CVPR, 2008.
37. Z. Ren, J. Yuan, C. Li, and W. Liu, "Minimum near-convex decomposition for robust Shape Representation," in Proc. ICCV, 2011.
38. J. Tighe and S. Lazebnik, "SuperParsing: Scalable nonparametric image parsing with superpixels," in Proc. ECCV, 2010.
39. H. Liang, J. Yuan, D. Thalmann, and Z. Zhang, "Model-based hand pose estimation via spatial-temporal hand parsing and 3D fingertip localization," Visual Comput. J., vol. 29, no. 6-8, pp. 837-848, Jun. 2013.
40. A. Hernandez-Vela, N. Zlateva, A. Marinov, M. Reyes, P. Radeva, D. Dimov, and S. Escalera, "Graph cuts optimization for multi-limb human segmentation in depth maps," in Proc. CVPR, 2012