Fits like a glove: Rapid and reliable hand shape personalization

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 5610-5619

  Tan, David Joseph ^a,b   Cashman, Thomas ^a   Taylor, Jonathan ^a   Fitzgibbon, Andrew ^a   Tarlow, Daniel ^a   Khamis, Sameh ^a   Izadi, Shahram ^a   Shotton, Jamie ^a  

^a MICROSOFT RESEARCH   (United States)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; COST FUNCTIONS; FINITE DIFFERENCE METHOD; PATTERN RECOGNITION;

CENTRAL FINITE DIFFERENCE; GRADIENT-BASED OPTIMIZATION; HIGH FREQUENCY HF; LOW FREQUENCY BEHAVIOR; MODEL REGISTRATIONS; PERSONALIZED MODEL; PIECEWISE-CONTINUOUS; PRACTICAL METHOD;

ENERGY EFFICIENCY;

EID: 84986277729     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.605     Document Type: Conference Paper

References (38)

1. B. Allen, B. Curless, and Z. Popovíc. Articulated body deformation from range scan data. ACM Trans. Graphics, 21 (3): 612-619, 2002.
2. B. Allen, B. Curless, and Z. Popovíc. The space of human body shapes: reconstruction and parameterization from range scans. ACM Trans. Graphics, 22 (3): 587-594, 2003.
3. D. Anguelov, P. Srinivasan, D. Koller, S. Thrun, J. Rodgers, and J. Davis. SCAPE: Shape completion and animation of people. ACM Trans. Graphics, 24 (3): 408-416, 2005.
4. L. Ballan, A. Taneja, J. Gall, L. V. Gool, and M. Pollefeys. Motion capture of hands in action using discriminative salient points. In Proc. ECCV, pages 640-653, 2012.
5. M. Black and M. Loper. OpenDR: An approximate differentiable renderer. In Proc. ECCV, pages 154-169, 2014.
6. V. Blanz and T. Vetter. A morphable model for the synthesis of 3D faces. In Proc. SIGGRAPH, pages 187-194, 1999.
7. F. Bogo, M. J. Black, M. Loper, and J. Romero. Detailed full-body reconstructions of moving people from monocular RGB-D sequences. In Proc. ICCV, pages 2300-2308, 2015.
8. T. J. Cashman and A. W. Fitzgibbon. What shape are dolphins Building 3D morphable models from 2D images. IEEE Trans. PAMI, 35 (1): 232-244, 2013.
9. Y. Chen, Z. Liu, and Z. Zhang. Tensor-based human body modeling. In Proc. CVPR, pages 105-112, 2013.
10. M. de La Gorce, D. J. Fleet, and N. Paragios. Model-based 3D hand pose estimation from monocular video. IEEE Trans. PAMI, 33 (9): 1793-1805, 2011.
11. M. de La Gorce, N. Paragios, and D. J. Fleet. Model-based hand tracking with texture, shading and self-occlusions. In Proc. CVPR, pages 1-8, 2008.
12. A. Delaunoy and E. Prados. Gradient flows for optimizing triangular mesh-based surfaces: Applications to 3D reconstruction problems dealing with visibility. IJCV, 95 (2): 100-123, 2011.
13. N. Hasler, C. Stoll, M. Sunkel, B. Rosenhahn, and H.-P. Seidel. A statistical model of human pose and body shape. Computer Graphics Forum, 28 (2): 337-346, 2009.
14. D. A. Hirshberg, M. Loper, E. Rachlin, and M. J. Black. Coregistration: Simultaneous alignment and modeling of articulated 3D shape. In Proc. ECCV, pages 242-255, 2012.
15. C. Kanzow, N. Yamashita, and M. Fukushima. Levenberg-Marquardt methods with strong local convergence properties for solving nonlinear equations with convex constraints. Journal of Computational and Applied Mathematics, 172 (2): 375-397, 2004.
16. C. Keskin, F. Kirac, Y. E. Kara, and L. Akarun. Hand pose estimation and hand shape classification using multi-layered randomized decision forests. In Proc. ECCV, pages 852-863, 2012.
17. S. Khamis, J. Taylor, J. Shotton, C. Keskin, S. Izadi, and A. Fitzgibbon. Learning an efficient model of hand shape variation from depth images. In Proc. CVPR, pages 2540-2548, 2015.
18. H. Li, R. W. Sumner, and M. Pauly. Global correspondence optimization for non-rigid registration of depth scans. Computer Graphics Forum, 27 (5): 1421-1430, 2008.
19. M. Liao, Q. Zhang, H. Wang, R. Yang, and M. Gong. Modeling deformable objects from a single depth camera. In Proc. ICCV, pages 167-174, 2009.
20. C. T. Loop. Smooth subdivision surfaces based on triangles. Master's thesis, University of Utah, Aug. 1987.
21. M. Loper, N. Mahmood, J. Romero, G. Pons-Moll, and M. J. Black. SMPL: A skinned multi-person linear model. ACM Trans. Graphics, 34 (6): #248, 2015.
22. A. Makris and A. Argyros. Model-based 3D hand tracking with on-line hand shape adaptation. In Proc. BMVC, pages 77. 1-77. 12, 2015.
23. M. Oberweger, P. Wohlhart, and V. Lepetit. Hands deep in deep learning for hand pose estimation. In Proc. Computer Vision Winter Workshop (CVWW), 2015.
24. M. Oberweger, P. Wohlhart, and V. Lepetit. Training a feedback loop for hand pose estimation. In Proc. ICCV, pages 3316-3324, 2015. 3, 6, 7
25. I. Oikonomidis, N. Kyriazis, and A. Argyros. Efficient modelbased 3D tracking of hand articulations using Kinect. In Proc. BMVC, pages 101. 1-101. 11, 2011.
26. I. Oikonomidis, N. Kyriazis, and A. Argyros. Tracking the articulated motion of two strongly interacting hands. In Proc. CVPR, pages 1862-1869, 2012.
27. G. Poier, K. Roditakis, S. Schulter, D. Michel, H. Bischof, and A. A. Argyros. Hybrid one-shot 3D hand pose estimation by exploiting uncertainties. In Proc. BMVC, pages 182. 1-182. 14, 2015.
28. T. Sharp, C. Keskin, D. Robertson, J. Taylor, J. Shotton, D. Kim, C. Rhemann, I. Leichter, A. Vinnikov, Y. Wei, D. Freedman, P. Kohli, E. Krupka, A. Fitzgibbon, and S. Izadi. Accurate, robust, and flexible realtime hand tracking. In Proc. CHI, pages 3633-3642, 2015.
29. S. Sridhar, F. Mueller, A. Oulasvirta, and C. Theobalt. Fast and robust hand tracking using detection-guided optimization. In Proc. CVPR, pages 3213-3221, 2015.
30. S. Sridhar, H. Rhodin, H.-P. Seidel, A. Oulasvirta, and C. Theobalt. Real-time hand tracking using a sum of anisotropic Gaussians model. In Proc. 3DV, pages 319-326, 2014.
31. J. S. Supancic III, G. Rogez, Y. Yang, J. Shotton, and D. Ramanan. Depth-based hand pose estimation: data, methods, and challenges. In Proc. ICCV, pages 1868-1876, 2015.
32. A. Tagliasacchi, M. Schröder, A. Tkach, S. Bouaziz, M. Botsch, and M. Pauly. Robust articulated-ICP for real-time hand tracking. Computer Graphics Forum, 34 (5): 101-114, 2015.
33. D. Tang, J. Taylor, P. Kohli, C. Keskin, T.-K. Kim, and J. Shotton. Opening the black box: Hierarchical sampling optimization for estimating human hand pose. In Proc. ICCV, pages 3325-3333, 2015.
34. J. Taylor, L. Bordeaux, T. Cashman, B. Corish, C. Keskin, T. Sharp, E. Soto, D. Sweeney, J. Valentin, B. Luff, A. Topalian, E. Wood, S. Khamis, P. Kohli, S. Izadi, R. Banks, A. Fitzgibbon, and J. Shotton. Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. In Proc. SIGGRAPH, 2016. To appear.
35. J. Taylor, R. Stebbing, V. Ramakrishna, C. Keskin, J. Shotton, S. Izadi, A. Hertzmann, and A. Fitzgibbon. User-specific hand modeling from monocular depth sequences. In Proc. CVPR, pages 644-651, 2014.
36. J. Tompson, M. Stein, Y. LeCun, and K. Perlin. Real-time continuous pose recovery of human hands using convolutional networks. ACM Trans. Graphics, 33 (5): #169, 2014.
37. A. Tsoli, N. Mahmood, and M. J. Black. Breathing life into shape: capturing, modeling and animating 3D human breathing. ACM Trans. Graphics, 33 (4): #52, 2014.
38. M. Ye and R. Yang. Real-time simultaneous pose and shape estimation for articulated objects using a single depth camera. In Proc. CVPR, pages 2353-2360, 2014.