Video-based hand manipulation capture through composite motion control

ACM Transactions on Graphics

Volumn 32, Issue 4, 2013, Pages

  Wang, Yangang ^a   Min, Jianyuan ^b   Zhang, Jianjie ^b   Liu, Yebin ^a   Xu, Feng ^a   Dai, Qionghai ^a   Chai, Jinxiang ^b  

^a TSINGHUA UNIVERSITY   (China)

^b TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Hand grasping and manipulation; Hand tracking; Motion capture; Motion control; Physics based simulation

Indexed keywords

DEXTEROUS MANIPULATION; HAND GRASPING; HAND MOTION TRACKING; HAND TRACKING; MOTION CAPTURE; MULTIPLE VIDEO STREAMS; OPTIMIZATION FRAMEWORK; PHYSICS-BASED SIMULATION;

MOTION CONTROL; OPTIMIZATION; VIDEO STREAMING;

DIGITAL STORAGE;

EID: 84880774541     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2461912.2462000     Document Type: Article

References (32)

1. ATHITSOS, V., AND SCLAROFF, S. 2003. Estimating 3d hand pose from a cluttered image. In Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, CVPR '03, 432-439.
2. BALLAN, L., TANEJA, A., GALL, J., GOOL, L. V., AND POLLEFEYS, M. 2012. Motion capture of hands in action using discriminative salient points. In European Conference on Computer Vision (ECCV), 640-653.
3. BRUBAKER, M. A., AND FLEET, D. J. 2008. The Kneed Walker for human pose tracking. In Proceedings of IEEE CVPR, 1-9.
4. CANNY, J. 1986. A computational approach to edge detection. IEEE Trans. Pattern Analysis and Machine Intelligence. 8(6): 679-698.
5. COTTLE, R., PANG, J., AND STONE, R. 2009. The linear complementarity problem. Society for Industrial Mathematics.
6. CYBERGLOVE, 2012. http://www.cyberglovesystems.com/.
7. DE LA GORCE, M., FLEET, D. J., AND PARAGIOS, N. 2011. Model-based 3d hand pose estimation from monocular video. In IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, 1793-1805.
8. DEBEVEC, P., YU, Y., AND BORSHUKOV, G. 1998. Efficient view-dependent image-based rendering with projective texturemapping. In 9th Eurographics Rendering Workshop, Springer.
9. GALL, J., ROSENHAHN, B., AND SEIDEL, H.-P. 2008. Human motion - understanding, modeling, capture and animation. Computational Imaging and Vision. 36: 319-345.
10. HOYET, L., RYALL, K., MCDONNELL, R., AND O'SULLIVAN, C. 2012. Sleight of hand: perception of finger motion from reduced marker sets. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D '12, 79-86.
11. KRY, P. G., AND PAI, D. K. 2006. Interaction capture and synthesis. ACM Trans. Graph. 25, 3, 872-880.
12. LEE, S.-H., AND GOSWAMI, A. 2010. Ground reaction force control at each foot: A momentum-based humanoid balance controller for non-level and non-stationary ground. In Intelligent Robots and Systems (IROS), 2010 IEEE/RSJ International Conference on, IEEE, 3157-3162.
13. LIU, L., YIN, K., VAN DE PANNE, M., SHAO, T., AND XU, W. 2010. Sampling-based contact-rich motion control. ACM Trans. Graph. 29, 4, 128:1-128:10.
14. LIU, C. K. 2008. Synthesis of interactive hand manipulation. In Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA '08, 163-171.
15. LIU, C. K. 2009. Dextrous manipulation from a grasping pose. ACM Trans. Graph. 28, 3, 59:1-59:6.
16. OIKONOMIDIS, I., KYRIAZIS, N., AND ARGYROS, A. A. 2011. Full dof tracking of a hand interacting with an object by modeling occlusions and physical constraints. In Proceedings of IEEE International Conference on Computer Vision (ICCV), 2088-2095.
17. PALMER, J. A., KREUTZ-DELGADO, K., AND MAKEIG, S. 2006. Super-gaussian mixture source model for ica. In Independent Component Analysis and Blind Signal Separation. Springer, 854-861.
18. POLLARD, N. S., AND ZORDAN, V. B. 2005. Physically based grasping control from example. In Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation, SCA '05, 311-318.
19. REHG, J., AND KANADE, T. 1995. Model-based tracking of selfoccluding articulated objects. In Proceedings of the Fifth IEEE International Conference on Computer Vision, ICCV '95, 612-617.
20. ROMERO, J., KJELLSTROM, H., AND KRAGIC, D. 2010. Hands in action: real-time 3d reconstruction of hands in interaction with objects. In IEEE International Conference on Robotics and Automation (ICRA), 458-463.
21. SUEDA, S., KAUFMAN, A., AND PAI, D. K. 2008. Musculotendon simulation for hand animation. ACM Trans. Graph. 27, 3, 83:1-83:8.
22. TSANG, W., SINGH, K., AND FIUME, E. 2005. Helping hand: an anatomically accurate inverse dynamics solution for unconstrained hand motion. In Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation, ACM, 319-328.
23. VICON SYSTEMS, 2012. http://www.vicon.com.
24. VONDRAK, M., SIGAL, L., AND JENKINS, O. C. 2008. Physical simulation for probabilistic motion tracking. In IEEE Conference on Computer Vision and Pattern Recognition, 1-8.
25. VONDRAK, M., SIGAL, L., HODGINS, J., AND JENKINS, O. 2012. Video-based 3d motion capture through biped control. ACM Trans. Graph. 31, 4 (July), 27:1-27:12.
26. WANG, R. Y., AND POPOVIĆ, J. 2009. Real-time hand-tracking with a color glove. ACM Trans. Graph. 28, 3, 63:1-63:8.
27. WEI, X., AND CHAI, J. 2010. Videomocap: modeling physically realistic human motion from monocular video sequences. ACM Trans. Graph. 29, 4 (July), 42:1-42:10.
28. WU, Y., LIN, J., AND HUANG, T. S. 2001. Capturing natural hand articulation. In Proceedings of IEEE International Conference on Computer Vision (ICCV), 426-432.
29. YE, Y., AND LIU, C. K. 2012. Synthesis of detailed hand manipulations using contact sampling. ACM Trans. Graph. 31, 4 (July), 41:1-41:10.
30. ZHANG, Z. 1999. Flexible camera calibration by viewing a plane from unknown orientations. In Proceedings of the International Conference on Computer Vision. 666-673.
31. ZHAO, W., CHAI, J., AND XU, Y.-Q. 2012. Combining marker-based mocap and rgb-d camera for acquiring highfidelity hand motion data. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA '12, 33-42.
32. ZHOU, H., AND HUANG, T. S. 2003. Tracking articulated hand motion with eigen dynamics analysis. In Proceedings of the Ninth IEEE International Conference on Computer Vision, ICCV '03, 1102-1109.