Real-time hand-tracking with a color glove

ACM Transactions on Graphics

Volumn 28, Issue 3, 2009, Pages

  Wang, Robert Y ^a   Popović, Jovan ^a,b,c  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b ADOBE RESEARCH   (United States)

^c UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Augmented reality; Hand tracking; Motion capture; User interface

Indexed keywords

ANIMATION CONTROL; CONSUMER APPLICATIONS; HAND TRACKING; INTERACTIVE RATES; MOTION CAPTURE; NEAREST-NEIGHBOR APPROACHES; POSE ESTIMATION; PROOF OF CONCEPT; SINGLE CAMERAS; TRACKING SYSTEM;

ANIMATION; AUGMENTED REALITY; THREE DIMENSIONAL; USER INTERFACES;

VIRTUAL REALITY;

EID: 70349684622     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1531326.1531369     Document Type: Conference Paper

References (40)

1. AGRAWALA, M., BEERS, A. C., FRÖHLICH, B., HANRAHAN, P. M., MCDOWALL, I., AND BOLAS, M. 1997. The two-user responsive workbench: Support for collaboration through independent views of a shared space. In Proceedings of SIGGRAPH 97, 327-332.
2. ATHITSOS, V., AND SCLAROFF, S. 2003. Estimating 3D hand pose from a cluttered image. In Computer Vision and Pattern Recognition (CVPR), vol.2, 432-439.
3. ATHITSOS, V., ALON, J., SCLAROFF, S., AND KOLLIOS, G. 2004. BoostMap: A method for efficient approximate similarity rankings. In Computer Vision and Pattern Recognition (CVPR), vol.2, 268-275.
4. BARNES, C., JACOBS, D. E., SANDERS, J., GOLDMAN, D. B., RUSINKIEWICZ, S., FINKELSTEIN, A., AND AGRAWALA, M. 2008. Video puppetry: a performative interface for cutout animation. ACM Transactions on Graphics 27, 5, 1-9.
5. BENKO, H., ISHAK, E., AND FEINER, S. 2005. Cross- Dimensional Gestural Interaction Techniques for Hybrid Immersive Environments. In IEEE Virtual Reality Conference, 209-216.
6. CHONG, H. Y., GORTLER, S. J., AND ZICKLER, T. 2008. A perception-based color space for illumination-invariant image processing. ACM Transactions on Graphics 27, 3, 1-7.
7. DE LA GORCE, M., PARAGIOS, N., AND FLEET, D. 2008. Model-Based Hand Tracking with Texture, Shading and Self- occlusions. In Computer Vision and Pattern Recognition (CVPR), 1-8.
8. DEWAELE, G., DEVERNAY, F., HORAUD, R. P., AND FORBES, F. 2006. The alignment between 3-d data and articulated shapes with bending surfaces. In European Conference on Computer Vision (ECCV), 578-591.
9. DHAWALE, P., MASOODIAN, M., AND ROGERS, B. 2006. Barehand 3D gesture input to interactive systems. In New Zealand Chapter's International Conference on Computer-Human Interaction: Design Centered HCI (CHINZ), 25-32.
10. DONTCHEVA, M., YNGVE, G., AND POPOVÍC , Z. 2003. Layered acting for character animation. ACM Transactions on Graphics 22, 3, 409-416.
11. DORNER, B. 1994. Chasing the Colour Glove: Visual Hand Tracking. Master's thesis, Simon Fraser University.
12. GROSSMAN, T., WIGDOR, D., AND BALAKRISHNAN, R. 2004. Multi-finger gestural interaction with 3d volumetric displays. In User Interface Software and Technology (UIST), 61-70.
13. GUSKOV, I., KLIBANOV, S., AND BRYANT, B. 2003. Trackable surfaces. In Symposium on Computer Animation (SCA), 251-257.
14. KEEFE, D. F., KARELITZ, D. B., VOTE, E. L., AND LAIDLAW, D. H. 2005. Artistic collaboration in designing vr visualizations. IEEE Computer Graphics and Applications 25, 2, 18-23.
15. KERSTEN, D., MAMASSIAN, P., AND KNILL, D. 1997. Moving cast shadows induce apparent motion in depth. Perception 26, 2, 171-192.
16. KRY, P., AND PAI, D. 2006. Interaction capture and synthesis. ACM Transactions on Graphics 25, 3, 872-880.
17. KRY, P., PIHUIT, A., BERNHARDT, A., AND CANI, M. 2008. HandNavigator: hands-on interaction for desktop virtual reality. In Virtual Reality Software and Technology (VRST), 53-60.
18. LAM, W., ZOU, F., AND KOMURA, T. 2004. Motion editing with data glove. In International Conference on Advances in Computer Entertainment Technology, 337-342.
19. LEE, C.-S., GHYME, S.-W., PARK, C.-J., AND WOHN, K. 1998. The control of avatar motion using hand gesture. In Virtual Reality Software and Technology (VRST), 59-65.
20. LI, Y., FU, J. L., AND POLLARD, N. S. 2007. Data-driven grasp synthesis using shape matching and task-based pruning. IEEE Transactions Visualization and Computer Graphics 13, 4, 732-747.
21. OLWAL, A., BENKO, H., AND FEINER, S. 2003. Senseshapes: Using statistical geometry for object selection in a multimodal augmented reality system. In International Symposium on Mixed and Augmented Reality (ISMAR), 300.
22. PARK, J., AND YOON, Y. 2006. LED-glove based interactions in multi-modal displays for teleconferencing. In International Conference on Artificial Reality and Telexistence-Workshops (ICAT), 395-399.
23. POLLARD, N., AND ZORDAN, V. 2005. Physically based grasping control from example. In Symposium on Computer Animation (SCA), 311-318.
24. REN, L., SHAKHNAROVICH, G., HODGINS, J., PFISTER, H., AND VIOLA, P. 2005. Learning silhouette features for control of human motion. ACM Transactions on Graphics 24, 4, 1303-1331.
25. SCHLATTMAN, M., AND KLEIN, R. 2007. Simultaneous 4 gestures 6 dof real-time two-hand tracking without any markers. In Virtual Reality Software and Technology (VRST), 39-42.
26. SCHOLZ, V., STICH, T., KECKEISEN, M., WACKER, M., AND MAGNOR, M. A. 2005. Garment motion capture using colorcoded patterns. Computer Graphics Forum 24, 3, 439-447.
27. SHAKHNAROVICH, G., VIOLA, P., AND DARRELL, T. 2003. Fast pose estimation with parameter-sensitive hashing. In International Conference on Computer Vision (ICCV), 750-757.
28. SHENG, J., BALAKRISHNAN, R., AND SINGH, K. 2006. An interface for virtual 3d sculpting via physical proxy. In Computer Graphics and Interactive Techniques in Australasia and Southeast Asia (GRAPHITE), 213-220.
29. SHIRATORI, T., AND HODGINS, J. K. 2008. Accelerometer-based user interfaces for the control of a physically simulated character. ACM Transactions on Graphics 27, 5, 1-9.
30. STARNER, T., WEAVER, J., AND PENTLAND, A. 1998. Real-time American sign language recognition using desk and wearable computer based video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1371-1375.
31. STENGER, B., THAYANANTHAN, A., TORR, P., AND CIPOLLA, R. 2006. Model-based hand tracking using a hierarchical bayesian filter. IEEE Transactions Pattern Analysis and Machine Intelligence 28, 9, 1372-1384.
32. STURMAN, D. J., AND ZELTZER, D. 1993. A design method for "whole-hand" human-computer interaction. ACM Transactions on Information Systems 11, 3, 219-238.
33. SUDDERTH, E. B., MANDEL, M. I., FREEMAN, T., AND WILLSKY, S. 2004. Distributed occlusion reasoning for tracking with nonparametric belief propagation. In Neural Information Processing Systems (NIPS), 1369-1376.
34. THEOBALT, C., ALBRECHT, I., HABER, J., MAGNOR, M., AND SEIDEL, H.-P. 2004. Pitching a baseball - tracking highspeed motion with multi-exposure images. ACM Transactions on Graphics 23, 3, 540-547.
35. TORRALBA, A., FERGUS, R., AND FREEMAN, W. T. 2007. Tiny images. Tech. Rep. MIT-CSAIL-TR-2007-2024, Computer Science and Artificial Intelligence Lab, MIT.
36. TORRALBA, A., FERGUS, R., AND WEISS., Y. 2008. Small codes and large databases for recognition. In Computer Vision and Pattern Recognition (CVPR), vol.2, 1-8.
37. WESCHE, G., AND SEIDEL, H.-P. 2001. Freedrawer: a freeform sketching system on the responsive workbench. In Virtual Reality Software and Technology (VRST), 167-174.
38. WHITE, R., AND FORSYTH, D. 2005. Deforming objects provide better camera calibration. Tech. Rep. UCB/EECS-2005-2013, EECS Department, University of California, Berkeley.
39. WHITE, R., CRANE, K., AND FORSYTH, D. A. 2007. Capturing and animating occluded cloth. ACM Transactions on Graphics 26, 3, 34:1-34:8.
40. WILSON, A., IZADI, S., HILLIGES, O., GARCIA-MENDOZA, A., AND KIRK, D. 2008. Bringing physics to the surface. In User Interface Software and Technology (UIST), 67-76.