Vision-based 3D finger interactions for mixed reality games with physics simulation

Proceedings of The 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry, VRCAI 2008

Volumn , Issue , 2008, Pages

  Song, Peng ^a   Yu, Hang ^a   Winkler, Stefan ^b  

^a INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^b Symmetricom   (United States)

Author keywords

Finger interaction; Finger tracking; Mixed reality; Physics simulation

Indexed keywords

3-D SPACE; FINGER INTERACTION; FINGER TRACKING; GESTURE-BASED INTERFACE; IMMERSIVE; INTERACTION EXPERIENCES; INTERACTIVE INTERFACES; MIXED REALITY; MIXED REALITY GAME; MIXED REALITY INTERFACES; MOUSE INPUT; PHYSICAL CHARACTERISTICS; PHYSICS ENGINE; PHYSICS SIMULATION; REAL ENVIRONMENTS; REAL-WORLD OBJECTS; STEREO CAMERAS; TOWER BUILDING; USER STUDY; VIRTUAL OBJECTS; VISION BASED;

FISHERIES; GAME THEORY; INTERACTIVE COMPUTER GRAPHICS; THREE DIMENSIONAL;

VIRTUAL REALITY;

EID: 70349092999     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1477862.1477871     Document Type: Conference Paper

References (25)

1. AUDET, S., BEDROSIAN, M., CLEMENT, C., AND DINCULESCU, M., 2006. MulTetris: A test of graspable user interfaces in collaborative games. Course project, McGill University, Canada.
2. BILLINGHURST, M., KATO, H., AND POUPYREV, I. 2001. The MagicBook: Moving seamlessly between reality and virtuality. IEEE Comput. Graph. Appl. 21, 3, 6-8.
3. BULLET. Bullet continuous collision detection and physics library. http://www.continuousphysics.com/Bullet/.
4. CHEOK, A. D., GOH, K. H., LIU, W., FARBIZ, F., FONG, S. W., TEO, S. L., LI, Y., AND YANG, X. 2004. Human pacman: a mobile, wide-area entertainment system based on physical, social, and ubiquitous computing. Personal Ubiquitous Comput. 8, 2, 71-81.
5. CROWLEY, J., BÉRARD, F., AND COUTAZ, J. 1995. Finger tracking as an input device for augmented reality. In Proc. International Conference on Automatic Face and Gesture Recognition.
6. HARDENBERG, C., AND BRARD, F. 2001. Bare-hand human computer interaction. In Proc. Perceptual User Interfaces.
7. HAVOK. Havok physics. http://www.havok.com/.
8. ISHII, H., AND ULLMER, B. 1997. Tangible bits: Towards seamless interfaces between people, bits and atoms. In Proceedings of CHI'97 Conference on Human Factors in Computing systems, 234-241.
9. LAPTEV, I., AND LINDEBERG, T. 2000. Tracking of multi-state hand models using particle filtering and a hierarchy of multi-scale image features. In Technical Report ISRN KTH/NA/P-00/12-SE, The Royal Institute of Technology (KTH).
10. LEE, S. Y., KIM, I. J., AND AHN, S. C., 2006. Real-time 3d video avatar for tangible interface. TSI workshop.
11. LIEN, C., AND HUANG, C. 1998. Model-based articulated hand motion tracking for gesture recognition. Image and Vision Computing 16, 2, 121-134.
12. MIKADO GAME. http://www.allwag.co.uk/ detail861700Mikado-Game.aspx.
13. NEWTON PHYSICS ENGINE. A free win32 physics engine. http://www.physicsengine.com/.
14. NIELSEN, R., DELMAN, T. F., AND LOSSING, T. 2005. A mixed reality game for urban planning. In Proceedings of Computers in Urban Planning and Urban Management.
15. ODE. Open dynamics engine. http://www.ode.org/.
16. REHG, J., AND KANADE, T. 1993. Digiteyes: Vision-based 3D human hand tracking. In Technical Report CMU-CS-93-220.
17. SATO, Y., KOBAYASHI, Y., AND KOIKE, H. 2000. Fast tracking of hands and fingertips in infrared images for augmented desk interface. In Proc. International Conference on Automatic Face and Gesture Recognition.
18. SEGEN, J. 1998. Gesture VR: Vision-based 3D hand interface for spatial interaction. In Proc. ACM Multimedia Conference.
19. SONG, P., WINKLER, S., GILANI, S., AND ZHOU, Z. 2007. Vision-based projected tabletop interface for finger interactions. In Human-Computer Interaction, IEEE International Workshop, HCI 2007, Proceedings, 49-58.
20. THOMAS, B., CLOSE, B., DONOGHUE, J., SQUIRES, J., BONDI, P. D., AND PIEKARSKI, W. 2002. First person indoor/outdoor augmented reality application: Arquake. Personal and Ubiquitous Computing 6, 1, 75-86.
21. TOKAMAK GAME PHYSICS. http://www. tokamakphysics.com/.
22. TRIESCH, J., AND MALSBURG, C. 1996. Robust classification of hand postures against complex background. In Proc. International Conference On Automatic Face and Gesture Recognition.
23. URAY, P., KIENZL, D. T., AND MARSCHE, D. U. 2006. MRI: a mixed reality interface for the masses. In ACM SIGGRAPH Emerging technologies, 24.
24. WANDERLEY, I., KELNER, J., COSTA, N., AND TEICHRIEB, V. 2006. A survey of interaction in mixed reality systems. In Symposium on Virtual Reality, 1-4.
25. WINKLER, S., YU, H., AND ZHOU, Z. Y. 2007. Tangible mixed reality desktop for digital media management. In SPIE The Engineering Reality of Virtual Reality, vol. 6490B.