Design and implementation of a flexible hand gesture command interface for games based on computer vision

SBGAMES2009 - 8th Brazilian Symposium on Games and Digital Entertainment

Volumn , Issue , 2009, Pages 64-73

  Bernardes, Joao ^a   Nakamura, Ricardo ^a   Tori, Romero ^a  

^a UNIVERSITY OF SÃO PAULO   (Brazil)

Author keywords

Computer vision; Electronic games; Gesture recognition; Humancomputer interaction

Indexed keywords

COMMAND INTERFACES; ELECTRONIC GAMES; HAND GESTURE; NO SENSOR; SYSTEM USE;

COMPUTER VISION;

GESTURE RECOGNITION;

EID: 77954401680     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SBGAMES.2009.16     Document Type: Conference Paper

References (39)

1. D. Bowman, E. Kruijff, J. LaViola, and I. Poupyrev, 3D User Interface: Theory and Practice. Addison-Wesley, 2005.
2. T. Starner, B. Leibe, B. Singletary, and J. Pair, "Mind-warping: towards creating a compelling collaborative augmented reality game", Proc. of the 5th international conference on Intelligent user interfaces (IUI '00), ACM, 2000, pp. 256-259, doi:10.1145/325737.325864.
3. J. Bernardes, R. Tori, R. Nakamura, D. Calife, and A. Tomoyose, "Augmented Reality Games", Extending Experiences: Structure, analysis and design of computer game player experience, L. Olli, H. Wirman, and A. Fernandez eds., Lapland University Press, 2008, p. 228-246.
4. Novint Falcon, Available from: http://home.novint.com/products/novint- falcon.php [Accessed 14 January 2010].
5. V. Dobnik, "Surgeons may err less by playing video games", 2004, Available from: http://www.msnbc.msn.com/id/4685909 [Accessed 14 January 2010].
6. B. Kane, "Beyond the Gamepad panel session", Available from: http://www.gamasutra.com/features/20050819/kane-01.shtml [Accessed 14 January 2010].
7. AiLive, "LiveMove White Paper", 2007, Available from: http://www.ikuni.com/papers/LiveMoveWhitePaper-en.pdf [Accessed 14 January 2010].
8. M. Snider, "Microsoft unveils hands-free gaming", USA Today, 1 June 2009, Available from: http://www.usatoday.com/tech/gaming/2009-06-01-hands- free-microsoft-N.htm [Accessed 14 January 2010].
9. E. Tse, S. Greenberg, C. Shen, and C. Forlines, "Multimodal multiplayer tabletop gaming", ACM Comput. Entertain. vol 5(2), 2007, doi:10.1145/1279540.1279552.
10. S. LAAKSO, and M. LAAKSO, "Design of a Body-Driven Multiplayer Game System", ACM Comput. Entertain. vol 4(4), 2006. doi:10.1145/1178418. 1178429.
11. J. Hoysniemi, P. Hamalainen, L. Turkki, and T. Rouvi, "Children's intuitive gestures in vision-based action games", Commun. ACM vol 48(1), Jan. 2005, pp. 44-50, doi:10.1145/1039539.1039568.
12. M. Isard, and A. Blake, "ICondensation: Unifying low-level and high-level tracking in a stochastic framework", Proc. 5th European Conf. Computer Vision, 1998.
13. M. Kölsch , M. Turk , T. Hollerer , and J. Chainey, "Vision-based Interfaces for Mobility", Intl. Conference on Mobile and Ubiquitous Systems (MobiQuitous), 2004.
14. K. Lyons, H. Brashear, T. Westeyn, J. Kim, and T. Starner, "GART: The Gesture and Activity Recognition Toolkit", HCI Intelligent Multimodal Interaction Environments, Springer, 2007, pp. 718-727, doi:10.1007/978-3-540- 73110-8-78.
15. A. Camurri, B. Mazzarino, and G. Volpe, "Analysis of Expressive Gesture: The EyesWeb Expressive Gesture Processing Library", Gesture-Based Communication in Human-Computer Interaction, Springer, 2004, pp. 469-470.
16. V. Pavlovic, R. Sharma, and T. Huang, "Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review", IEEE Trans. Pattern Anal. Mach. Intell. vol 19(7), July 1997, pp. 677-695, doi:10.1109/34.598226.
17. S. Mitra, and T. Acharya, "Gesture Recognition: A Survey", IEEE Trans. Systems, Man, and Cybernetics, Part C: Applications and Reviews vol 37(3) , May 2007, pp.311-324.
18. A. Erol, G. Bebis, M. Nicolescu, R. Boyle, and X. Twombly, "A Review on Vision-Based Full DOF Hand Motion Estimation", Proc. 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops - vol. 3 (CVPR '05), IEEE press, 2005, pp. 75-82, doi:10.1109/CVPR. 2005.395.
19. B. Shneiderman, Designing the User Interface: Strategies for Effective Human-Computer Interaction, 3rd ed.. Addison-Wesley, 1998.
20. D. Mapes, and J. Moshel, "A Two Handed Interface for Object Manipulation in Virtual Environments", Presence: Teleoperators and Virtual Environments vol. 4(4), 1995, pp. 403-416.
21. T. Fritsch, H. Ritter, and J. Schiller, "The effect of latency and network limitations on MMORPGs: a field study of everquest2", Proc. 4th ACM SIGCOMM workshop on Network and system support for games (NetGames '05), ACM, 2005, doi:10.1145/1103599.1103623
22. G. Miller, "The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information", The Psychological Review vol. 63, pp. 81-97.
23. M. Bernal-Merino, "Localization and the Cultural Concept of Play", 2007, Available from: http://www.gamecareerguide.com/features/454/ localization-and-the-cultural.php [Accessed 14 January 2010].
24. T. Hong, "Shoot to Thrill", Game Developer vol. 15(9), 2008, pp. 21-28.
25. T. Henderson, and S. Bhatti, "Networked games: a QoS-sensitive application for QoS-insensitive users?" Proc. ACM SIGCOMM workshop on Revisiting IP QoS: What have we learned, why do we care? (RIPQoS '03), ACM, 2003, pp. 141-147, doi:10.1145/944592.944601
26. S. Liddell, and R. Johnson, "American Sign Language: The Phonological Base", Sign Language Studies vol. 64, 1989, pp. 195-277.
27. OpenCV, Available from: http://sourceforge.net/projects/opencvlibrary/ [Accessed 14 January 2010].
28. B. Eckel, Thinking in C++. Prentice Hall, 2003.
29. M. Fleck, and D. Forsyth, "Naked people Skin Filter", Available from: http://www.cs.hmc.edu/~fleck/naked-skin.html [Accessed 14 January 2010].
30. J. Viggiano, "Comparison of the accuracy of different white-balancing options as quantified by their color constancy", Proc. Sensors and Camera Systems for Scientific, Industrial, and Digital Photography Applications V, 2004, pp. 323-333.
31. T. Yoon, K. Kim, J. Lee, D. Kim, and C. Song, "Image Segmentation of Human Forearms in Infrared Image", 28th Annual Int. Conf. IEEE Engineering in Medicine and Biology Society (EMBS '06), 2006, pp.2762-2765.
32. Y. Wu, and T. Huang, "Capturing articulated human hand motion: a divide-and-conquer approach", Proc. Seventh IEEE Int. Conf. Computer Vision, 1999, pp. 606-611.
33. A. Imai, N. Shimada, and Y. Shirai, "3-D hand posture recognition by training contour variation", Proc. Sixth IEEE Int. Conf. Automatic Face and Gesture Recognition, 2004, pp. 895-900.
34. N. Shimada, K. Kimura, and Y. Shirai, "Real-Time 3-D Hand Posture Estimation Based on 2-D Appearance Retrieval Using Monocular Camera", Proc. IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems (RATFGRTS' 01), 2001.
35. J. Mammen, S. Chaudhuri, and T. Agrawal, "Simultaneous tracking of both hands by estimation of erroneous observations", Proc. British Machine Vision Conference, 2001.
36. Logix4U, "Inpout32.dll for Windows 98/2000/NT/XP", Available from: http://logix4u.net/Legacy-Ports/Parallel-port/inpout32.dll-for-Windows-98/ 2000/NT/XP.html [Accessed 14 January 2010].
37. Y. Liu, and Y. Jia, "A Robust Hand Tracking and Gesture Recognition Method for Wearable Visual Interfaces and its Applications", Proc. Third Int. Conf. on Image and Graphics (ICIG '04), 2004, pp. 472-475, doi:10.1109/ICIG.2004.24
38. R. de Bem, and A. Costa, "Rastreamento visual de múltiplos objetos utilizando uma abordagem livre de modelo", Proc. XVI Congresso Brasileiro de Automática, pp. 2760-2765.
39. R. Nakamura, and R. Tori, "Improving Collision Detection for Real-Time Video Avatar Interaction", Proc. X Symp. on Virtual and Augmented Reality, pp. 105-114.