gRmobile: A framework for touch and accelerometer gesture recognition for mobile games

SBGAMES2009 - 8th Brazilian Symposium on Games and Digital Entertainment

Volumn , Issue , 2009, Pages 141-150

  Joselli, Mark ^a   Clua, Esteban ^a  

^a IC UFF   (Brazil)

Author keywords

Gesture recognition; Mobile games; Motion sensors; Tangible user interfaces; Touch phones

Indexed keywords

BRUTE FORCE; COMPLEX PATTERN; GAME DESIGN; HIDDEN MARKOV FIELDS; MOBILE APPLICATIONS; MOBILE GAMES; MOBILE PHONE GAMES; MOTION SENSORS; NEW FORMS; TANGIBLE USER INTERFACES; USER INPUT; USER INTERACTION;

ACCELEROMETERS; FUZZY LOGIC; FUZZY NEURAL NETWORKS; HIDDEN MARKOV MODELS; MOBILE DEVICES; MOBILE PHONES; MOBILE TELECOMMUNICATION SYSTEMS; SENSORS; TELEPHONE; TELEPHONE SETS; USER INTERFACES;

GESTURE RECOGNITION;

EID: 77954397523     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SBGAMES.2009.24     Document Type: Conference Paper

References (47)

1. M. Joselli, M. Zamith, L. Valente, E. W. G. Clua, A. Montenegro, A. Conci, and P. Feij, Pagliosa, "An adaptative game loop architecture with automatic distribution of tasks between cpu and gpu," Proceedings of the VII Brazilian Symposium on Computer Games and Digital Entertainment, pp. 115-120, 2008.
2. F. Chehimi, P. Coulton, and R. Edwards, "Evolution of 3d mobile games development," Personal Ubiquitous Comput., vol. 12, no. 1, pp. 19-25, 2008.
3. M1ndLab, "Alien revolt: Location-based massive-multiplayer online rpg." Avalible at: http://www.alienrevolt.com, 2007.
4. A. De Souza E Silva, "Hybrid reality and location-based gaming: Redefining mobility and game spaces in urban environments," Simul. Gaming, vol. 40, no. 3, pp. 404-424, 2009.
5. M. J. Zyda, D. Thukral, J. C. Ferrans, J. Engelsma, and M. Hans, "Enabling a voice modality in mobile games through voicexml," in Sandbox '08: Proceedings of the 2008 ACM SIGGRAPH symposium on Video games, Sandbox. New York, NY, USA: ACM, 2008, pp. 143-147.
6. F. Chehimi and P. Coulton, "Motion controlled mobile 3d multiplayer gaming," in ACE '08: Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology, ACE. New York, NY, USA: ACM, 2008, pp. 267-270.
7. A. Park and K. Jung, "Flying cake: Augmented game on mobile devices," Comput. Entertain., vol. 7, no. 1, pp. 1-19, 2009.
8. M. Rohs, "Marker-Based Embodied Interaction for Handheld Augmented Reality Games," Journal of Virtual Reality and Broadcasting, vol. 4, no. 5, Mar. 2007, urn:nbn:de:0009-6-7939, ISSN 1860-2037.
9. M. Zyda, D. Thukral, S. Jakatdar, J. Engelsma, J. Ferrans, M. Hans, L. Shi, F. Kitson, and V. Vasudevan, "Educating the next generation of mobile game developers," IEEE Computer Graphics and Applications, vol. 27, no. 2, pp. 96, 92-95, 2007.
10. E. M. I. Koivisto, "Mobile games 2010," in CyberGames '06: Proceedings of the 2006 international conference on Game research and development, CyberGames. Murdoch University, Australia, Australia: Murdoch University, 2006, pp. 1-2.
11. E. Oliver, "A survey of platforms for mobile networks research," SIGMOBILE Mob. Comput. Commun. Rev., vol. 12, no. 4, pp. 56-63, 2008.
12. J. O. B. Soh and B. C. Y. Tan, "Mobile gaming," Commun. ACM, vol. 51, no. 3, pp. 35-39, 2008.
13. Gartner, "Gartner says worldwide mobile gaming revenue to grow 50 percent in 2007," Avalible at: http://www.gartner.com/it/page.jsp?id= 507467, 2007.
14. P. Gilbertson, P. Coulton, F. Chehimi, and T. Vajk, "Using "tilt" as an interface to control "no-button" 3-d mobile games," Comput. Entertain., vol. 6, no. 3, pp. 1-13, 2008.
15. F. Nokia, "Turn limitation into strength: Design one-button games," Nokia, Tech. Rep., 2006. [Online]. Available: http://sw.nokia.com/ id/8dff4326-3979-4149-96c0-5fa95a14a3cb/Turn-Limitationin-to-Strength-Design- One-Button-Games-v1-0-en.pdf
16. J. Delgado, M. Joselli, S. Stanzani, S. M. Sadjadi, E. Clua, and H. Alvarez, "A learning and collaboration platform based on sage," in WCCCE '09: Proceedings of the 14th Western Canadian Conference on Computing Education. New York, NY, USA: ACM, 2009, pp. 70-76.
17. J. O. Wobbrock, A. D. Wilson, and Y. Li, "Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes," in UIST '07: Proceedings of the 20th annual ACM symposium on User interface software and technology, UIST. New York, NY, USA: ACM, 2007, pp. 159-168.
18. L. Anderson, D. J. Purdy, and W. Viant, "Variations on a fuzzy logic gesture recognition algorithm," in ACE '04: Proceedings of the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology, ACE. New York, NY, USA: ACM, 2004, pp. 280-283.
19. J. Mena-Chalco, H. Carrer, Y. Zana, and R. M. Cesar Jr., "Identification of protein coding regions using the modified gabor-wavelet transform," IEEE/ACM Trans. Comput. Biol. Bioinformatics, vol. 5, no. 2, pp. 198-207, 2008.
20. T. Westeyn, H. Brashear, A. Atrash, and T. Starner, "Georgia tech gesture toolkit: supporting experiments in gesture recognition," in ICMI '03: Proceedings of the 5th international conference on Multimodal interfaces, ICMI. New York, NY, USA: ACM, 2003, pp. 85-92.
21. Z. Prekopcsák, P. Halácsy, and C. Gáspár- Papanek, "Accelerometer based real-time gesture recognition," in Proceedings of the 12th International Student Conference on Electrical Engineering. International Student Conference on Electrical Engineering, 2008.
22. D. King, W. B. Lyons, C. Flanagan, and E. Lewis, "Signal processing technique utilising fourier transform methods and artificial neural network pattern recognition for interpreting complex data from a multipoint optical fibre sensor system," in WISICT '04: Proceedings of the winter international synposium on Information and communication technologies, WISICT. Trinity College Dublin, 2004, pp. 1-6.
23. G. Bailador, D. Roggen, G. Tröster, and G. Trivi no, "Real time gesture recognition using continuous time recurrent neural networks," in BodyNets '07: Proceedings of the ICST 2nd international conference on Body area networks, BodyNets. ICST, Brussels, Belgium, Belgium: ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), 2007, pp. 1-8.
24. T. Capin, K. Pulli, and T. Akenine-Möller, "The state of the art in mobile graphics research," IEEE Comput. Graph. Appl., vol. 28, no. 4, pp. 74-84, 2008.
25. S. J. Vaughan Nichols, "New interfaces at the touch of a fingertip," Computer, vol. 40, no. 8, pp. 12-15, 2007.
26. S. Narayanaswamy, J. Hu, and R. Kashi, "User interface for a pcs smart phone," in ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems, ICMCS. Washington, DC, USA: IEEE Computer Society, 1999, p. 9777.
27. C. Wei, G. Marsden, and J. Gain, "Novel interface for first person shooting games on pdas," in OZCHI '08: Proceedings of the 20th Australasian Conference on Computer-Human Interaction, OZCHI. New York, NY, USA: ACM, 2008, pp. 113-121.
28. M. Moyle and A. Cockburn, "Analysing mouse and pen flick gestures," in In Proc. of the SIGCHI-NZ Symposium On Computer-Human Interaction. SIGCHI, 2002, pp. 266-267.
29. L. Lombardi and M. Porta, "Adding gestures to ordinary mouse use: a new input modality for improved human-computer interaction," in ICIAP '07: Proceedings of the 14th International Conference on Image Analysis and Processing, ICIAP. Washington, DC, USA: IEEE Computer Society, 2007, pp. 461-466.
30. M. Buckland, AI Techniques for Game Programming (The Premier Press Game Development Series). Course Technology PTR, October 2002. [Online]. Available: http://www.amazon.com/exec/obidos/redirect?tag=citeulike07-20&path=ASIN/ 193184108X
31. E. Hoggan, S. A. Brewster, and J. Johnston, "Investigating the effectiveness of tactile feedback for mobile touchscreens," in CHI '08: Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, CHI. New York, NY, USA: ACM, 2008, pp. 1573-1582.
32. N. Crampton, K. Fox, H. Johnston, and A. Whitehead, "Dance dance evolution: Accelerometer sensor networks as input to video games," in IEEE HAVE 2007. IEEE HAVE, 2007, pp. 74-84.
33. L. Valente, C. S. de Souza, and B. Feijó, "An exploratory study on non-visual mobile phone interfaces for games," in IHC '08: Proceedings of the VIII Brazilian Symposium on Human Factors in Computing Systems, SBC. Porto Alegre, Brazil, Brazil: Sociedade Brasileira de Computaçao, 2008, pp. 31-39.
34. J. Mlch, "Wiimote gesture recognition," in Proceedings of the 15th Conference and Competition STUDENT EEICT 2009 Volume 4, Faculty of Electrical Engineering and Communication BUT. Faculty of Electrical Engineering and Communication BUT, 2009, pp. 344-349. [Online]. Available: http://www.fit.vutbr.cz/research/view pub.php?id=8933
35. T. Schlömer, B. Poppinga, N. Henze, and S. Boll, "Gesture recognition with a wii controller," in TEI '08: Proceedings of the 2nd international conference on Tangible and embedded interaction, TEI. New York, NY, USA: ACM, 2008, pp. 11-14.
36. E. S. Choi, W. C. Bang, S. J. Cho, J. Yang, D. Y. Kim, and S. R. Kim, "Beatbox music phone: gesture-based interactive mobile phone using a tri-axis accelerometer," in Industrial Technology, 2005. ICIT 2005. IEEE International Conference on. ICIT, 2005, pp. 97-102.
37. T. Pylvánáinen, "Accelerometer based gesture recognition using continuous hmms," Pattern Recognition and Image Analysis, pp. 639-646, 2005. [Online]. Available: http://dx.doi.org/10.1007/11492429n 77
38. Z. Prekopcsák, P. Halácsy, and C. Gáspár- Papanek, "Design and development of an everyday hand gesture interface," in Mobile-HCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services, MobileHCI. New York, NY, USA: ACM, 2008, pp. 479-480.
39. J. Scheible, T. Ojala, and P. Coulton, "Mobitoss: a novel gesture based interface for creating and sharing mobile multimedia art on large public displays," in MM '08: Proceeding of the 16th ACM international conference on Multimedia, MM. New York, NY, USA: ACM, 2008, pp. 957-960.
40. F. G. Hofmann, P. Heyer, and G. Hommel, "Velocity profile based recognition of dynamic gestures with discrete hidden markov models," in Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction, International Gesture Workshop. London, UK: Springer-Verlag, 1998, pp. 81-95.
41. J.-M. Franois, "Jahmm: Java implementation of hidden markov model (hmm) related algorithms," Avalible at: http://code.google.com/p/jahmm/, 2009.
42. B. Poppinga, "wiigee:a java-based gesture recognition library for the wii remote," Avalible at: http://www.wiigee.org, 2009.
43. L. Rabiner and B. Juang, "An introduction to hidden markov models," ASSP Magazine, IEEE [see also IEEE Signal Processing Magazine], vol. 3, no. 1, pp. 4-16, 1986. [Online]. Available: http://ieeexplore.ieee.org/ xpls/abs-all.jsp?arnumber=1165342
44. L. R. Rabiner, "A tutorial on hidden markov models and selected applications in speech recognition," Readings in speech recognition, pp. 267-296, 1990.
45. J. A. Bilmes, "What hmms can do," IEICE - Trans. Inf. Syst., vol. E89-D, no. 3, pp. 869-891, 2006.
46. N. Friedman, D. Geiger, and M. Goldszmidt, "Bayesian network classifiers," Mach. Learn., vol. 29, no. 2-3, pp. 131-163, 1997.
47. R. Kao and D. Sarigumba, BlackBerry Storm For Dummies. For Dummies, 2009.