Integrating the Wii controller with enJine: 3D interfaces extending the frontiers of a didactic game engine

Computers in Entertainment

Volumn 7, Issue 1, 2009, Pages

  Bernardes, João ^a   Nakamura, Ricardo ^a   Calife, Daniel ^a   Tokunaga, Daniel ^a   Tori, Romero ^a  

^a UNIVERSITY OF SÃO PAULO   (Brazil)

Author keywords

3D user interfaces; Game engine

Indexed keywords

3D INPUT DEVICE; 3D INTERFACE; 3D USER INTERFACES; GAME ENGINE; INPUT DEVICES; INTERACTION STYLES; LAYERED ARCHITECTURE; TEST RESULTS;

CONTROLLERS; GAME THEORY; KNOBS; THREE DIMENSIONAL;

USER INTERFACES;

EID: 67649497033     PISSN: 15443574     EISSN: 15443981     Source Type: Journal    
DOI: 10.1145/1486508.1486520     Document Type: Article

References (55)

1. Ailive. 2008. LiveMove white paper. http://www.ikuni.com/papers/ LiveMoveWhitePaper-en. pdf.
2. Attygalle, S., Duff, M., Rikakis, T., and Jiping, H. 2008. Low-cost, at-home assessment system with Wii Remote based motion capture. In Proceedings of the Conference on Virtual Rehabilitation, IEEE, 168-174.
3. Avetana. 2008. http://www.avetana-gmbh.de/ avetana-gmbh/ produkte/jsr82.eng.xml.
4. Azuma, R. 1997. A survey of augmented reality. Presence: Teleoperators and Virtual Environments 6, 4 (Aug.), 355-385.
5. Barakonyi, I., Markus W., Thomas, P., and Schmalstieg, D. 2005. MonkeyBridge: Autonomous agents in augmented reality games. In Proceedings of the ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, ACM, New York.
6. Belcher, J. 2007. Embodied interfaces for interactive percussion instruction. Master's dissertation. http://scholar.lib.vt.edu/theses/ available/etd-5312007-113346/.
7. Billinghurst, M., Kato, H., and Poupyrev, I. 2000. Artoolkit: A computer vision based augmented reality toolkit. In Proceedings of the IEEE Virtual Reality 2000 Conference.
8. Bimber, O. and Raskar, R. 2005. Spatial Augmented Reality: Merging Real and Virtual Worlds. A K Peters.
9. Bluesock. 2008. http://bluesock.dev.java.net.
10. Bluetooth Specification. http://www.bluetooth.com/ Bluetooth/Technology/Building/Specifications.
11. Bowman, D., Kruijff, E., Laviolla, J.J., Jr., and Poupyrev, I. 2005. 3D User Interfaces. Addison-Wesley, Reading, MA.
12. Bruegge, B. et al. 2007. Pinocchio: Conducting a virtual symphony orchestra. In Proceedings of the International Conference on Advances in Computer Entertainment Technology, ACM, New York, 294-295.
13. Cabral, M., Morimoto, C., and Zuffo, M. 2005. On the usability of gesture interfaces in virtual reality environments. In Proceedings of the 2005 Latin American Conference on Human-Computer Interaction, ACM, New York, 100-108.
14. Calife, D., Tomoyose, A., Spinola, D., Bernardes, J. L., Jr., and Tori, R. 2007. Robot ARena: Infrastructure for applications involving spatial augmented reality and robots. In Proceedings of the IX Symposium on Virtual and Augmented Reality.
15. Carless, S. 2005. Xbox CFO estimates initial Xbox 360 sales. http://www.gamasutra.com/php-bin/news-index.php?story=7109%3C/link%3E.
16. Dobson, J. 2006. Nintendo: 600,000 Wii, 454,000 Zelda Sold In First Eight Days. Available on: http://www.gamasutra.com/php-bin/news index.php? story=11864
17. Dragicevic, P. and Fekete, J. 2004. Support for input adaptability in the ICON toolkit. In Proceedings of the 6th International Conference on Multimodal Interfaces, ACM, New York, 212- 219.
18. Farias, T., Teixeira, J., Rodrigues, C., Pessoa, S., Costa, N., Teichrieb, V., and Kelner, J. 2006. CIDA: Aninteraction devices management platform. In Proceedings of the Symposium on Virtual Reality, SBC, 271-284.
19. Forbes, K. 2007. cWiimote library. http:// simulatedcomicproduct.com.
20. Galego, B. and Simone, L. 2007. Leveraging online virtual worlds for upper extremity rehabilitation. In Proceedings of the IEEE Bioengineering Conference, IEEE, 267-268.
21. Geiger, C., Reimann, C., Sticklein, J., and Paelke, V. 2002. JARToolKit - A Java binding for AR-ToolKit. Augmented reality toolkit. In Proceedings of the First IEEE International Workshop.
22. GLOVEPIE. http://carl.kenner.googlepages.com/glovepie.
23. Gomes, P. and Pamplona, V. 2005. M3GE: um motor de jogos 3D para dispositivos móveis com suporte a Mobile 3D Graphics API. In Proceedings of the Brazilian Symposium on Computer Games and Electronic Entertainment, SBC, 55-65.
24. Govil, A., You, S., and Neumann, U. 2000. A video-based augmented reality golf simulator. In Proceedings of the 8th ACM International Conference on Multimedia, ACM, New York.
25. Hay, S., Newman, J., and Harle, R. 2008. Optical tracking using commodity hardware. In Proceedings of the Mixed and Augmented Reality, IEEE, 159-160.
26. Hoetzlein, R. and Schwartz, D. 2005. GameX:Aplatform for incremental instruction in computer graphics and game design. In Proceedings of the ACM SIGGRAPH 2005 Educator's Program, ACM Press, New York.
27. Huang, T. and Pavlovic, V. 1995. Hand gesture modelling, Analysis and synthesis. In Proceedings of the International Workshop on Automatic Face and Gesture Recognition. IEEE, 73- 79.
28. INVENSENSE. 2008, Invensense™ IDG-600 motion sensing solution showcased in Nintendo's new Wii Motionplus accessory. Available on: http://www.invensense.com/news/071508.html
29. Ishii, H. and Ullmer, B. 1997. Tangible bits: Towards seamless interfaces between people, bits and atoms. In Proceedings of The SIGCHI Conference on Human Factors In Computing Systems, ACM, New York, 234-241.
30. Java Bluetooth.Com. 2008. Development kits. http://www.javabluetooth.com/development-kits. html.
31. Kim, K. et al. 2005. ARPushPush: Augmented reality game in indoor environment. In Proceedings of the International Workshop on Pervasive Gaming Applications.
32. Kolsch, M. and Turk, M. 2005. Hand tracking with flocks of features. In Proceedings of 2005 Conference on Computer Vision and Pattern Recognition. IEEE.
33. Lee, J. C. 2008. Hacking the Nintendo Wii remote. IEEE Pervasive Computing 7, 3, 39-45.
34. Magerkurth, C., Engelke, T., and Memisoglu, M. 2004. Augmenting the virtual domain with physical and social elements. Computers in Entertainment 2, 4 (Oct).
35. Mandryk, R., Maranan, D., and Inkpen, K. 2002. False prophets: Exploring hybrid board/video games. In Proceedings of the Conference of Human Factors in Computing Systems. 640-641.
36. Marcel, S. 2008. Gestures for multi-modal interfaces: A review. 2002. http://citeseer.ist.psu. edu/marcel02gestures.html.
37. Moser, R. 1997. A fantasy adventure game as a learning environment. In Proceedings of the Innovation and Technology in Computer Science Education Conference (ITiCSE), ACM, New York, 114-116.
38. Nakamura, R., Bernardes, J. L., and Tori, R. 2006. enJine: Architecture and application of an open-source didactic game engine. In Digital Proceedings of the Brazilian Symposium on Games and Digital Entertainment. http://www.cin.ufpe.br/∼sbgames/ proceedings/index.htm.
39. Nintendo Wii remote. http://wii.nintendo.com/ controller.Jsp.
40. Ohshima, T., Satoh, K., Yamamoto, H., and Tamura, H. 1999. RV-border guards: A multi-player entertainment in mixed reality space. In Proceedings of the IEEE and ACM Second International Workshop on Augmented Reality, ACM, New York.
41. OPENGL ES. 2008. http://www.khronos.org/opengles
42. Pascale, M. and Prattichizzo, D. 2005. The haptik library: A component based architecture for uniform access to haptic devices. IEEE Robotics and Automation Magazine (in press).
43. Pavlovic, V., Sharma, R., and Huang, T. 1997. Visual interpretation of hand gestures for human computer interaction: A review. IEEE Trans. Pattern Analysis and Machine Intelligence 19, 7, 677-695.
44. Rasco, B. 2007. Where's the Wiimote? Using Kalman filtering to extract accelerometer data. http://www.gamasutra.com/view/feature/1494/wheres- the-wiimote-using-kalman-.php.
45. Sweedyk, E., De Laet, M., Slattery, M. C., and Kuffner, J. 2005. Computer games and CS education: Why and how. In Proceedings of the Innovation and Technology in Computer Science Education Conference (ITiCSE), ACM, New York, 256-257.
46. Schlömer, T., Poppinga, B., Henze, N., and Boll S. 2008. Gesture Recognition with a Wii Controller. In Proceedings of the 2nd International Conference on Tangible and Embedded Interaction, Bonn, Germany, February 2008, 11-14.
47. Souza, M. and Ribeiro, T., AR wiiSquash: Utilização do wiiMote como interface de interação com o usuário em Jogos de Realidade Aumentada baseada em projetores. Monograph, Centro Universitário Senac , Sao Paulo, 2008. 43 p.
48. Thompson et al. 2006. JSR 82. http://jcp.org/en/jsr/detail?id=82 /.
49. Tokunaga, D., Vicentim, A., Muto, M., Bernardes, J., and Tori, R. 2008. GESKTOP 3D: Explorando novas formas de interação 3D baseadas em gestos. In Proceedings of the X Symposium on Virtual and Augmented Reality, SBC, 125-128.
50. Tori, R., Bernardes, J., and Nakamura, R. 2006. Teaching introductory computer graphics using Java 3D, games and customized software: A Brazilian experience. In Digital Proceedings of the 34th International Conference and Exhibition on Computer Graphics and Interactive Techniques, ACM SIGGRAPH Educators Program, ACM, New York.
51. Tsuda, F., Hokama, P., Rodrigues, T., and Bernardes, J. 2007. Integration of jARToolKit and enJine: Extending with AR the potential use of a didactic game engine. In Proceedings of the IX Symposium on Virtual and Augmented Reality, SBC, 51-59.
52. Wieringen, V. M. and Eklund, J. M. 2008. Real-time signal processing of accelerometer data for wearable medical patient monitoring devices. In Proceedings of the Engineering in Medicine and Biology Society, IEEE, 2397-2400.
53. WIILI. http://www.wiili.org.
54. Wilson, P. H., Duckworth, J., Mumford, N., Eldridge, R., Guilielmetti, M., Thomas, P., Shum, D., and Rudolph, H. 2007. A virtual tabletop workspace for the assessment of upper limb function in traumatic brain injury (TBI). In Proceedings of the Virtual Rehabilitation Conference, IEEE, 14-19.
55. Wu, W. and Huang, T. 1999. Vision-Based Gesture Recognition: A Review. Springer, New York.