Giving your self to the game: Transferring a player's own movements to avatars using tangible interfaces

Proceedings of the 2009 ACM SIGGRAPH Symposium on Video Games, Sandbox '09

Volumn , Issue , 2009, Pages 161-168

  Mazalek, Ali ^a   Chandrasekharan, Sanjay ^b   Nitsche, Michael ^a   Welsh, Tim ^b   Thomas, Geoff ^a   Sanka, Tandav ^a   Clifton, Paul ^a  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF CALGARY   (Canada)

Author keywords

Body memory; Common coding; Game avatar; Puppet; Tangible user interface; Video game; Virtual character

Indexed keywords

BODY MOVEMENTS; IMAGINATION OF MOVEMENTS; TANGIBLE INTERFACES; TANGIBLE USER INTERFACES; VIDEO GAME; VIRTUAL CHARACTER;

ABSTRACTING; INTERACTIVE COMPUTER GRAPHICS; USER INTERFACES;

EDUCATIONAL MOTION PICTURES;

EID: 70450277796     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (41)

1. BALAKRISHNAN R., FITZMAURICE G., KURTENBACH G., SINGH K. 1999. Exploring interactive curve and surface manipulation using a bend and twist sensitive input strip. In Proceedings of the ACM Symposium on Interactive 3D Graphics (I3DG '99), ACM Press, 111-118.
2. BARSALOU, L. W. 1999. Perceptual symbol systems. Behavioral and Brain Sciences, 22, 577-660.
3. BEARDSWORTH, T., BUCKNER, T. 1981. The ability to recognize oneself from a video recording of one's movements without seeing one's body. In Bulletin of the Psychonomic Society, 18 (1), 19-22.
4. BRASS, M., BEKKERING, H., PRINZ, W. 2002. Movement observation affects movement execution in a simple response task. Acta Psychologica, 106, 3-22.
5. BRASS, M., HEYES, C. 2005. Imitation: is cognitive neuroscience solving the correspondence problem? Trends in Cognitive Sciences, 9, 489-495.
6. CALVO-MERINO, B., GLASER, D.E., GREZES, J., PASSINGHAM, R.E., HAGGARD, P. 2005. Action observation and acquired motor skills. Cerebral Cortex, 15, 1243-1249
7. CHANDRASEKHARAN, S., ATHREYA, D., SRINIVASAN, N. 2006. Twists and Oliver Twists in mental rotation: complementary actions as orphan processes. In Ron Sun, ed., Proceedings of the 28th Annual Conference of the Cognitive Science Society, Vancouver, Sheridan, 1092-1097.
8. CUTTING, J. E., KOZLOWSKI, L.T. 1977. Recognizing friends by their walk: Gait perception without familiarity cues. Bulletin of the Psychonomic Society, 9, 353-356.
9. DECETY, J. 2002. Is there such a thing as a functional equivalence between imagined, observed and executed actions. In A.N. Meltzoff & W. Prinz, Eds., The Imitative Mind: Development, Evolution and Brain Bases. Cambridge University Press, 291-310.
10. DIFEDE, J., HOFFMAN, H. 2002. Virtual reality exposure therapy for World Trade Center post-traumatic stress disorder: A case report. CyberPsychology & Behavior, 5, 6, 529-535.
11. ESPOSITO, C., PALEY, W.B. 1995. Of mice and monkeys: A specialized input device for virtual body animation. In Proceedings of Symposium on Interactive 3D Graphics, 109-213.
12. FADIGA, L., FOGASSI, L., PAVESI, G., RIZZOLATTI, G. 1995. Motor facilitation during action observation: a magnetic stimulation study. Journal of Neurophysiology, 73, 2608-2611.
13. FADIGA, L., CRAIGHERO, L., BUCCINO, G. RIZZOLATTI, G. 2002. Speech listening specifically modulates the excitability of tongue muscles: a TMS study. European Journal of Neuroscience, 15, 399-402.
14. GALLESE, V., FERRARI P.F., KOHLER E., FOGASSI L. 2002. The eyes, the hand and the mind: behavioral and neurophysiological aspects of social cognition. In: The Cognitive Animal. Bekoff, M., Allen, C., Burghardt, M. (Eds.), MIT Press, 451-462.
15. HECKER, C., RAABE, B., ENSLOW, R.W., DEWEESE, J.; MAYNARD, J., VAN PROOIJEN, K. 2008. Real-time motion retargeting to highly varied user-created morphologies. ACM Transaction on Graphics, 27, 3, 27:1-27:11.
16. HEGARTY, M. 2004. Mechanical reasoning as mental simulation. Trends in Cognitive Sciences, 8, 280-285.
17. HOMMEL, B., MÜSSELER, J., ASCHERSLEBEN, G., PRINZ, W. 2001. The theory of event coding (TEC): A framework for perception and action planning. Behavioral & Brain Sciences, 24, 910-937.
18. HUNT, D., MOORE, J., WEST, A., NITSCHE, M. 2006. Puppet Show: Intuitive puppet interfaces for expressive character control. In Medi@terra 2006, Gaming Realities: A Challenge for Digital Culture, Fournos Centre, Manthos Santorineos, Ed., 159-167.
19. HURLEY, S., CHATER, N. 2005. Perspectives on imitation: From neuroscience to social science. Vol. 1: Imitation, human development and culture, MIT Press.
20. ISBISTER, K. 2006. Better game characters by design: A psychological approach. Elsevier/Morgan Kaufmann.
21. ISHII, H., ULLMER, B. 1997. Tangible bits: towards seamless interfaces between people, bits and atoms. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 1997), ACM Press, 234-241.
22. JACOB, R., SIBERT, L. 1992. The perceptual structure of multidimensional input device selection. In Proceedings of Human Factors in Computing Systems (CHI '92), ACM Press, 211-218.
23. JEANNEROD, M. 1997. The cognitive neuroscience of action. Blackwell.
24. JEANNEROD, M. 2006. From volition to agency: The mechanism of action recognition and its failures. In, Disorders of Volition, N. Sebanz & W. Prinz, Eds., MIT Press, 175-192.
25. KNOBLICH, G., FLACH, R. 2001. Predicting the effects of actions: interactions of perception and action. Psychological Science, 12 6, 467-472.
26. KNOBLICH, G., PRINZ, W. 2001. Recognition of self-generated actions from kinematic displays of drawing. Journal of Experimental Psychology: human perception and performance, 27, 2, 456-465.
27. KNOBLICH, G., SEBANZ, N. 2006. The social nature of perception and action. Psychological Science, 15, 3, 99-104.
28. LOMBARD, M., DITTON, T. 1997. At the heart of it all: The concept of telepresence. Journal of Computer-Mediated Communication, 3, 2, 1-39.
29. MAZALEK, A., NITSCHE, M. 2007. Tangible interfaces for real-time 3D virtual environments. In Proceedings of the international Conference on Advances in Computer Entertainment Technology, ACM Press, 155-162.
30. PRINZ, W. 2005. An ideomotor approach to imitation. In Perspectives on imitation: From neuroscience to social science, Vol. 1. S. Hurley, N. Chater, Eds., MIT Press, 141-156.
31. REPP, B.H., KNOBLICH, G. 2004. Perceiving action identity: How pianists recognize their own performances. In Psychological Science, 15, 604-609
32. ROTHBAUM, B., ANDERSON, P., ZIMAND, E., HODGES, L., LANG, D., WILSON, J. 2006. Virtual Reality exposure therapy and standard (in vivo) exposure therapy in the treatment of fear of flying. Behavior Therapy, 37, 1, 80-90.
33. SLATER, M. 1999. Measuring presence: A response to the Witmer and Singer questionnaire. Presence: Teleoperators and Virtual Environments, 8, 5, 560-566.
34. TURKLE, S. 1996. Life on the screen. Identity in the age of the internet. Weidenfeld & Nicolson.
35. ULLMER B., ISHII, H. 2001. Emerging frameworks for tangible user interfaces. In Human-Computer Interaction in the New Millennium, John M. Carroll, Ed., Addison-Wesley, 579-601.
36. VINGERHOETS, G., DE LANGE, F.P., VANDEMAELE, P., DEBLAERE, ACHTEN, E. 2002. Motor imagery in mental rotation: an FMRI study. Neuroimage, 17, 1623-1633.
37. VIRPET THEATER PROJECT, Entertainment Technology Center (ETC), Carnegie Mellon University, Pittsburgh, PA, USA. http://www.etc.cmu.edu/ projects/virpets/spring03/.
38. WELSH, T.N., ELLIOTT, D. 2004. Movement trajectories in the presence of a distracting stimulus: Evidence for a response activation model of selective reaching. Quarterly Journal of Experimental Psychology - Section A, 57, 1031-1057.
39. WEXLER, M., KOSSLYN S.M., BERTHOZ, A. (1998). Motor processes in mental rotation. Cognition, 68, 77-94.
40. WITMER, B., SINGER M. 1998. Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environments, 7, 3, 225-240.
41. WOHLSCHLAGER, A. 2001. Mental object rotation and the planning of hand movements. Perception and Psychophysics, 63 (4), 709-718.