Ideomotor design: Using common coding theory to derive novel video game interactions

Pragmatics and Cognition

Volumn 18, Issue 2, 2010, Pages 313-339

  Chandrasekharan, Sanjay ^a   Mazalek, Alexandra ^a   Nitsche, Michael ^a   Chen, Yanfeng ^a   Ranjana, Apara ^b  

^a Georgia Institute of Technology   (United States)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Common coding; Digital media; Embodied cognition; Interaction design; Tangible interfaces; Video games

Indexed keywords

EID: 77955725616     PISSN: 09290907     EISSN: 15699943     Source Type: Journal    
DOI: 10.1075/pc.18.2.04cha     Document Type: Article

References (77)

1. Ambady, N., Bernieri, F.J., and Richeson, J.A. 2000. Towards a histology of social behavior: Judgmental accuracy from thin slices of the behavioral stream. Advances in Experimental Social Psychology 32: 201-271.
2. Barsalou, L.W. 1999. Perceptual symbol systems. Behavioral and Brain Sciences 22: 577-660.
3. Bassili, J.N. 1978. Facial motion in the perception of faces and of emotional expressions. Journal of Experimental Psychology: Human Perception and Performance 4: 373-379.
4. Beilock, S.L. and Holt, L.E. 2007. Embodied preference judgments: Can likeability be driven by the motor system?. Psychological Science 18: 51-57.
5. Bergen, B., Chang, N., and Narayan, S. 2004. Simulated action in an embodied construction grammar. In K.D. Forbus, D. Gentner, and T. Regier (eds), Proceedings of the 26th Annual Meeting of the Cognitive Science Society. Hillsdale, NJ: Lawrence Erlbaum, 108-113.
6. Bosbach, S., Cole, J., Prinz, W., and Knoblich, G. 2005. Understanding another's expectation from action: The role of peripheral sensation. Nature Neuroscience 8: 1295-1297.
7. Brass, M. and Heyes, C. 2005. Imitation: Is cognitive neuroscience solving the correspondence problem?. Trends in Cognitive Sciences 9: 489-495.
8. Brass, M., Bekkering, H., and Prinz, W. 2002. Movement observation affects movement execution in a simple response task. Acta Psychologica 106: 3-22.
9. Casile, A. and Giese, M.A. 2006. Non-visual motor learning influences the recognition of biological motion. Current Biology 16: 69-74.
10. Chandrasekharan, S. 2009. Building to discover: a common coding model. Cognitive Science 33: 1059-1086.
11. Chandrasekharan, S. and Ranjan, A. 2007. Classifying Others' Behavior from Simulated Momentum. Proceedings of the 99th annual meeting of the Southern Society for Philosophy and Psychology, Atlanta, USA.
12. Chandrasekharan, S. and Stewart T.C. 2007. The origin of epistemic structures and proto-representations. Adaptive Behavior 15: 329-353.
13. Chandrasekharan, S. and Osbeck, L. 2010. Rethinking situatedness: Environment structure in the time of the common code. Theory & Psychology 20(2): 171-207.
14. Cree, G.S., McRae, K., and McNorgan, C. 1999. An attractor model of lexical conceptual processing: Simulating semantic priming. Cognitive Science 23: 371-414.
15. Cutting, J.E. and Kozlowski, L.T. 1977. Recognizing friends by their walk: Gait perception without familiarity cues. Bulletin of the Psychonomic Society 9: 353-356.
16. Decety, J. 2002. Is there such a thing as a functional equivalence between imagined, observed and executed actions. In A.N. Meltzoff and W. Prinz (eds), The Imitative Mind: Development, Evolution and Brain Bases. Cambridge: Cambridge University Press, 291-310.
17. Difede, J. and Hoffman, H. 2002. Virtual reality exposure therapy for world trade center posttraumatic stress disorder: A case report. CyberPsychology and Behavior 5: 529-535.
18. Dijksterhuis, A. 2005. Why we are social animals: The high road to imitation as social glue. In S. Hurley and N. Chater (eds), Perspectives on Imitation: From Neuroscience to Social Science, Vol.2. Cambridge, MA: The MIT Press, 141-156.
19. Dourish, P. 2001. Where the Action Is. The Foundations of Embodied Interaction. Cambridge, MA: The MIT Press.
20. Ehrsson, H.H. 2007. The experimental induction of out-of-body experiences. Science 317: 1048.
21. Fadiga, L., Craighero, L., Buccino, G., and Rizzolatti, G. 2002. Speech listening specifically modulates the excitability of tongue muscles: A TMS study. European Journal of Neuroscience 15: 399-402.
22. Fadiga, L., Fogassi, L., Pavesi, G., and Rizzolatti, G. 1995. Motor facilitation during action observation: A magnetic stimulation study. Journal of Neurophysiology 73: 2608-2611.
23. Fadiga, L., Fogassi, L., Gallese, V., Rizzolatti, G. 2000. Visuomotor neurons: Ambiguity of the discharge or 'motor' perception?. International Journal of Psychophysiology 35: 165-177.
24. Feng, J., Spence, I., and Pratt, J. 2007. Playing an action video game reduces gender differences in spatial cognition. Psychological Science 18: 850-855.
25. Fiorio, M., Tinazzi, M., and Agiloti. S.M. 2006. Selective impairment of hand mental rotation in patients with focal hand dystonia. Brain 129: 47-54.
26. Galantucci, B. 2005. An experimental study of the emergence of human communication systems. Cognitive Science 29: 737-767.
27. Gallese, V., Ferrari P.F., Kohler E., and Fogassi L. 2002. The eyes, the hand and the mind: Behavioral and neurophysiological aspects of social cognition. In M. Bekoff, C. Allen, and M. Burghardt (eds), The Cognitive Animal. Cambridge, MA: The MIT Press, 451-462.
28. Glenberg, A.M. and Kaschak, M.P. 2002. Grounding language in action. Psychonomic Bulletin and Review 9: 558-565.
29. Green, S. and Bavelier, D. 2003. Action video game modifies visual selective attention. Nature 423: 534-537.
30. Hayles, K. 1999. How We Became Posthuman. Virtual Bodies in Cybernetics, Literature, and Informatics. Chicago: The University of Chicago Press.
31. Heeter, C. 1992. Being there: The subjective experience of presence. Presence: Teleoperators and Virtual Environments 1(2): 262-271.
32. Hegarty, M. 2004. Mechanical reasoning as mental simulation. Trends in Cognitive Sciences 8: 280-285.
33. Heyes, C.M. 2005. Imitation by association. In S. Hurley and N. Chater (eds), 157-174.
34. Holt, L.E. and Beilock, S.L. 2006. Expertise and its embodiment: Examining the impact of sensorimotor skill expertise on the representation of action-related text. Psychonomic Bulletin and Review 13: 694-701.
35. Hommel, B., Müsseler, J., Aschersleben, G., and Prinz, W. 2001. The theory of event coding (TEC): A framework for perception and action planning. Behavioral and Brain Sciences 24: 849-878.
36. Hurley, S. 2008. The shared circuits model: How control, mirroring and simulation can enable imitation, deliberation and mindreading . Behavioral and Brain Sciences 31: 1-22.
37. Hurley, S. and Chater, N. 2005. Perspectives on Imitation: From Neuroscience to Social Science. Cambridge, MA: The MIT Press.
38. Isbister, K. 2006. Better Game Characters by Design: A Psychological Approach. San Francisco: Elsevier / Morgan Kaufmann.
39. James, W. 1890. Principles of Psychology. New York: Holt.
40. Jeannerod, M. 1997. The Cognitive Neuroscience of Action. Oxford: Blackwell.
41. Jeannerod, M. 2006. From volition to agency: The mechanism of action recognition and its failures. In N. Sebanz and W. Prinz (eds), Disorders of Volition. Cambridge, MA: The MIT Press, 175-192.
42. Johnson, K.L., Gill, S., Reichman, V., and Tassinary, L.G. 2007. Swagger, sway, and sexuality: Judging sexual orientation from body motion and morphology. Journal of Personality and Social Psychology 93: 321-334
43. Johnson-Laird, P.N. 1983. Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness. Cambridge, MA: Harvard University Press.
44. Kandel, S., Orliaguet, J.-P., and Viviani, P. 2000. Perceptual anticipation in handwriting: The role of implicit motor competence. Perception and Psychophysics 62: 706-716.
45. Knoblich, G. and Sebanz, N. 2006. The social nature of perception and action. Psychological Science 15: 99-104.
46. Kosslyn, S.M. 1994. Image and Brain. Cambridge, MA: The MIT Press.
47. Koster, R. 2005. A Theory of Fun for Game Design. Scottsdale, AZ: Paraglyph Press.
48. Kozlowski, L.T. and Cutting, J.E. 1977. Recognizing the sex of a walker from a dynamic pointlight display. Perception and Psychophysics 21: 575-580.
49. Laurel, B. 1991. Computers as Theatre. Reading, MA: Addison-Wesley Publishing Company.
50. Lenggenhager, B., Tadi, T., Metzinger, T., and Blanke, O. 2007. Video ergo sum: manipulating bodily self-consciouness. Science 317: 1096-1099.
51. Lombard, M. and Ditton, T. 1997. At the heart of it all: The concept of telepresence. Journal of Computer-Mediated Communication 3: 1-39.
52. Martin, T. and Schwartz, D.L. 2005. Physically distributed learning: Adapting and reinterpreting physical environments in the development of fraction concepts. Cognitive Science 29: 587-625.
53. Mateas, M. 2002. Interactive Drama, Art and Artificial Intelligence. Unpublished PhD dissertation, Carnegie Mellon University.
54. Mazalek, A., Chandrasekharan, S., Nitsche, M., Welsh, T. Thomas, G., Sanka, T., and Clifton, P. 2009. Giving your self to the game: Transferring a player's own movements to avatars using tangible interfaces. Proceedings of Sandbox 2009: ACM SIGGRAPH Videogame Symposium, New York, NY: ACM Press, 161-168.
55. Mazalek, A., Nitsche, M., Chandrasekharan, S., Welsh, T., Clifton, P., Quitmeyer, A., Peer, F., and Kirschner, F. In press. Recognizing self in puppet controlled virtual avatars. Proceedings of Fun and Games 2010, New York: ACM Press.
56. Nersessian, N.J. 2002. The cognitive basis of model-based reasoning in science. In P. Carruthers, S. Stich, and M. Siegal, (eds), The Cognitive Basis of Science. Cambridge: Cambridge University Press, 133-153.
57. Nersessian, N.J. 2008. Creating Scientific Concepts. Cambridge, MA: The MIT Press.
58. Oztop, E., Kawato, M., and Arbib, M. 2006. Mirror neurons and imitation: A computationally guided review. Neural Networks 19: 254-271.
59. Prinz, W. 1992. Why don't we perceive our brain states?. European Journal of Cognitive Psychology 4:1-20.
60. Prinz, W. 2005. A common coding approach to imitation. In S. Hurley and N. Chater (eds),, 141-156.
61. Rothbaum, B., Anderson, P., Zimand, E., Hodges, L., Lang, D., and Wilson, J. 2006. Virtual reality exposure therapy and standard (in vivo) exposure therapy in the treatment of fear of flying. Behavior Therapy 37: 80-90.
62. Sebanz, N., Knoblich, G., and Prinz, W. 2005. How two share a task. Journal of Experimental Psychology: Human Perception and Performance 33: 1234-1246.
63. Slater, M. 1999. Measuring presence: A response to the Witmer and Singer questionnaire. Presence: Teleoperators and Virtual Environments 8: 560-566.
64. Thirioux, B., Jorland, G., Bret, M., Tramus, M., and Berthoz, A. 2009. Walking on a line: A motor paradigm using rotation and refelction symmetry to study mental body transformations. Brain and Cognition 70: 191-200.
65. Topolinski, S. and Strack, F. 2009. Motormouth: Mere exposure depends on stimulus-specific motor simulations. Journal of Experimental Psychology: Learning, Memory, and Cognition 35: 423-433.
66. Turkle, S. 1996. Life on the Screen. Identity in the Age of the Internet. London: Weidenfeld and Nicolson.
67. Vingerhoets, G., de Lange, F.P, Vandemaele, P., Deblaere, K., and Achten, E. 2002. Motor imagery in mental rotation: An FMRI study. Neuroimage 17: 1623-1633.
68. Viviani, P. 2002. Motor competence in the perception of dynamic events: a tutorial. In W. Prinz and B. Hommel (eds), Common Mechanisms in Perception and Action: Attention and Performance XIX. New York: Oxford University Press, 406-442.
69. Viviani, P. and Stucchi, N. 1989. The effect of movement velocity on form perception: Geometric illusions in dynamic displays. Perception and Psychophysics 46: 266-274.
70. Viviani, P. and Stucchi, N. 1992. Biological movements look uniform: Evidence of motorperceptual interaction. Journal of Experimental Psychology: Human perception and performance 18: 603-623.
71. Welsh, T.N. and Elliott, D. 2004. Movement trajectories in the presence of a distracting stimulus: Evidence for a response activation model of selective reaching. Quarterly Journal of Experimental Psychology - Section A 57: 1031-1057.
72. Welsh, T.N., Lyons, J., Weeks, D.J., Anson, G.J., Chua, R., Mendoza, J., and Elliott, D. 2007. Within-and between-nervous system inhibition of return: Observation is as good as performance. Psychonomic Bullettin and Review14: 950-956
73. Welsh, T.N., Weeks, D.J., Chua, R., and Goodman, D. 2007. Perceptual-motor interaction: Some implications for HCI. In A. Sears and J.A. Jacko (eds), The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, 2nd ed. Boca Raton, FL: CRC Press, 27-41.
74. Wexler, M. and van Boxtel, J.J.A. 2005. Depth perception by the active observer. Trends in Cognitive Sciences 9: 431-438.
75. Wilson, N.L. and Gibbs, R.W. 2007. Real and imagined body movement primes metaphor comprehension. Cognitive Science 31: 721-731.
76. Witmer, B. and Singer, M. 1998. Measuring presence in virtual environments: A presence questionaire. Presence: Teleoperators and Virtual Environments 7: 225-240.
77. Wohlschlager, A. 2001. Mental object rotation and the planning of hand movements. Perception and Psychophysics 63: 709-718.