Gesture processing as grounded motor cognition: Towards a computational model

Procedia - Social and Behavioral Sciences

Volumn 32, Issue , 2012, Pages 213-223

  Sadeghipoura, Amir ^a   Koppa, Stefan ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

Computational model; Embodied conversational agents; Embodiment; Gestures; Grounded cognition; Motor cognition; Social interaction

Indexed keywords

EID: 84858412523     PISSN: 18770428     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1016/j.sbspro.2012.01.032     Document Type: Conference Paper

References (36)

1. Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22, 577-660.
2. Barsalou, L. W. (2008). Grounded Cognition. Annual Review of Psychology, 59, 617-645.
3. Brass, M., Bekkering, H., & Prinz, W. (2001). Movement observation affects movement execution in a simple response task. Acta Psychologica, 106, 3-22. (Pubitemid 33650989)
4. Buxbaum, L. J., Johnson-Frey, S. H., & Bartlett-Williams, M. (2005). Deficient internal models for planning hand-object interactions in apraxia. Neuropsychologia, 43, 917-929. (Pubitemid 40248899)
5. Csibra, G. (2007). Action mirroring and action interpretation: An alternative account. In P. Haggard, Y. Rosetti & M. Kawato (Eds.), Sensorimotor foundations of higher cognition. Attention and Performance XXII (pp. 435-459). Oxford: Oxford University Press.
6. Damasio, A. R. (1989). The brain binds entities and events by multiregional activation from convergence zones. Neural Computation, 1, 123-132.
7. Fadiga, L., Craighero, L., Buccino, G., & Rizzolatti, G. (2002). Speech listening specifically modulates the excitability of tongue muscles: A TMS study. European Journal of Neuroscience, 15, 399-402. (Pubitemid 35471962)
8. Gallese, V. (2003). The manifold nature of interpersonal relations: The quest for a common mechanism. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 358, 517-528. (Pubitemid 36380531)
9. Gallese, V., & Goldman, A. (1998). Mirror neurons and the simulation theory of mind-reading. Trends in Cognitive Sciences, 2, 493-501. (Pubitemid 28557112)
10. Gibson, J. J. (1977). The theory of affordances. In R. E. Shaw, & J. Bransford (Eds.), Perceiving, acting, and knowing: Toward an ecological psychology (pp. 67-82). Hillsdale. NJ: Lawrence Erlbaum Association.
11. Gilden, D., Blake, R., & Hurst, G. (1995). Neural adaptation of imaginary visual motion. Cognitive Psychology, 28, 1-16.
12. Goldman, A. I. (2006). Simulating minds: The philosophy, psychology, and neuroscience of mindreading. New York: Oxford University Press.
13. Griffiths, T., Chater, N., Kemp, C., Perfors, A., & Tenenbaum, J. B. (2010). Probabilistic models of cognition: Exploring representations and inductive biases. Trends in Cognitive Sciences, 14, 357-364.
14. Hamilton, A. F., & Grafton, S. T. (2007). The motor hierarchy: From kinematics to goals and intentions. In P. Haggard, Y. Rosetti & M. Kawato (Eds.), Sensorimotor foundations if higher cognition (pp. 381-407). Oxford: Oxford University Press.
15. Hebb, D. (1949). The organization of behavior. New York: Wiley & Sons.
16. Hochstein, S., & Ahissar, M. (2002). View from the top: Hierarchies and reverse hierarchies in the visual system. Neuron, 36, 791-804. (Pubitemid 35447852)
17. Hommel, B., Müsseler, J., Aschersleben, G., & Prinz, W. (2001). The Theory of Event Coding (TEC): A framework for perception and action planning. Behavioral and Brain Sciences, 24, 849-878. (Pubitemid 34965924)
18. Iacoboni, M. (2009). Imitation, empathy, and mirror neurons. Annual Review of Psychology, 60, 653-670.
19. Jeannerod, M. (2006). Motor cognition: What actions tell the self. Oxford: Oxford University Press.
20. Kopp, S., Bergmann, K., & Wachsmuth, I. (2008). Multimodal communication from multimodal thinking - towards an integrated model of speech and gesture production. International Journal of Semantic Computing, 2, 115-136.
21. Kosslyn, S. M., Alpert, N. M., Thompson, W. L., Maljkovic, V., Weise, S. B., Chabris, C., et al. (1993). Visual mental imagery activates topographically organized visual cortex: PET investigations. Journal of Cognitive Neuroscience, 5, 263-287. (Pubitemid 23225581)
22. Loula, F., Prasad, S., Harber, K., & Shiffrar, M. (2005). Recognizing people from their movement. Journal of Experimental Psychology: Human Perception and Performance, 31, 210-220. (Pubitemid 40306524)
23. Marslen-Wilson, W., & Tyler, L. K. (1980). The temporal structure of spoken language understanding. Cognition, 8, 1-71.
24. McNeill, D. (1992). Hand and mind: What gestures. Chicago: University of Chicago Press.
25. McNorgan, C., Reid, J., & McRae, K. (2011). Integrating conceptual knowledge within and across representational modalities. Cognition, 118, 211-233.
26. Montgomery, K. J., Isenberg, N., & Haxby, J. V. (2007). Communicative hand gestures and object-directed hand movements activated the mirror neuron system. Social Cognitive and Affective Neuroscience, 2, 114-122.
27. Mukamel, R., Ekstrom, A. D., Kaplan, J., Iacoboni, M., & Fried, I. (2010). Single-neuron responses in humans during execution and observation of actions. Current Biology, 20, 750-756.
28. Mussa-Ivaldi, F., & Solla, S. (2004). Neural primitives for motion control. IEEE Journal of Oceanic Engineering, 29, 640-650.
29. Oaksford, M., & Chater, N. (2009). Précis of Bayesian rationality: The probabilistic approach to human reasoning. Behavioral and Brain Sciences, 32, 69-84.
30. Oztop, E., Franklin, D. W., Chaminade, T., & Cheng, G. (2005). Human-humanoid interaction: Is a humanoid robot perceived as a human? International Journal of Humanoid Robotics, 2, 537-559.
31. Pulvermüller, F., Shtyrov, Y., & Ilmoniemi, R. (2005). Brain signatures of meaning access in action word recognition. Journal of Cognitive Neuroscience, 17, 884-892. (Pubitemid 40800022)
32. Sadeghipour, A., & Kopp, S. (2010). Embodied gesture processing: Motor-based integration of perception and action in social artificial agents. Cognitive Computation, 1-17.
33. Sommerville, J. A., & Decety, J. (2006). Weaving the fabric of social interaction: Articulating developmental psychology and cognitive neuroscience in the domain of motor cognition. Psychonomic Bulletin and Review, 13, 179-200. (Pubitemid 44411997)
34. Sowa, T. (2006). Towards the integration of shape-related information in 3-D gestures and speech. Proceedings of the 8th international conference on Multimodal interfaces, USA, 92-99. (Pubitemid 47113434)
35. Tomasello, M. (2008). Origins of human communication. Cambridge: MIT Press.
36. Wolpert, D. M., Miall, R. C., & Kawato, M. (1998). Internal models in the cerebellum. Trends in Cognitive Sciences, 2, 338-347. (Pubitemid 28396569)