Vision, action and language unified through embodiment

Psychological Research

Volumn 77, Issue 1, 2013, Pages 1-6

  Caligiore, Daniele ^a   Fischer, Martin H ^b  

^a INSTITUTE OF COGNITIVE SCIENCES AND TECHNOLOGIES   (Italy)

^b UNIVERSITY OF POTSDAM   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITION; EDITORIAL; HUMAN; LANGUAGE; PSYCHOMOTOR PERFORMANCE; VISION;

COGNITION; HUMANS; LANGUAGE; PSYCHOMOTOR PERFORMANCE; VISION, OCULAR;

EID: 84871930677     PISSN: 03400727     EISSN: 14302772     Source Type: Journal    
DOI: 10.1007/s00426-012-0417-0     Document Type: Editorial

References (78)

1. Arbib, M. A., & Lee, J. Y. (2007). Vision and action in the language-ready brain: From mirror neurons to SemRep. Lecture Notes in Computer Science, 4729, 104.
2. Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22, 577-660.
3. Bekkering, H., & Neggers, S. F. W. (2002). Visual search is modulated by action intentions. Psychological Science, 13, 370-374.
4. Bonaiuto, J., & Arbib, M. A. (2010). Extending the mirror neuron system model, II: What did I just do? A new role for mirror neurons. Biological Cybernetics, 102, 341-259.
5. Bonaiuto, J., Rosta, E., & Arbib, M. A. (2007). Extending the mirror neuron system model, I. Biological Cybernetics, 96, 9-38.
6. Borghi, A. M. (2004). Object concepts and action: Extracting affordances from objects parts. Acta Psychologica, 115(1), 69-96.
7. Borghi, A. M., & Cimatti, F. (2009). Words as tools and the problem of abstract words meanings. In N. Taatgen & H. van Rijn (Eds.), Proceedings of the 31st Annual Conference of the Cognitive Science Society (pp. 2304-2309). Amsterdam: Cognitive Science Society.
8. Borghi, A. M., Glenberg, A. M., & Kaschak, M. (2004). Putting words in perspective. Memory & Cognition, 32, 863-873.
9. Buccino, G., Binkofski, F., Fink, G. R., Fadiga, L., Fogassi, L., Gallese, V., et al. (2001). Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. European Journal of Neuroscience, 13, 400-404.
10. Buccino, G., Binkofski, F., & Riggio, L. (2004). The mirror neuron system and action recognition. Brain and Language, 89, 370-376.
11. Caligiore, D., Borghi, A. M., Parisi, D., & Baldassarre, G. (2010). TRoPICALS: A computational embodied neuroscience model of compatibility effects. Psychological Review, 117, 1188-1228.
12. Caligiore, D., Borghi, A. M., Parisi, D., Ellis, R., Cangelosi, A., & Baldassarre, G. (2012). How affordances associated with a distractor object affect compatibility effects: A study with the computational model TRoPICALS. Psychological Research (this issue).
13. Cangelosi, A., Hourdakis, E., & Tikhanoff, V. (2006). Language acquisition and symbol grounding transfer with neural networks and cognitive robots. The 2006 IEEE International Joint Conference on Neural Network Proceedings (pp. 1576-1582).
14. Cangelosi, A., & Parisi, D. (2002). Simulating the evolution of language. In A. Cangelosi & D. Parisi (Eds.), Simulating the Evolution of Language (p. xii + 356). Berlin: Springer.
15. Cangelosi, A., & Riga, T. (2006). An embodied model for sensorimotor grounding and grounding transfer: experiments with robots. Cognitive Science, 30, 673-689.
16. Chersi, F., Thill, S., Ziemke, T., & Borghi, A. M. (2010) Sentence processing: Linking language to motor chains. Frontiers in Neurorobotics 4(4). doi: 10. 3389/fnbot. 2010. 00004.
17. De Vega, M., Moreno, V., & Castillo, D. (2012). The comprehension of action-related sentences may cause interference rather than facilitation on matching actions. Psychological Research (this issue).
18. Ellis, R., Swabey, D., Bridgeman, J., May, B., Tucker, M., & Hyne, A. (2012). Bodies and other visual objects: The dialectics of reaching toward objects. Psychological Research (this issue).
19. Fadiga, L., Craighero, L., Fabbri Destro, M., Finos, L., Cotillon Williams, N., Smith, A. T., et al. (2006). Language in shadow. Social Neuroscience, 1, 77-89.
20. Fadiga, L., Fogassi, L., Gallese, V., & Rizzolatti, G. (2000). Visuomotor neurons: Ambiguity of the discharge or 'motor' perception? International Journal of Psychophysiology, 35, 165-177.
21. Fagg, A. H., & Arbib, M. A. (1998). Modeling parietal-premotor interaction in primate control of grasping. Neural Networks, 11, 1277-1303.
22. Fischer, M. H., & Dahl, C. (2007). The time course of visuo-motor affordances. Experimental Brain Research, 176, 519-524.
23. Fischer, M. H., & Hoellen, N. (2004). Space- and object-based attention depend on motor intention. The Journal of General Psychology, 13, 365-377.
24. Fleischer, J. G., & Edelman, G. M. (2009). Brain-based devices: An embodied approach to linking nervous system structure and function to behavior. IEEE Robotics & Automation Magazine, 16, 33-41.
25. Fogassi, L., Ferrari, P. F., Gesierich, B., Rozzi, S., Chersi, F., & Rizzolatti, G. (2005). Parietal lobe: From action organization to intention understanding. Science, 308, 662-667.
26. Friston, K. (2009). Causal modelling and brain connectivity in functional magnetic resonance imaging. PLoS Biol, 7(2), e33.
27. Gallese, V. (2008). Mirror neurons and the social nature of language: The neural exploitation hypothesis. Social Neuroscience, 3, 317-333.
28. Garagnani, M., Wennekers, T., & Pulvermüller, F. (2008). A neuroanatomically grounded Hebbian-learning model of attention-language interactions in the human brain. European Journal of Neuroscience, 27, 492-513.
29. Gentilucci, M. (2003). Grasp observation influences speech production. European Journal of Neuroscience, 17, 179-184.
30. Gentilucci, M., Benuzzi, F., Gangitano, M., & Grimaldi, S. (2001). Grasp with hand and mouth: A kinematic study on healthy subjects. Journal of Neurophysiology, 86, 1685-1699.
31. Gianelli, C., Scorolli, C., & Borghi, A. M. (2012). Acting in perspective: The role of body and language as social tools. Psychological Research (this issue).
32. Glenberg, A. M. (2010). Embodiment as a unifying perspective for psychology. Wiley Interdisciplinary Reviews: Cognitive Science, 1, 586-596.
33. Glenberg, A. M., & Kaschak, M. P. (2002). Grounding language in action. Psychonomic Bulletin & Review, 9, 558-565.
34. Glenberg, A. M., & Robertson, D. A. (1999). Indexical understanding of instructions. Discourse Processes, 28, 1-26.
35. Glenberg, A. M., & Robertson, D. A. (2000). Symbol grounding and meaning: A comparison of high-dimensional and embodied theories of meaning. Journal of Memory and Language, 43, 379-401.
36. Grèzes, J., Tucker, M., Armony, J., Ellis, R., & Passingham, R. E. (2003). Objects automatically potentiate action: An fMRI study of implicit processing. European Journal of Neuroscience, 17, 2735-2740.
37. Hanlon, R. E., Brown, J. W., & Gerstman, L. J. (1990). Enhancement of naming in nonfluent aphasia through gesture. Brain and Language, 38, 298-314.
38. Hauk, O., Johnsrude, I., & Pulvermüller, F. (2004). Somatotopic representation of action words in human motor and premotor cortex. Neuron, 41, 301-307.
39. Hommel, B., & Colzato, L. S. (2010). Games with(out) Frontiers: Towards an integrated science of human cognition. Frontiers in Psychology, 1, 2.
40. Iizuka, H., Marocco, D., Ando, H., & Maeda, T. (2012). An experimental study on co-evolution of categorical perception and communication system in humans. Psychological Research (this issue).
41. Jeannerod, M. (2007). Motor cognition: What actions tell the self. Oxford: Oxford University Press.
42. Johansson, R. S., Westling, G., Bäckström, A., & Flanagan, J. R. (2001). Eye-hand coordination in object manipulation. Journal of Neuroscience, 21, 6917-6932.
43. Johnson-Frey, S. H., Maloof, F. R., Newman-Norlund, R., Farrer, C., Inati, S., & Grafton, S. T. (2003). Actions or hand-objects interactions? Human inferior frontal cortex and action observation. Neuron, 39, 1053-1058.
44. Lakoff, G. (1987). Women, fire, and dangerous things: What categories reveal about the mind. Chicago: University of Chicago Press.
45. Land, M. F., & Furneaux, S. (1997). The knowledge base of the oculomotor system. Philosophical Transactions of the Royal Society of London-Series B: Biological Sciences, 352(1358), 1231-1239.
46. Li, P., Farkas, I., & MacWhinney, B. (2004). Early lexical development in a self-organizing neural network. Neural Networks, 17, 1345-1362.
47. MacWhinney, B. (1998). Models of the emergence of language. Annual Review of Psychology, 49, 199-227.
48. Mannella, F., Mirolli, M., & Baldassarre, G. (2010). The interplay of Pavlovian and instrumental processes in devaluation experiments: A computational embodied neuroscience model tested with a simulated rat. In C. R. Tosh & G. D. Ruxton (Eds.), Modelling perception using artificial neural networks. Cambridge: Cambridge University Press.
49. Marino, B., Gough, P. M., Gallese, V., Riggio, L., & Buccino, G. (2012). How the motor system handles nouns: A behavioural study. Psychological Research (this issue).
50. Mayor, J., & Plunkett, K. (2010). A neurocomputational account of taxonomic responding and fast mapping in early word learning. Psychological Review, 117, 1-31.
51. O'Reilly, R. C. (1998). Six Principles for Biologically-Based Computational Models of Cortical Cognition. Trends in Cognitive Sciences, 2, 455-462.
52. Oztop, E., & Arbib, M. A. (2002). Schema design and implementation of the grasp-related mirror neuron system. Biological Cybernetics, 87, 116-140.
53. Pezzulo, G., Barsalou, L. W., Cangelosi, A., Fischer, M. H., Spivey, M., & McRae, K. (2011). The mechanics of embodiment: A dialogue on embodiment and computational modeling. Frontiers in Psychology,. doi: 10. 3389/fpsyg. 2011. 00005.
54. Prescott, T. J., Montes-Gonzalez, F., Gurney, K., Humphries, M. D., & Redgrave, P. (2006). A robot model of the basal ganglia: Behavior and intrinsic processing. Neural Networks, 19, 31-61.
55. Pulvermüller, F. (2005). Brain mechanisms linking language and action. Nature Review Neuroscience, 6, 576-582.
56. Pulvermüller, F., & Fadiga, L. (2010). Active perception: Sensorimotor circuits as a cortical basis for language. Nature Reviews Neuroscience, 11, 351-360.
57. Rizzolatti, G., & Arbib, M. A. (1998). Language within our grasp. Trends in Neurosciences, 21, 188-194.
58. Rizzolatti, G., & Craighero, L. (2004). The mirror-neuron system. Annual Review of Neuroscience, 27, 169-192.
59. Rothkopf, C. A., & Ballard, D. H. (2010). Credit assignment in multiple goal embodied visuomotor behavior. Frontiers in Psychology, 1, 173.
60. Sakata, H., Taira, M., Mine, S., & Murata, A. (1992). Hand-movement-related neurons of the posterior parietal cortex of the monkey: Their role in the visual guidance of hand movements. In R. Caminiti, P. B. Johnson, & Y. Burnod (Eds.), Control of arm movement in space: Neurophysiological and computational approaches (pp. 185-198). Heidelberg: Springer.
61. Steels, L. (2003). Evolving grounded communication for robots. Trends in Cognitive Sciences, 7, 308-312.
62. Steels, L., & Vogt, P. (1997). Grounding adaptive language games in robotic agents. In I. Harvey & P. Husbands (Eds.), Proceedings of the fourth european conference on artificial life (pp. 474-482). MIT Press.
63. Strick, P. L., Dum, R. P., & Fiez, J. A. (2009). Cerebellum and non-motor function. Annual Review of Neuroscience, 32, 413-434.
64. Symes, E., Tucker, M., Ellis, R., Vainio, L., & Ottoboni, G. (2008). Grasp preparation improves change detection for congruent objects. Journal of Experimental Psychology: Human Perception and Performance, 34, 854-871.
65. Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. E. (1995). Integration of visual and linguistic information in spoken language comprehension. Science, 268, 1632-1634.
66. Tettamanti, M., Buccino, G., Saccuman, M. C., Gallese, V., Danna, M., Scifo, P., et al. (2005). Listening to action-related sentences activates fronto-parietal motor circuits. Journal of Cognitive Neuroscience, 17, 273-281.
67. Thill, S., Caligiore, D., Borghi, A. M., Ziemke, T., & Baldassarre, G. (2012). Integrating theories and computational models of affordance control and mirror neurons: A review and a model design. Neuroscience & Biobehavioral Reviews (Submitted).
68. Tsiotas, G., Borghi, A. M., & Parisi, D. (2005). Objects and affordances: An Artificial Life simulation. In B. Bara, L. Barsalou, B. Bucciarelli (Eds.), COGSCI2005. XXVII Annual Conference of the Cognitive Science Society (pp. 2212-2217). Mahwah, N. J.: Lawrence Erlbaum Associates.
69. Tucker, M., & Ellis, R. (1998). On the relations between seen objects and components of potential actions. Journal of Experimental Psychology: Human Perception and Performance, 24, 830-846.
70. Tucker, M., & Ellis, R. (2001). The potentiation of grasp types during visual object categorization. Visual Cognition, 8, 769-800.
71. Tucker, M., & Ellis, R. (2004). Action priming by briefly presented objects. Acta Psychologica, 116, 185-203.
72. Watkins, K. E., Strafella, A. P., & Paus, T. (2003). Seeing and hearing speech excites the motor system involved in speech production. Neuropsychologia, 41, 989-994.
73. Weiner, K. S., & Grill-Spector, K. (2010). Sparsely-distributed organization of face and limb activations in human ventral temporal cortex. Neuroimage, 52, 1559-1573.
74. Weiner, K. S., & Grill-Spector, K. (2011). Not one extrastriate body area: Using anatomical landmarks, hMT+, and visual field maps to parcellate limb-selective activations in human lateral occipitotemporal cortex. Neuroimage, 56, 2183-2199.
75. Weiner, K. S., & Grill-Spector, K. (2012). Neural representations of faces and limbs neighbor in human high-level visual cortex: Evidence for a new organization principle. Psychological Research (this issue).
76. Willems, R. M., & Hagoort, P. (2007). Neural evidence for the interplay between language, gesture and action: A review. Brain and Language, 101, 278-289.
77. Yoon, E. Y., Heinke, D., & Humphreys, G. (2002). Modelling direct perceptual constraints on action selection: The Naming and Action Model (NAM). Visual Cognition, 9, 615-661.
78. Zwaan, R. A. (2004). The immersed experiencer: Toward an embodied theory of language comprehension. In B. H. Ross (ed.), Psychology of learning and motivation, (vol. 44, pp. 35-62). New York: Academic.