Grounding language in action and perception: From cognitive agents to humanoid robots

Physics of Life Reviews

Volumn 7, Issue 2, 2010, Pages 139-151

  Cangelosi, Angelo ^a  

^a UNIVERSITY OF PLYMOUTH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITIVE AGENTS; COGNITIVE ROBOTICS; DEVELOPMENTAL ROBOTICS; EMBODIED COGNITION; GROUNDING LANGUAGE; HUMANOID ROBOT; HUMANOID ROBOTICS; LANGUAGE EVOLUTION; LANGUAGE GROUNDING; MULTI AGENT SIMULATION; OPEN SOURCES; ROBOTIC AGENTS; SYMBOL GROUNDING;

ANTHROPOMORPHIC ROBOTS; BIOLOGY; COGNITIVE SYSTEMS; COMPUTER SIMULATION; COMPUTER SIMULATION LANGUAGES; PROCESS DESIGN; ROBOTICS;

LINGUISTICS;

ANIMAL; ARTICLE; BRAIN; COGNITION; CYBERNETICS; HUMAN; LANGUAGE; MOVEMENT (PHYSIOLOGY); PERCEPTION; PHYSIOLOGY; ROBOTICS;

ANIMALS; BRAIN; COGNITION; CYBERNETICS; HUMANS; LANGUAGE; MOVEMENT; PERCEPTION; ROBOTICS;

EID: 77952890268     PISSN: 15710645     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.plrev.2010.02.001     Document Type: Review

References (68)

1. Barsalou L. Perceptual symbol systems. Behavioral and Brain Sciences 22 (1999) 577-609
2. Blondin-Massé A, Chicoisne G, Gargouri Y, Harnad S, Picard O, Marcotte O. How is meaning grounded in dictionary definitions? In: TextGraphs-3 workshop - 22nd international conference on computational linguistics; 2008
3. Bongard J.C., and Pfeifer R. Evolving complete agents using artificial ontogeny. In: Hara F., and Pfeifer R. (Eds). Morpho-functional machines: The new species (designing embodied intelligence) (2003), Springer-Verlag 237-258
4. Borghi A.M., Glenberg A., and Kaschak M. Putting words in perspective. Memory and Cognition 32 6 (2004) 863-873
5. Brighton H., Smith K., and Kirby S. Language as an evolutionary system. Physics of Life Reviews 2 3 (2005) 177-226
6. Burgess C., and Lund K. Modeling parsing constraints with high-dimensional context space. Language and Cognitive Processes 12 (1997) 177-210
7. Cangelosi A. Evolution of communication and language using signals, symbols and words. IEEE Transactions on Evolutionary Computation 5 2 (2001) 93-101
8. Cangelosi A. Approaches to grounding symbols in perceptual and sensorimotor categories. In: Cohen H., and Lefebvre C. (Eds). Handbook of categorization in cognitive science (2005), Elsevier 719-737
9. Cangelosi A. The grounding and sharing of symbols. Pragmatics and Cognition 14 2 (2006) 275-285
10. Cangelosi A. The symbol grounding problems has been solved: Or maybe not?. AMD Newsletter 6 2 (2009) 10-12
11. Cangelosi A, et al. Integration of action and language knowledge: A roadmap for developmental robotics. IEEE Transactions on Autonomous Mental Development, submitted for publication
12. In: Cangelosi A., Bugmann G., and Borisyuk R. (Eds). Modeling language, cognition and action: Proceedings of the 9th neural computation and psychology workshop (2005), World Scientific, Singapore
13. Cangelosi A., and Parisi D. The emergence of a "language" in an evolving population of neural networks. Connection Science 10 2 (1998) 83-97
14. Cangelosi A., Greco A., and Harnad S. From robotic toil to symbolic theft: Grounding transfer from entry-level to higher-level categories. Connection Science 12 2 (2000) 143-162
15. Cangelosi A., and Harnad S. The adaptive advantage of symbolic theft over sensorimotor toil: Grounding language in perceptual categories. Evolution of Communication 4 1 (2000) 117-142
16. Cangelosi A., and Parisi D. The processing of verbs and nouns in neural networks: Insights from synthetic brain imaging. Brain and Language 89 2 (2004) 401-408
17. In: Cangelosi A., and Parisi D. (Eds). Simulating the evolution of language (2002), Springer, London
18. Cangelosi A., and Riga T. An embodied model for sensorimotor grounding and grounding transfer: Experiments with epigenetic robots. Cognitive Science 30 4 (2006) 673-689
19. Cangelosi A., Tikhanoff V., Fontanari J.F., and Hourdakis E. Integrating language and cognition: A cognitive robotics approach. IEEE Computational Intelligence Magazine 2 3 (2007) 65-70
20. Cappa S.F., and Perani D. The neural correlates of noun and verb processing. Journal of Neurolinguistics 16 2-3 (2003) 183-189
21. Chicoisne G, Blondin-Masse A, Picard O, Harnad S. Grounding abstract word definitions in prior concrete experience. In: Sixth annual conference on the mental lexicon. University of Alberta, Banff (Alberta); 7-10 October 2008
22. Coventry KR, Cangelosi A, Rajapakse R, Bacon A, Newstead S, Joyce D, et al. Spatial prepositions and vague quantifiers: Implementing the functional geometric framework. In: Spatial cognition conference 2004. Germany; 11-13 October 2004
23. Coventry K.R., and Garrod S.C. Saying, seeing and acting: The psychological semantics of spatial prepositions. Essays in cognitive psychology series (2004), Psychology Press, Hove and New York
24. Coventry KR, Lynott L, Cangelosi A, Knight L, Joyce D, Richardson DC. Spatial language, visual attention, and perceptual simulation. Brain and Language, in press
25. Coventry K.R., Prat-Sala M., and Richards L.V. The interplay between geometry and function in the comprehension of over, under, above and below. Journal of Memory and Language 44 (2001) 376-398
26. Elman J.L. Finding structure in time. Cognitive Science 14 (1990) 179-211
27. Feldman J., and Narayanan S. Embodied meaning in a neural theory of language. Brain and Language 89 (2004) 385-392
28. Fodor J.A. The language of thought (1975), Harvard University Press, Cambridge (MA)
29. Fontanari J.F., and Perlovsky L.I. Evolving compositionality in evolutionary language games. IEEE Transactions on Evolutionary Computation 11 6 (2007) 758-769
30. Gallese V., and Lakoff G. The brain's concepts: The role of the sensory-motor system in reason and language. Cognitive Neuropsychology 22 (2005) 455-479
31. Glenberg A., and Kaschak K. Grounding language in action. Psychonomic Bulletin & Review 9 3 (2002) 558-565
32. Glenberg A.M., and Robertson D.A. Symbol grounding and meaning: A comparison of high-dimensional and embodied theories of meaning. Journal of Memory & Language 43 3 (2000) 379-401
33. Goldberg A.E. Constructions at work: The nature of generalization in language (2006), Oxford University Press, Oxford
34. Harnad S. The origin of words: A psychophysical hypothesis. In: Velichkovsky B., and Rumbaugh D. (Eds). Communicating meaning: Evolution and development of language (1996), Erlbaum, NJ 27-44
35. Harnad S. The symbol grounding problem. Physica D 42 (1990) 335-346
36. Harnad S. From sensorimotor categories to grounded symbols. Technical report ECS. University of Southampton; 2009
37. Hauk O., Johnsrude I., and Pulvermuller F. Somatotopic representation of action words in human motor and premotor cortex. Neuron 41 2 (2004) 301-307
38. Kirby S., and Hurford J. The emergence of linguistic structure: An overview of the iterated learning model. In: Cangelosi A., and Parisi D. (Eds). Simulating the evolution of language (2002), Springer, London
39. Landauer T.K., and Dumais S.T. A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review 104 (1997) 211-240
40. Lungarella M., Metta G., Pfeifer R., and Sandini G. Developmental robotics: A survey. Connection Science 15 4 (2003) 151-190
41. In: Lyon C., Nehaniv C.L., and Cangelosi A. (Eds). Emergence of communication and language (2007), Springer, London
42. Macura Z, Cangelosi A, Ellis R, Bugmann D, Fischer MH, Myachykov A. A cognitive robotic model of grasping. In: Proceedings of the ninth international conference on epigenetic robotics. Venice; November 12-14, 2009
43. Massera G., Cangelosi A., and Nolfi S. Evolution of prehension ability in an anthropomorphic neurorobotic arm. Frontiers in Neurorobotics 1 4 (2007)
44. Metta G., Sandini G., Vernon D., Natale L., and Nori F. The iCub humanoid robot: An open platform for research in embodied cognition. In: Madhavan R., and Messina E.R. (Eds). Proceedings of IEEE workshop on performance metrics for intelligent systems workshop (PerMIS'08) (2008), Washington (DC)
45. Munroe S., and Cangelosi A. Learning and the evolution of language: The role of cultural variation and learning cost in the Baldwin effect. Artificial Life 8 (2002) 311-339
46. Nehaniv C.L., Lyon C., and Cangelosi A. Current work and open problems: A roadmap for research into the emergence of communication and language. In: Lyon C., Nehaniv C.L., and Cangelosi A. (Eds). Emergence of communication and language (2007), Springer, London
47. Nolfi S., and Floreano D. Evolutionary robotics: The biology, intelligence and technology of self-organizing machines (2000), MIT Press/Bradford Books, Cambridge (MA)
48. In: Pecher D., and Zwaan R.A. (Eds). Grounding cognition: The role of perception and action in memory, language, and thinking (2005), Cambridge University Press, Cambridge (UK)
49. Perlovsky L. Neural networks and intellect: Using model-based concepts (2001), Oxford University Press, New York
50. Perlovsky L. Integrating language and cognition. IEEE Connections 2 2 (2004) 8-13
51. Perlovsky L.I. Language and cognition. Neural Networks 22 3 (2009) 247-257
52. Pulvermuller F. The neuroscience of language: On brain circuits of words and serial order (2003), Cambridge University Press, Cambridge
53. Rizzolatti G., and Arbib M.A. Language within our grasp. Trends in Neurosciences 21 5 (1998) 188-194
54. Steels L. Evolving grounded communication for robots. Trends in Cognitive Sciences 7 7 (2003) 308-312
55. Steels L. The symbol grounding problem has been solved. So what's next?. In: de Vega M. (Ed). Symbols and embodiment: Debates on meaning and cognition (2008), Oxford University Press, Oxford 223-244
56. Steels L., and Belpaeme T. Coordinating perceptually grounded categories through language. A case study for colour. Behavioral and Brain Sciences 28 4 (2005) 469-489
57. Steels L., and Kaplan K. AIBO's first words: The social learning of language and meaning. Evolution of Communication 4 1 (2000) 3-32
58. Talmy L. Toward a cognitive semantics, vol. I (2000), Cambridge University Press, Cambridge
59. Tikhanoff V, Cangelosi A, Metta G. Language understanding in humanoid robots: Simulation experiments with iCub platform. Submitted for publication
60. Tikhanoff V., Cangelosi A., Fitzpatrick P., Metta G., Natale L., and Nori F. An open-source simulator for cognitive robotics research: The prototype of the iCub humanoid robot simulator. In: Madhavan R., and Messina E.R. (Eds). Proceedings of IEEE workshop on performance metrics for intelligent systems workshop (PerMIS'08) (2008), Washington (DC)
61. Tikhanoff V. Development of cognitive capabilities in humanoid robots. PhD thesis. Plymouth (UK): School of Computing, Communications & Electronics, University of Plymouth; 2009
62. Tikhanoff V, Miranda ER. Musical composition by an autonomous robot: An approach to AIBO interaction. In: Proceedings of TAROS 2005 (Towards autonomous robotic system). London (UK): Imperial College, 2005. p. 181-8
63. Tomasello M. First verbs: A case study of early grammatical development (1992), CUP, Cambridge
64. Tomasello M. Constructing a language: A usage-based theory of language acquisition (2003), Harvard University Press
65. Vogt P. The physical symbol grounding problem. Cognitive Systems Research 3 3 (2002) 429-457
66. Weng J., McClelland J., Pentland A., Sporns O., Stockman I., Sur M., et al. Autonomous mental development by robots and animals. Science 291 (2001) 599-600
67. Wilson M. Six views of embodied cognition. Psychonomic Bulletin and Review 9 (2002) 625-636
68. Ziemke T. On the role of robot simulations in embodied cognitive science. AISB Journal 1 4 (2003) 389-399