Grounding action words in the sensorimotor interaction with the world: Experiments with a simulated icub humanoid robot

Frontiers in Neurorobotics

Volumn 4, Issue MAY, 2010, Pages

  Marocco, Davide ^a   Cangelosi, Angelo ^a   Fischer, Kerstin ^b   Belpaeme, Tony ^a  

^a UNIVERSITY OF PLYMOUTH   (United Kingdom)

^b UNIVERSITY OF SOUTHERN DENMARK   (Denmark)

Author keywords

Cognitive robotics; Embodiment; Grounding problem

Indexed keywords

EID: 84858390996     PISSN: None     EISSN: 16625218     Source Type: Journal    
DOI: 10.3389/fnbot.2010.00007     Document Type: Article

References (68)

1. Bailey, D., Feldman, J., Narayanan, S., and Lakoff, G. (1997). "Modeling embodied lexical development," in Proceedings of the 19th Cognitive Science Society Conference, Mahwah, NJ: Erlbaum.
2. Barsalou, L. (1999). Perceptual symbol systems. Behav. Brain. Sci. 22, 577-609.
3. Beira, R., Lopes, M., Prac, M., Santos-Victor, J., Bernardino, A., Metta, G., Becchiz, F., and Saltar, R. (2006). Design of the robot-cub (iCub) head. Proc. IEEE Int. Conf. Robot. Autom. 94-100.
4. Bergen, B. (2005). "Mental simulation in literal and figurative language," in The Literal and Non-Literal in Language and Thought, eds S. Coulson and B. Lewandowska-Tomaszczyk (Frankfurt: Peter Lang), 255-278.
5. Bowerman, M., and Choi, S. (2001). "Shaping meanings for language: universal and language-specific in the acquisition of semantic categories," in Language Acquisition and Conceptual Development, eds M. Bowerman and S. C. Levinson (Cambridge: Cambridge University Press), 475-511.
6. Bowerman, M. (2005). "Why can't you "open" a nut or "break" a cooked noodle? Learning covert object categories in action word meanings," in Building Object Categories in Developmental Time, eds L. Gershkoff-Stowe and D. H. Rakison (Mahwah, NJ: Erlbaum), 209-243.
7. Cangelosi, A., and Parisi, D. (2002). Simulating the Evolution of Language. London: Springer.
8. Cangelosi, A., and Riga, T. (2006). An embodied model for sensorimotor grounding and grounding transfer: Experiments with epigenetic robots. Cogn. Sci. 30, 673-689.
9. Cannon, E. N., and Cohen, P. R. (2010). "Talk about motion: the semantic representation of verbs by motion dynamics," in The Spatial Foundations of Cognition and Language: Thinking Through Space, eds K. S. Mix, L. B. Smith and M. Gasser (New York: Oxford University Press), 235-258.
10. Clark, H. H. (1973). "Space, time, semantics and the child," in Cognitive Development and the Acquisition of Language, ed. T. E. Moore (New York: Academic Press), 27-64.
11. Cohen, P. R., Morrison, C. T., and Cannon, E. (2005). "Maps for verbs: the relation between interaction dynamics and verb use," in Proceedings of the Nineteenth International Conference on Artificial Intelligence (IJCAI 2005).
12. Dogar, M., Cakmak, M., Ugur, E., and Sahin, E. (2007). "From primitive behaviors to goal-directed behavior using affordances," in IEEE/RSJ International Conference on Intelligent Robots and Systems.
13. Dominey, P. (2005). Emergence of grammatical constructions: evidence from simulation and grounded agent experiments. Connect. Sci. 17, 289-306.
14. Feldman, J., and Narayanan, S. (2004). Embodied meaning in a neural theory of language. Brain Lang. 89, 385-392.
15. Fern, A. P., Givan, R. L., and Siskind, J. M. (2002). Specific-to-general learning for temporal events with application to learning event definitions from video. J. Artif. Intell. Res. 17, 379-449.
16. Fitzpatrick, P., Metta, G., Natale, L., Rao, S., and Sandini, G. (2003). "Learning about objects through action: initial steps towards artificial cognition," in IEEE International Conference on Robotics and Automation (Taipei, Taiwan).
17. Fritz, G., Paletta, L., Breithaupt, R., Rome, E., and Dorffner, G. (2006). "Learning predictive features in affordance based robotic perception systems," in IEEE/RSJ International Conference on Intelligent Robots and Systems. (Beijing, China).
18. Gallese, V., and Lakoff, G. (2005). The brain's concepts: the role of the sensory-motor system in reason and language. Cogn. Neuropsychol. 22, 455-479.
19. Gelman, S. A. (2009). Learning from others: children's construction of concepts. Annu. Rev. Psychol. 60, 115-140.
20. Gelman, S. A., and Heyman, G. D. (1999). Carrot-eaters and creature-believers: the effects of lexicalization on children's inferences about social categories. Psychol. Sci. 10, 489-493.
21. Glenberg, A. M. (2007). "Language and action: creating sensible combinations of ideas" in The Oxford handbook of psycholinguistics, ed. G. Gaskell (Oxford, UK: Oxford University Press), 361-370.
22. Glenberg, A. M., and Kaschak, M. P. (2002). Grounding language in action. Psychon. Bull. Rev. 9, 558-565.
23. Glenberg, A. M., and Robertson, D. A. (2000). Symbol grounding and meaning: a comparison of high-dimensional and embodied theories of meaning. J. Mem. Lang. 43, 379-401.
24. Halliday, M. A. K. (1985). An introduction to Functional Grammar. London: Edward Arnold.
25. Harnad, S. (1990). The symbol grounding problem. Physica D 42, 335-346.
26. Hatch, E. (1983). Psycholinguistics: a second language perspective. Rowley, MA: Newbury House.
27. Kaplan, F., Oudeyer, P.-Y., and Bergen, B. (2008). Computational models in the debate over language learnability. Infant Child Dev. 17, 55-80.
28. Karmiloff, K., and Karmiloff-Smith, A. (2001). Pathways to language: from fetus to adolescent. Cambridge, MA: Harvard University Press.
29. Kirby, S. (2001). Spontaneous evolution of linguistic structure: an iterated learning model of the emergence of regularity and irregularity. IEEE Trans. Evol. Comput. 5, 102-110.
30. Kozima, H., Nakagawa, G., and Yano, H. (2002). "Emergence of imitation mediated by objects," in Second International Workshop on Epigenetic Robotics (Edinburgh, Scotland).
31. Lakoff, G., and Johnson, M. (1999). Philosophy In The Flesh: the Embodied Mind and its Challenge to Western Thought. New York: Basic Books.
32. Langacker, R. W. (2008). Cognitive Grammar. New York: Oxford University Press.
33. Lyon, C., Nehaniv, C. L., and Cangelosi, A. (2007). Emergence of Communication and Language. London: Springer.
34. Mandler, J. M. (1992). How to build a baby: II. Conceptual primitives. Psychol. Rev. 99, 587-604.
35. Mandler, J. M. (1999). Seeing is not the same as thinking: commentary on "making sense of infant categorization". Dev. Rev. 19, 297-306.
36. Marocco, D., Cangelosi, A., and Nolfi, S. (2003). The emergence of communication is evolutionary robots. Philos. Trans. R Soc. Lond. A 361, 2397-2421.
37. Metta, G., Fitzpatrick, P., and Natale, L. (2006). YARP: yet another robot platform. Int. J. Adv. Robot. Sys. 3, 43-48.
38. Metta, G., Sandini, G., Vernon, D., Natale, L., and Nori, F. (2008). "The iCub humanoid robot: an open platform for research in embodied cognition," in Proceedings of IEEE Workshop on Performance Metrics for Intelligent Systems Workshop (PerMIS'08), eds R. Madhavan and E. R. Messina (Washington, DC: IEEE).
39. Montesano, L., Lopes, M., Bernardino, A., and Santos-Victor, J. (2008). Learning object affordances: from sensory motor maps to imitation. IEEE Trans. Robot. 24, 15-26.
40. Nelson, K. (1973). Some evidence for the cognitive primacy of categorization and its functional basis. Merrill Palmer Q. 19, 21-39.
41. Nolfi, S., and Marocco, D. (2002). "Active perception: a sensorimotor account of object categorization," in From Animals to Animats 7 - The Seventh International Conference on the Simulation of Adaptive Behavior, eds B. Hallam, D. Floreano, J. Hallam, G. Hayes and J.-A. Meyer (Cambridge: MIT Press), 266-271.
42. Oudeyer, P.-Y., and Kaplan, F. (2006). Discovering communication. Connect. Sci. 18, 189-206.
43. Oudeyer, P.-Y., Kaplan, F., and Hafner, V. (2007). Intrinsic motivation systems for autonomous mental development. IEEE Trans. Evol. Comput. 11, 265-286.
44. Pecher, D., and Zwaan, R. A. (2005). Grounding Cognition: The Role of Perception and Action in Memory, Language, and Thinking. Cambridge, UK: Cambridge University Press.
45. Pulvermüller, F., Haerle, M., and Hummel, F. (2001). Walking or talking? Behavioral and neurophysiological correlates of action verb processing. Brain Lang. 78, 134-168.
46. Roy, D., Hsiao, K., and Mavridis, N. (2003). Conversational robots: building blocks for grounding word meanings. In Proceedings of the HLT-NAACL03 workshop on learning word meaning from non-linguistic data.
47. Rumelhart, D. E., and McClelland, J. L. (1986). Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Vol. I. Cambridge, MA: MIT Press.
48. Sachs, J. (1983). Talking about the there and then: the emergence of displaced reference in parent-child discourse. In Children's language, Vol. 4, ed. K. E. Nelson (Hillsdale, NJ: Erlbaum).
49. Siskind, J. M. (2001). Grounding the lexical semantics of verbs in visual perception using force dynamics and event logic. J. Artif. Intell. Res. 15, 31-90.
50. Smith, L. B., Jones, S. S., and Landau, B. (1996). Naming in young children: a dumb attentional mechanism? Cognition 60, 143-171.
51. Snow, C. E. (1977). "Mothers' speech research: from input to interaction," in Talking to Children: Language Input and Acquisition, eds C. E. Snow and C. Ferguson (Cambridge: Cambridge University Press), 31-49.
52. Steels, L. (2001). Language games for autonomous robots. IEEE Intell. Syst. 16, 16-22.
53. Steels, L. (2003). Evolving grounded communication for robots. Trends Cogn. Sci. (Regul. Ed.) 7, 308-312.
54. Steels, L., and Baillie, J.-C. (2003). Shared grounding of event descriptions by autonomous robots. Rob. Auton. Syst. 43, 163-173.
55. Steels, L., and Kaplan, F. (2000). AIBO's first words: the social learning of language and meaning. Evol. Commun. 4, 3-32.
56. Steels, L., Kaplan, F., McIntyre, A., and Van Looveren, J. (2002). "Crucial factors in the origins of word-meaning," in The Transition to Language ed. A. Wray (Oxford: Oxford University Press), 252-271.
57. Stoytchev, A. (2005). "Behavior-grounded representation of tool affordances," in International Conference on Robotics and Automation (Barcelona, Spain).
58. Sugita, Y., and Tani, J. (2005). Learning semantic combinatoriality from the interaction between linguistic and behavioral processes. Adap. Behav. 13, 211-225.
59. Talmy, L. (1988). Force dynamics in language and cognition. Cogn. Sci. 12, 49-100.
60. Tikhanoff, V., Cangelosi, A., Fitzpatrick, P., Metta, G., Natale, L., and Nori, F. (2008). "An open-source simulator for cognitive robotics research: the prototype of the iCub humanoid robot simulator," in Proceedings of IEEE Workshop on Performance Metrics for Intelligent Systems Workshop (PerMIS'08), eds R. Madhavan and E. R. Messina (Washington, DC).
61. Tsagarakis, G., Metta, G., Sandini, D., Vernon, R., Beira, F., Becchi, L., Righetti, J., Santos-Victor, J., Ijspeert, A. J., Carrozza, M. D., and Caldwell, D. G. (2007). iCub: the design and realization of an open humanoid platform for cognitive and neuroscience research. Adv. Robot. 21, 1151-1175.
62. Veneziano, E. (2001). Displacement and informativeness in child-directed talk. First Lang. 21, 323-356.
63. Werbos, P. J. (1990). Backpropagation through time: what it does and how to do it. Proc. IEEE 78, 1550-1560.
64. Wierzbicka, A. (1985). Lexicography and Conceptual Analysis. Ann Arbor: Karoma.
65. Williams, R. J., and Zipser, D. (1995). "Gradient-based learning algorithms for recurrent networks and their computational complexity," in Backpropagation: Theory, Architectures, and Applications, eds Y. Chauvin and D. E. Rumelhart (Mahwah, NJ: Lawrence Erlbaum Associates), 433-486.
66. Yamashita, Y., and Tani, J. (2008). Emergence of functional hierarchy in a multiple timescale neural network model: a humanoid robot experiment. PLoS Comput. Biol. 4, e1000220. doi:10.1371/journal.pcbi.1000220
67. Yu, C. (2005). The emergence of links between lexical acquisition and object categorization: a computational study. Connect. Sci. 17, 381-397.
68. Ziemke, T. (2003). On the role of robot simulations in embodied cognitive science. AISB J. 1, 389-399.