Linking language with embodied and teleological representations of action for humanoid cognition

Frontiers in Neurorobotics

Volumn 4, Issue JUN, 2010, Pages

  Lallee, Stephane ^a   Madden, Carol ^a   Hoen, Michel ^a   Dominey, Peter Ford ^a  

^a INSERM   (France)

Author keywords

Action perception; Cooperation; Human robot interaction; Language

Indexed keywords

EID: 78651504027     PISSN: None     EISSN: 16625218     Source Type: Journal    
DOI: 10.3389/fnbot.2010.00008     Document Type: Article

References (69)

1. Barsalou, L. W. (1999). Perceptual symbol systems. Behav. Brain Sci. 22, 577-660.
2. Barsalou, L. W., Santos, A., Simmons, W. K., and Wilson, C. D. (2008). "Language and simulation in conceptual processing," in Symbols, Embodiment, and Meaning, eds M. De Vega, A. M. Glenberg and A. C. Graesser (Oxford, UK: Oxford University Press), 245-284.
3. Bekkering, H., Wohlschlager, A., and Gattis, M. (2000). Imitation of gestures in children is goal-directed. Q. J. Exp. Psychol. 53, 153-164.
4. Bergen, B., and Chang, N. (2005). "Embodied construction grammar in simulation-based language understanding," in Construction Grammar(s): Cognitive Grounding and Theoretical Extensions, eds J.-O. Östman and M. Fried (Amsterdam: John Benjamins), 147-156.
5. Bonawitz, E. B., Horowitz, A., Ferranti, D., and Schulz, L. (2009). "The block makes it go: causal language helps toddlers integrate prediction, action, and expectations about contact relations," in Proceedings of the Thirty-first Cognitive Science Society, eds N. Taatgen and H. van Rijn (Amsterdam: Cognitive Science Society), 81-86.
6. Borghi, A. M., and Cimatti, F. (2009). "Words as tools and the problem of abstract word meanings," in Proceedings of the Thirty-first Cognitive Science Society, eds N. Taatgen and H. van Rijn (Amsterdam: Cognitive Science Society).
7. Bowerman, M. (1974). Learning the structure of causative verbs: a study in the relationship of cognitive, semantic, and syntactic development. Proc. Res. Child Lang. Dev. 8, 142-178.
8. Brass, M., Schmitt, R. M., Spengler, S., and Gergely, G. (2007). Investigating action understanding: inferential processes versus action simulation. Curr. Biol. 17, 2117-2121.
9. Carey, S. (2009). The Origin of Concepts. New York: Oxford University Press.
10. Csibra, G. (2003). Teleological and referential understanding of action in infancy. Phil. Trans. R. Soc. Lond. B. 358, 447-458.
11. Decety, J., and Grèzes, J. (2006). The power of simulation: imagining one's own and other's behavior. Brain Res. 1079, 4-14.
12. Decety, J., and Lamm, C. (2007). The role of the right temporoparietal junction in social interaction: how low-level computational processes contribute to meta-cognition. Neuroscientist 13, 580-593.
13. Dominey, P. F. (2003). A conceptuocentric shift in the characterization of language. Comment on Jackendoff, BBS, 674-675.
14. Dominey, P. F., and Boucher, J. D. (2005). Learning to talk about events from narrated video in a construction grammar framework. Artif. Intell. 167, 31-61.
15. Dominey, P. F., Hoen, M., Blanc, J. M., and Lelekov-Boissard, T. (2003). Neurological basis of language and sequential cognition: evidence from simulation, aphasia, and ERP studies. Brain Lang. 86, 207-225.
16. Dominey, P. F., Inui, T., and Hoen, M. (2009a). Neural network processing of natural language: II. Towards a unified model of corticostriatal function in learning sentence comprehension and non-linguistic sequencing. Brain Lang. 109, 80-92.
17. Dominey, P. F., Mallet, A., and Yoshida, E. (2009b). Real-time spoken-language programming for cooperative interaction with a humanoid apprentice. Int. J. HR 6, 147-171.
18. Dominey, P. F., and Warneken, F. (in press). The origin of shared intentions in human-robot cooperation. New Ideas Psychol.
19. Dove, G. (2009). Beyond conceptual symbols. A call for representational pluralism. Cognition 110, 412-431.
20. Fadiga, L., Craighero, L., and D'Ausilio, A. (2009). Broca's area in language, action, and music. The neurosciences and music III - disorders and plasticity. Ann. N. Y. Acad. Sci. 1169, 448-458.
21. Fern, A., Givan, R., and Siskind, J. M. (2002). Specific-to-general learning for temporal events with application to learning event definitions from video. J. Artif. Intell. Res. 17, 379-449.
22. Fischer, M. H., and Zwaan, R. A. (2008). Embodied language: a review of the role of the motor system in language comprehension. Q. J. Exp. Psychol. 61, 825-850.
23. Fogassi, L., Ferrari, P. F., Gesierich, B., Rozzi, S., Chersi, F., and Rizzolatti, G. (2005). Parietal lobe: from action organization to intention understanding. Science 308, 662-667.
24. Fontanari, J. F., Tikhanoff, V., Cangelosi, A., Ilin, R., and Perlovsky, L. I. (2009). Cross-situational learning of object-word mapping using Neural Modeling Fields. Neural Netw. 22, 579-585.
25. Gergely, G., and Csibra, G. (2003). Teleological reasoning in infancy: the naïve theory of rational action. Trends Cogn. Sci. 7, 287-292.
26. Glaser, W. R. (1992). Picture naming. Cognition 42, 61-105.
27. Goldberg, A. E. (1995). Constructions: A Construction Grammar Approach to Argument Structure. Chicago: University of Chicago Press.
28. Hauk, O., Shtyrov, Y., and Pulvermüller, F. (2008). The time course of action and action-word comprehension in the human brain as revealed by neurophysiology. J. Physiol. Paris 102, 50-58.
29. Hauser, M., and Wood, J. (2010). Evolving the capacity to understand actions, intentions, and goals. Annu. Rev. Psychol. 61, 303-324.
30. Hickok, G., and Poeppel, D. (2007). The cortical organization of speech processing. Nat. Rev. Neurosci. 8, 393-402.
31. Hoen, M., Pachot-Clouard, M., Segebarth, C., and Dominey, P. F. (2006). When Broca experiences the Janus syndrome: an ER-fMRI study comparing sentence comprehension and cognitive sequence processing. Cortex 42, 605-623.
32. Hood, L., Bloom, L., and Brainerd, C. J. (1979). What, when, and how about why: a longitudinal study of early expressions of causality. Monogr. Soc. Res. Child Dev. 44, 1-47.
33. Jackendoff, R. (2002). Foundations of Language: brain, Meaning, Grammar, Evolution. Oxford University Press.
34. Jackendoff, R. (2003). Précis of Foundations of Language: brain, Meaning, Grammar, Evolution, BBS 26, 651-707.
35. Kan, I. P., Barsalou, L. W., Solomon, K. O., Minor, J. K., and Thompson-Schill, S. L. (2003). Role of mental imagery in a property verification task: fMRI evidence for perceptual representations of conceptual knowledge. Cogn. Neuropsychol. 20, 525-540.
36. Kotovsky, L., and Baillargeon, R. (1998). The development of calibration-based reasoning about collision events in young infants. Cognition 67, 311-351.
37. Lallee, S., Warkeken, F., and Dominey, P. F. (2009). "Learning to collaborate by observation and spoken language," in Ninth International Conference on Epigenetic Robotics, Venice.
38. Leslie, A. M., and Keeble, S. (1987). Do six-month-old infants perceive causality? Cognition 25, 265-288.
39. Madden, C. J., Hoen, M., and Dominey, P. F. (2010). A cognitive neuroscience perspective on embodied language for human-robot cooperation. Brain Lang. 112, 180-188.
40. Mandler, J. M. (2008). On the birth and growth of concepts. Philos. Psychol. 21, 207-230.
41. Mason, R. A., and Just, M. A. (2006). "Neuroimaging contributions to the understanding of discourse processes," in Handbook of Psycholinguistics, eds M. Traxler and M. A. Gernsbacher (Amsterdam: Elsevier), 765-799.
42. Meltzer, J. A., McArdle, J. J., Schafer, R. J., and Braun, A. R. (in press). Neural aspects of sentence comprehension: syntactic complexity, reversibility, and reanalysis. Cereb. Cortex.
43. Michotte, A. (1963). The Perception of Causality. New York: Basic Books.
44. Mirolli, M., and Parisi, D. (in press). Towards a Vygotskyan cognitive robotics: the role of language as a cognitive tool. New Ideas Psychol.
45. Obleser, J., Zimmermann, J., Van Meter, J., and Rauschecker, J. P. (2007). Multiple stages of auditory speech perception reflected in event-related FMRI. Cereb. Cortex 17, 2251-2257.
46. Parisi, D. (2006). "Simulating the evolutionary emergence of language: a research agenda," in The Evolution of Language, eds A. Cangelosi, A. D. M. Smith and K. Smith (Singapore: World Scientific), 230-238.
47. Parisi D., and Mirolli M. (2006). "The emergence of language: how to simulate it," in Emergence of Communication and Language, eds C. Lyon, C. Nehaniv and A. Cangelosi (London: Springer), 269-285.
48. Pulvermüller, F., Shtyrov, Y., and Hauk, O. (2009). Understanding in an instant: neurophysiological evidence for mechanistic language circuits in the brain. Brain Lang. 110, 81-94.
49. Rizzolatti, G., and Fabbri-Destro, M. (2008). The mirror system and its role in social cognition. Curr. Opin. Neurobiol. 18, 179-184.
50. Saur, D., Kreher, B. W., and Schnell, S., et al., (2008). Ventral and dorsal pathways for language. Proc. Natl. Acad. Sci. U. S. A. 105, 18035-18040.
51. Saxe, R., Xiao, D. K., Kovacs, G., Perrett, D. I., and Kanwisher, N. (2004). A region of right posterior superior temporal sulcus responds to observed intentional actions. Neuropsychologia 42, 1435-1446.
52. Scott, S. K., Rosen, S., Lang, H., and Wise, R. J. (2006). Neural correlates of intelligibility in speech investigated with noise vocoded speech - a positron emission tomography study. J. Acoust. Soc. Am. 120, 1075-1083.
53. Siskind, J. M. (2001). Grounding the lexical semantics of verbs in visual perception using force dynamics and event logic. J. Artif. Intell. Res. 15, 31-90.
54. Siskind, J. M. (2003). Reconstructing force-dynamic models from video sequences. Artif. Intell. 151, 91-154.
55. Sommerville, A., and Woodward, A. L. (2005). Pulling out the intentional structure of action: the relation between action processing and action production in infancy. Cognition 95, 1-30.
56. Speer, N. K., Zacks, J. M., and Reynolds, J. R. (2007). Human brain activity time-locked to narrative event boundaries. Psychol. Sci. 18, 449-455.
57. Spelke, E. S. (1990). Principles of object perception. Cogn. Sci. 14, 29-56.
58. Spelke, E. S., and Kinzler, K. D. (2007). Core knowledge. Dev. Sci. 10, 89-96.
59. Talmy, L. (1988). Force dynamics in language and cognition. Cogn. Sci. 12, 49-100.
60. Tettamanti, M., Buccino, G., Saccuman, M. C., Gallese, V., Danna, M., Scifo, P., Fazio, F., Rizzolatti, G., Cappa, S. F., and Perani, D. (2005). Listening to action-related sentences activates fronto-parietal motor circuits. J. Cogn. Neurosci. 17, 273-281.
61. Tomasello, M. (2008). Origins of Human Communication. Cambridge: MIT Press.
62. Tomasello, M., Carpenter, M., Call, J., Behne, T., and Moll, H. (2005). Understanding and sharing intentions: the origins of cultural cognition. Behav. Brain Sci. 28, 675-691.
63. Tikhanoff, V., Cangelosi, A., and Metta, G. (2009). "Language understanding in humanoid robots: simulation experiments with iCub platform", in Proceedings of 2009 International Conference on Integration of Knowledge Intensive Multi-Agent Systems (KIMAS'09), St. Louis, MA.
64. Tsagarakis, N. G., Metta, G., Sandini, G., Vernon, D., Beira, R., Becchi, F., Righetti, L., Victor, J. S., Ijspeert, A. J., Carrozza, M. C., and Caldwell, D. G. (2007). iCub - the design and realization of an open humanoid platform for cognitive and neuroscience research. Adv. Robot. 21, 1151-1175.
65. Ullman, M. T. (2004). Contributions of memory circuits to language: the declarative/procedural model. Cognition 92, 231-270.
66. Wible, C. G., Preus, A. P., and Hashimoto, R. (2009). A cognitive neuroscience view of schizophrenic symptoms: abnormal activation of a system for social perception and communication. Brain Imaging Behav. 3, 85-110.
67. Wolff, P. (2007). Representing causation. J. Exp. Psychol. Gen. 136, 82-111.
68. Woodward, A. L. (1998). Infants selectively encode the goal object of an actor's reach. Cognition 69, 1-34.
69. Zwaan, R. A., and Madden, C. J. (2005). "Embodied sentence comprehension," in Grounding cognition: The Role of Perception and Action in Memory, Language, and Thinking, eds D. Pecher and R. A. Zwaan (Cambridge, UK: Cambridge University Press), 224-245.