Towards a platform-independent cooperative human robot interaction system: III An architecture for learning and executing actions and shared plans

IEEE Transactions on Autonomous Mental Development

Volumn 4, Issue 3, 2012, Pages 239-253

  Lallee, Stephane ^a   Pattacini, Ugo ^b   Lemaignan, Séverin ^c   Lenz, Alexander ^d   Melhuish, Chris ^d   Natale, Lorenzo ^b   Skachek, Sergey ^d   Hamann, Katharina ^e   Steinwender, Jasmin ^e   Sisbot, Emrah Akin ^c   Metta, Giorgio ^b   Guitton, Julien ^c   Alami, Rachid ^c   Warnier, Matthieu ^c   Pipe, Tony ^d   Warneken, Felix ^f   Dominey, Peter Ford ^a  

^a STEM CELL AND BRAIN RESEARCH INSTITUTE   (France)

^b ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^c LAAS CNRS   (France)

^d BRISTOL ROBOTICS LABORATORY   (United Kingdom)

^e MAX PLANCK INSTITUTE FOR EVOLUTIONARY ANTHROPOLOGY   (Germany)

^f HARVARD UNIVERSITY   (United States)

Author keywords

Computer supported cooperative work; distributed representations; knowledge acquisition; knowledge base management; knowledge management; natural language; natural language interfaces; psychology; robotics; user interface management systems; vision and scene understanding; voice I O; web based interaction

Indexed keywords

COOPERATIVE WORKS; DISTRIBUTED REPRESENTATION; KNOWLEDGE BASE; NATURAL LANGUAGE INTERFACES; NATURAL LANGUAGES; PSYCHOLOGY; USER INTERFACE MANAGEMENT SYSTEMS; VISION AND SCENE UNDERSTANDING; WEB-BASED INTERACTION;

COGNITIVE SYSTEMS; HUMAN COMPUTER INTERACTION; KNOWLEDGE ACQUISITION; KNOWLEDGE BASED SYSTEMS; KNOWLEDGE MANAGEMENT; NATURAL LANGUAGE PROCESSING SYSTEMS; ROBOTICS; SOIL STRUCTURE INTERACTIONS; USER INTERFACES;

HUMAN ROBOT INTERACTION;

EID: 84866531098     PISSN: 19430604     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAMD.2012.2199754     Document Type: Article

References (41)

1. M. Tomasello, M. Carpenter, J. Call, T. Behne, and H. Moll, "Understanding and sharing intentions: The origins of cultural cognition, " Behav. Brain Sci., vol. 28, pp. 675-691, 2005. (Pubitemid 43372568)
2. F. Warneken, F. Chen, and M. Tomasello, "Cooperative activities in young children and chimpanzees, " Child Develop., vol. 77, pp. 640-663, 2006. (Pubitemid 43736539)
3. S. Lallée, S. Lemaignan, A. Lenz, C. Melhuish, L. Natale, S. Skachek, T. van Der Zant, F. Warneken, and P. Dominey, "Towards a platformindependent cooperative human-robot interaction system: I. Perception, " in Proc. IROS, Taipei, Taiwan, 2010, pp. 4444-4451.
4. S. Lallée, U. Pattacini, J. Boucher, S. Lemaignan, A. Lenz, C. Melhuish, L. Natale, S. Skachek, K. Hamann, J. Steinwender, E. A. Sisbot, G. Metta, R. Alami, M. Warnier, J. Guitton, F. Warneken, and P. F. Dominey, "Towards a platform-independent cooperative human-robot interaction system: II. Perception, execution and imitation of goal directed actions, " in Proc. IROS, San Francisco, CA, 2011, pp. 2895-2902.
5. G. Metta, G. Sandini, D. Vernon, L. Natale, and F. Nori, "The iCub humanoid robot: An open platform for research in embodied cognition, " in Proc. PerMIS: Perform. Metrics Intell. Syst. Workshop, Washington, DC, 2008, pp. 19-21.
6. S. S. A. Lenz, K. Hamann, J. Steinwender, A. G. Pipe, and C. R. Melhuish, The BERT2 Infrastructure: An Integr. Syst. Study Human-Robot Interact., 2010.
7. D. Sperber and L. A. Hirschfeld, "The cognitive foundations of cultural stability, " Trends Cogn. Sci., vol. 8, p. 6, 2004.
8. T. Froese and T. Ziemke, "Enactive artificial intelligence: Investigating the systemic organization of life and mind, " Artif. Intell., vol. 173, pp. 466-500, 2009.
9. F. Warneken and M. Tomasello, "Helping and cooperation at 14months of age, " Infancy, vol. 11, pp. 271-294, 2007.
10. C. Brownell, G. Ramani, and S. Zerwas, "Becoming a social partner with peers: Cooperation and social understanding in one-and two-yearolds, " Child Develop., vol. 77, pp. 803-821, 2006. (Pubitemid 44117897)
11. M. Carpenter, M. Tomasello, and T. Striano, "Role reversal imitation and language in typically developing infants and children with autism, " Infancy, vol. 8, pp. 253-278, 2005.
12. P. Dominey and F. Warneken, "The basis of shared intentions in human and robot cognition, " New Ideas Psychol., 2009, to be published.
13. S. Lallée, F. Warneken, and P. Dominey, "Learning to collaborate by observation, " in Epirob, Venice, 2009.
14. J. Ashley and M. Tomasello, "Cooperative problem-solving and teaching in preschoolers, " Social Develop., vol. 7, pp. 143-163, 1998. (Pubitemid 128087899)
15. P. Dominey, G. Metta, F. Nori, and L. Natale, "Anticipation and initiative in human-humanoid interaction, " in Proc. Int. Conf. Humanoid Robot., Daejeon, Korea, 2008.
16. P. Dominey, A. Mallet, and E. Yoshida, "Real-time cooperative behavior acquisition by a humanoid apprentice, " in Proc. Int. Conf. Humanoid Robot., Pittsburg, PA, 2007.
17. M. Tomasello, The Cultural Origins of Human Cognition. Cambridge, MA: Harvard Univ. Press, 1999.
18. J. Mandler, Ed., Preverbal Representation and Language (Language and Space MIT Press, 1996.
19. L. Talmy, "Force dynamics in language and cognition, " Cogn. Sci., vol. 12, pp. 49-100, 1988.
20. L. Kotovsky and R. Baillargeon, "The development of calibration-based reasoning about collision events in young infants, " Cognition, vol. 67, pp. 311-351, 1998. (Pubitemid 128403691)
21. J. Siskind, "Grounding the lexical semantics of verbs in visual perception using force dynamics and event logic, " J. Artif. Intell. Res., vol. 15, pp. 31-90, 2001.
22. L. Steels and J. Baillie, "Shared grounding of event descriptions by autonomous robots, " Robot. Autonom. Syst., vol. 43, pp. 163-173, 2003.
23. P. Dominey and J. Boucher, "Learning to talk about events from narrated video in a construction grammar framework, " Artif. Intell., vol. 167, pp. 31-61, 2005. (Pubitemid 41240677)
24. P. Greenfield, "Language, tools and brain: The ontogeny and phylogeny of hierarchically organized sequential behavior, " Behav. Brain Sci., vol. 14, pp. 531-551, 1991.
25. M. Ryoo and J. Aggarwal, Recognition of Composite Human Activities Through Context-Free Grammar Based Representation, pp. 1709-1718, 2006.
26. M. S. Ryoo and J. K. Aggarwal, "Recognition of composite human activities through context-free grammar based representation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, vol. 2, pp. 1709-1718, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.
27. S. Park and J. Aggarwal, "A hierarchical bayesian network for event recognition of human actions and interactions, " Multimedia Syst., vol. 10, pp. 164-179, 2004.
28. S. Park and J. Aggarwal, "Semantic-level understanding of human actions and interactions using event hierarchy, " in Proc. Comput. Vis. Pattern Recognit. Workshop (CVPRW '04), 2004, p. 12.
29. P. Dominey, A. Mallet, and E. Yoshida, "Progress in programming the hrp-2 humanoid using spoken language, " in Proc. IEEE Int. Conf. Robot. Autom., 2007, pp. 2169-2174. (Pubitemid 350140500)
30. P. Dominey, A. Mallet, and E. Yoshida, "Real-Time spoken-language programming for cooperative interaction with a humanoid apprentice, " Int. J. Humanoids Robot., vol. 6, pp. 147-171, 2009.
31. I. R. A. Peters, K. A. Hambuchen, and R. E. Bodenheimer, "The sensory ego-sphere: A mediating interface between sensors and cognition, " Autonom. Robots, vol. 26, pp. 1-19, 2009.
32. S. Sutton, R. Cole, J. Villiers, J. Schalkwyk, P. Vermeulen, M. Macon, Y. Yan, E. Kaiser, B. Rundle, and K. Shobaki, "Universal speech tools: The CSLU toolkit, " in Proc. 5th Int. Conf. Spoken Language Process., 1998.
33. U. Pattacini, F. Nori, L. Natale, G. Metta, and G. Sandini, "An experimental evaluation of a novel minimum-jerk Cartesian controller for humanoid robots, " in Proc. IROS, Taipei, Taiwan, 2010.
34. V. Tikhanoff, A. Cangelosi, and G. Metta, "Integration of speech and action in humanoid robots: iCub simulation experiments, " IEEE Trans. Autonom. Mental Develop., vol. 3, pp. 17-29, 2011.
35. P. Fitzpatrick, G. Metta, and L. Natale, "Towards long-lived robot genes, " Robot. Autonom. Syst., vol. 56, pp. 29-45, 2007. (Pubitemid 351491189)
36. S. Thorpe, R. Guyonneau, N. Guilbaud, J. Allegraud, and R. Van-Rullen, "SpikeNet: Real-time visual processing with one spike per neuron, " Neurocomputing, vol. 58, pp. 857-864, 2004. (Pubitemid 38684343)
37. M. Fumagalli, M. Randazzo, F. Nori, L. Natale, G. Metta, and G. Sandini, "Exploiting proximal measurements for the iCub active compliance, " in Proc. IROS, Taipei, Taiwan, 2010.
38. A. Senju and G. Csibra, "Gaze following in human infants depends on communicative signals, " Current Biol., vol. 18, pp. 668-671, 2008.
39. S. Lallée, C. Madden, M. Hoen, and P. Dominey, "Linking language with embodied teleological representations of action for humanoid cognition, " Frontiers in Neurobot., 2010.
40. Y. Demiris and M. Johnson, "Distributed, predictive perception of actions: A biologically inspired robotics architecture for imitation and learning, " Connect. Sci., vol. 15, pp. 231-243, 2003. (Pubitemid 38474542)
41. B. Argall, S. Chernova, M. Veloso, and B. Browning, "A survey of robot learning from demonstration, " Robot. Autonom. Syst., vol. 57, pp. 469-483, 2009.