Real-time spoken-language programming for cooperative interaction with a humanoid apprentice

International Journal of Humanoid Robotics

Volumn 6, Issue 2, 2009, Pages 147-171

  Dominey, Peter Ford ^a   Mallet, Anthony ^b   Yoshida, Eiichi ^c  

^a CNRS   (France)

^b LAAS CNRS   (France)

^c NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

Author keywords

Cooperative interaction; Humanoid apprentice; Real time spoken language

Indexed keywords

CO-OPERATIVE ASSEMBLY; COOPERATIVE INTERACTION; COOPERATIVE INTERACTIONS; HUMANOID APPRENTICE; INITIAL CONDITIONS; MOTOR ACT; MULTIPLE FUNCTION; REAL-TIME SPOKEN LANGUAGE; SEQUENCE ACQUISITION; SPOKEN LANGUAGES; TASK DOMAIN; TASK RELEVANT;

APPRENTICES; INTELLIGENT ROBOTS; MOTORS; REAL TIME SYSTEMS; ROBOT PROGRAMMING;

LINGUISTICS;

EID: 68049086586     PISSN: 02198436     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219843609001711     Document Type: Article

References (26)

1. A. Goldberg, Constructions: A new theoretical approach to language, Trends in Cognitive Sciences 7 (2003) 219-224.
2. P. F. Dominey, Chapter 11: Spoken language and vision for adaptive human-robot cooperation, Humanoid Robots, New Developments, ed. A. C. de Pina Filho (ARS International, Vienna, 2007), pp. 185-209.
3. P. F. Dominey and J. D. Boucher, Learning to talk about events from narrated video in the construction grammar framework, Artif. Intell. 167 (2005) 31-61.
4. P. F. Dominey, Learning grammatical constructions from narrated video events for human-robot interaction, Proc. of the IEEE Humanoid Robotics Conf., Karlsruhe, Germany (2003).
5. P. F. Dominey, J. D. Boucher and T. Inui, Building an adaptive spoken language interface for perceptually grounded human-robot interaction, Proc. of the IEEE-RAS/RSJ Int. Conf. Humanoid Robots (2004).
6. P. F. Dominey, M. Alvarez, B. Gao, M. Jeambrun, A. Weitzenfeld and A. Medrano, Robot command, interrogation and teaching via social interaction, Proc. IEEE Conf. on Humanoid Robotics (2005).
7. P. F. Dominey, A. Mallet and E. Yoshida, Progress in programming the HRP-2 humanoid using spoken language, Proc. of ICRA 2007 (Rome, 2007).
8. M. N. Nicolescu and M. J. Mataric, Learning and interacting in human-robot domains, IEEE Trans. Sys. Man Cybernetics B 31 5) 419-430.
9. S. Lauria, G. Buggmann, T. Kyriacou and E. Klein, Mobile robot programming using natural language, Robotics and Autonomous Systems 38(3-4) (2002) 171-181.
10. T. Kyriacou, G. Bugmann and S. Lauria, Vision-based urban navigation procedures for verbally instructed robots, Robotics and Autonomous Systems (51) (2005) 69-80.
11. N. Mavridis and D. Roy, Grounded situation models for robots: Where words and percepts meet, Proc. of the IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS) (2006).
12. R. Zöllner, T. Asfour and R. Dillman, Programming by demonstration: dual-arm manipulation tasks for humanoid robots, Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS, 2004).
13. S. Calinon, F. Guenter and A. Billard, On learning the statistical representation of a task and generalizing it to various contexts, Proc. IEEE/ICRA (2006).
14. K. Kaneko, F. Kanehiro, S. Kajita, H. Hirukawa, T. Kawasaki, M. Hirata, K. Akachi and T. Isozumi, Humanoid robot hrp-2, Proc. of the 2004 IEEE Int. Conf. on Robotics & Automation 2 (2004) 1083-1090.
15. F. Kanehiro, N. Miyata, S. Kajita, K. Fujiwara, H. Hirukawa, Y. Nakamura, K. Yamane, I. Kohara, Y. Kawamura and Y. Sankai, Virtual humanoid robot platform to develop controllers of real humanoid robots without porting, Proc. Int. Conf. on Intelligent Robots and Systems (2001) 1093-1099.
16. P. F. Dominey, M. Hoen and T. Inui, A neurolinguistic model of grammatical construction processing, J. of Cognitive Neuroscience 18(12) (2006) 2088-2107.
17. B. Hoff and M. Arbib, A model of the effects of speed, accuracy, and perturbation on visually guided reaching, Control of Arm Movement in Space: Neurophysiological and Computational Approaches, eds. R. Caminiti, P. B. Johnson and Y. Burnod (1992), pp. 285-306.
18. K. Shoemake, Animating rotation with quaternion curves, SIGGRAPH (1985) 245-254.
19. D. Roy, K.-Y. Hsiao and N. Mavridis, Mental imagery for a conversational robot, IEEE Transactions on Systems, Man, and Cybernetics, Part B 34(3) (2004) 1374-1383.
20. N. Iwahashi, Language acquisition through a human-robot interface by combining speech, visual, and behavioral information, Information Sciences 156(1-2) (2003) 109-121.
21. O. Lemon and X. Liu, DUDE: A dialogue and understanding development environment, mapping business process models to information state update dialog system, Proceedings of EACL (2006).
22. H. Asoh, Y. Motomura, F. Asano, I. Hara, S. Hayamizu, K. Itou, T. Kurita, T. Matsui, R. Bunschoten and B. Kröse, Jijo-2: An office robot that communicates and learns, IEEE Intelligent Systems (2001) 46-55.
23. S. Hüwel and B. Wrede, Spontaneous speech understanding for robust multi-modal human-robot communication, Proc. of the COLING/ACL 2006 Main Conference Poster Sessions (2006) 391-398.
24. D. J. Kulic, D. Lee, C. Ott and Y. Nakamura, Incremental learning of full body motion primitives for humanoid robots, IEEE Int. Conf. on Humanoid Robots (2008) 326-332.
25. P. F. Dominey, G. Metta, L. Natale and F. Nori, Anticipation and initiative in dialog and behavior during cooperative human-humanoid interaction, IEEE-RAS Int. Conf. on Humanoid Robots, December 1-3 (Daejeon, Korea, 2008).
26. G. R. Bradski, Computer vision face tracking for use in a perceptual user interface, Intel Technology Journal, 2nd Quarter (1998).