Towards an integrated model of speech and gesture production for multi-modal robot behavior

Proceedings - IEEE International Workshop on Robot and Human Interactive Communication

Volumn , Issue , 2010, Pages 614-619

  Salem, Maha ^a   Kopp, Stefan ^b   Wachsmuth, Ipke ^b   Joublin, Frank ^c  

^a Research Institute for Cognition and Robotics   (Germany)

^b BIELEFELD UNIVERSITY   (Germany)

^c HONDA RESEARCH INSTITUTE EUROPE GMBH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ARM MOVEMENTS; BEHAVIOR REPRESENTATION; CONVERSATIONAL AGENTS; HUMANOID ROBOT; INTEGRATED MODELS; MOTOR ACTIONS; MOTOR CONTROL; MOTOR SYSTEMS; MULTI-MODAL; PHYSICAL ROBOTS; PRODUCTION MODELS; ROBOT BEHAVIOR; ROBOT CONTROL ARCHITECTURE; RUNTIMES; TEXT-TO-SPEECH SYSTEM; VIRTUAL AGENT; VIRTUAL HUMANS;

ANTHROPOMORPHIC ROBOTS; SPEECH SYNTHESIS; VIRTUAL REALITY;

ROBOT PROGRAMMING;

EID: 78649892414     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ROMAN.2010.5598665     Document Type: Conference Paper

References (25)

1. M. Bennewitz, F. Faber, D. Joho, and S. Behnke. Fritz - A Humanoid Communication Robot. In RO-MAN 07: Proc. of the 16th IEEE International Symposium on Robot and Human Interactive Communication, 2007.
2. C. Breazeal and B. Scassellati. How to Build Robots that Make Friends and Influence People. In International Conference on Intelligent Robots and Systems, 1999. IROS '99. Proceedings. 1999 IEEE/RSJ, volume 2, pages 858-863, 1999.
3. S. Calinon and A. Billard. Learning of Gestures by Imitation in a Humanoid Robot. In K. Dautenhahn and C.L. Nehaniv, editors, Imitation and Social Learning in Robots, Humans and Animals: Behavioural, Social and Communicative Dimensions, pages 153-177. Cambridge University Press, 2007.
4. J. Cassell, T. Bickmore, L. Campbell, H. Vilhjálmsson, and H. Yan. Human Conversation as a System Framework: Desigining Embodied Conversational Agents. In Embodied Conversational Agents, pages 29-63. MIT Press: Cambridge, MA, 2000.
5. M. Gienger, H. Janßen, and S. Goerick. Task-Oriented Whole Body Motion for Humanoid Robots. In Proceedings of the IEEE-RAS International Conference on Humanoid Robots, Tsukuba, Japan, 2005.
6. J.F. Gorostiza, R. Barber, A.M. Khamis, M. Malfaz, R. Pacheco, R. Rivas, A. Corrales, E. Delgado, and M.A. Salichs. Multimodal Human-Robot Interaction Framework for a Personal Robot. In ROMAN 06: Proc. of the 15th IEEE International Symposium on Robot and Human Interactive Communication, 2006.
7. B. Hartmann, M. Mancini, and C. Pelachaud. Implementing Expressive Gesture Synthesis for Embodied Conversational Agents. Gesture in Human-Computer Interaction and Simulation, 2005.
8. S. Kopp, K. Bergmann, and I. Wachsmuth. Multimodal Communication from Multimodal Thinking - Towards an Integrated Model of Speech and Gesture Production. Semantic Computing, 2(1):115-136, 2008.
9. S. Kopp and I. Wachsmuth. A Knowledge-based Approach for Lifelike Gesture Animation. In W. Horn, editor, ECAI 2000 - Proceedings of the 14th European Conference on Artificial Intelligence, pages 663- 667, Amsterdam, 2000. IOS Press.
10. S. Kopp and I. Wachsmuth. Synthesizing Multimodal Utterances for Conversational Agents. Computer Animation and Virtual Worlds, 15(1):39-52, 2004.
11. A. Kranstedt, S. Kopp, and I. Wachsmuth. MURML: A Multimodal Utterance Representation Markup Language for Conversational Agents. In Proceedings of the AAMAS02 Workshop on Embodied Conversational Agents - let's specify and evaluate them, Bologna, Italy, July 2002.
12. M.L. Latash. Control of Human Movement. Human Kinetics Publishers, Champaign, IL, USA, 1993.
13. K.F. Macdorman and H. Ishiguro. The Uncanny Advantage of Using Androids in Cognitive and Social Science Research. Interaction Studies, 7(3):297-337, 2006.
14. M. J. Mataric and M. Pomplun. Fixation Behavior in Observation and Imitation of Human Movement. Cognitive Brain Research, 7(2):191-202, 1998.
15. D. McNeill. Hand and Mind: What Gestures Reveal about Thought. University of Chicago Press, Chicago, 1992.
16. T. Minato, M. Shimada, H. Ishiguro, and S. Itakura. Development of an Android Robot for Studying Human-Robot Interaction. Innovations in Applied Artificial Intelligence, pages 424-434, 2004.
17. T. Miyashita, K. Shinozawa, and N. Hagita. Gesture Translation for Heterogeneous Robots. In Proceedings of 6th IEEE-RAS International Conference on Humanoid Robots, pages 462-467, 2006.
18. R. Niewiadomski, E. Bevacqua, M. Mancini, and C. Pelachaud. Greta: An Interactive Expressive ECA System. In Proceedings of 8th Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS2009), pages 1399-1400, 2009.
19. N.S. Pollard, J.K. Hodgins, M.J. Riley, and C.G. Atkeson. Adapting Human Motion for the Control of a Humanoid Robot. In Proceedings of International Conference on Robotics and Automation, pages 1390- 1397, 2002.
20. E. Reiter and R. Dale. Building Natural Language Generation Systems. Cambridge Univ. Press, 2000.
21. M. Salem, S. Kopp, I.Wachsmuth, and F. Joublin. Towards Meaningful Robot Gesture. In Proceedings of the 3rd International Workshop on Human-Centered Robotic Systems (HCRS'09). Springer, 2009.
22. M. Schröder and Jürgen Trouvain. The German Text-to-Speech Synthesis System MARY: A Tool for Research, Development and Teaching. In International Journal of Speech Technology, pages 365- 377, 2003.
23. M.R. Sheridan. Planning and Controlling Simple Movements. The Psychology of Human Movement, pages 47-82, 1984.
24. C.L. Sidner, C. Lee, and N. Lesh. The Role of Dialog in Human Robot Interaction. In International Workshop on Language Understanding and Agents for Real World Interaction, 2003.
25. I. Wachsmuth and S. Kopp. Lifelike Gesture Synthesis and Timing for Conversational Agents. In I. Wachsmuth and T. Sowa, editors, Gesture and Sign Language in Human-Computer Interaction, LNAI 2298, pages 120-133, Berlin, 2002. Springer.