Increasing the expressiveness of virtual agents- Autonomous generation of speech and gesture for spatial description tasks

Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS

Volumn 1, Issue , 2009, Pages 507-514

  Bergmann, Kirsten ^a   Kopp, Stefan ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

Bodied conversational agents; Expressiveness; Gesture; Language; Multimodal output

Indexed keywords

KNOWLEDGE REPRESENTATION; MULTI AGENT SYSTEMS; USER INTERFACES;

CONVERSATIONAL AGENTS; EXPRESSIVENESS; GESTURE; LANGUAGE; MULTIMODAL OUTPUT;

AUTONOMOUS AGENTS;

EID: 84899861845     PISSN: 15488403     EISSN: 15582914     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. J. Bavelas, J. Gerwing, C. Sutton, and D. Prevost. Gesturing on the telephone: Independent effects of dialogue and visibility. Journal of Memory and Language, 58:495-520, 2008.
2. J. Cassell, M. Stone, and H. Yan. Coordination and context-dependence in the generation of embodied conversation. In Proceedings of the First International Conference on Natural Language Generation, 2000.
3. J. Cassell, H. Vilhjalmsson, and T. Bickmore. Beat: The behavior expression animation toolkit. In Proceedings of SIGGRAPH, 2001.
4. J. de Ruiter. The production of gesture and speech. In D. McNeill, editor, Language and gesture. Cambridge University Press, 2000.
5. M. Denis. The description of routes: A cognitive approach to the production of spatial discourse. Current Psychology of Cognition, 16:409-458, 1997.
6. B. Hartmann, M. Mancini, and C. Pelachaud. Implementing expressive gesture synthesis for embodied conversational agents. In Gesture in Human-Computer Interaction and Simulation, 2005.
7. A. Hostetter, M. Alibali, and S. Kita. Does sitting on your hands make you bite your tongue? The cffects of gesture inhibition on speech during motor descriptions. In D. S. McNamara and J. G. Trafton, editors, Proc. 29th meeting of the Cognitive Science Society, pages 1097-1102. Erlbaum, 2007.
8. M. Huenerfauth, L. Zhou, E. Gu, and J. Allbeck. Design and evaluation of an american sign language generator. In Proceedings of the Workshop on Embodied Language Processing, 2007.
9. A. Kendon. Gesture Visible Action as Utterance. Cambridge University Press, 2004.
10. S. Kita and A. Ozyiirek. What does cross-linguistic variation in semantic coordination of speech and gesture reveal?: Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48:16-32, 2003.
11. S. Kopp, K. Bergmann, and I. Wachsmuth. Multimodal communication from multimodal thinking - Towards an integrated model of speech and gesture production. International Journal of Semantic Computing, 2(1):115-136, 2008.
12. S. Kopp, P. Tepper, K. Ferriman, K. Striegnitz, and J. Cassell. Trading spaces: How humans and humanoids use speech and gesture to give directions. In T. Nishida, editor, Conversational Informatics, chapter 8, pages 133-160. John Wiley, 2007.
13. S. Kopp and I. Wachsmuth. Synthesizing multimodal utterances for conversational agents. Computer Animation and Virtual Worlds, 15(1):39-52, 2004.
14. S. Levinson. Frames of reference and molyneux's question: Cross-linguistic evidence. In Space and Language, pages 109- 169. MIT Press, 1996.
15. E. Morsella and R. Krauss. The role of gestures in spatial working memory and speech. The American Journal of Psychology, 117:411-424, 2004.
16. M. Neff, M. Kipp, I. Albrecht, and H.-P. Seidel. Gesture modeling and animation based on a probabilistic re-creation of speaker style. ACM Transactions on Graphics, 27/1:1-24, 2008.
17. A. Paivio. Mental Representations. Oxford Univ. Press, 1986.
18. T. Sowa and I. Wachsmuth. A model for the representation and processing of shape in coverbal iconic gestures. In Proc. KogWis05, pages 183-188, Basel, 2005. Schwabe.
19. H. Steck and V. Tresp. Bayesian belief networks for data mining. In Proceedings of the 2nd Workshop "Data Mining und Data Warehousing als Grundlage moderner enscheidungsunterstuetzender System", 1999.
20. M. Stone, D. DeCarlo, I. Oh, C. Rodriguez, A. Stere, A. Lees, and C. Bregler. Speaking with hands: Creating animated conversational characters from recordings of human performance. In Proceedings of SIGGRAPH, pages 506- 513, 2004.
21. M. Stone, C. Doran, B. Webber, T. Bleam, and M. Palmer. Microplanning with Communicative Intentions: The Spud System. Comput. Intelligence, 19(4):311-381, 2003.