Synthesizing multimodal utterances for conversational agents

Computer Animation and Virtual Worlds

Volumn 15, Issue 1, 2004, Pages 39-52

  Kopp, Stefan ^a   Wachsmuth, Ipke ^a,b  

^a BIELEFELD UNIVERSITY   (Germany)

^b Center for Interdisciplinary Research (ZiF)

Author keywords

Gesture animation; Model based computer animation; Motion control; Multimodal conversational agents

Indexed keywords

ANIMATION; ARTIFICIAL INTELLIGENCE; BEHAVIORAL RESEARCH; GESTURE RECOGNITION; MOTION CONTROL; MULTI AGENT SYSTEMS; VIRTUAL REALITY; XML;

GESTURE ANIMATION; MAX'S UTTERANCES; MODEL-BASED COMPUTER ANIMATION; MULTIMODAL CONVERSATIONAL AGENTS;

SPEECH SYNTHESIS;

EID: 12844251654     PISSN: 15464261     EISSN: None     Source Type: Journal    
DOI: 10.1002/cav.6     Document Type: Review

References (24)

1. Cassell J, Sullivan J, Prevost S, Churchill E (eds). Embodied Conversational Agents. MIT Press: Cambridge, MA, 2000.
2. Cassell J, Bickmore T, Campbell L, Vilhjalmsson H, Yan H. Human conversation as a system framework: designing embodied conversational agents. In Embodied Conversational Agents, Cassell J et al. (eds). MIT Press: Cambridge, MA, 2000; 29-63.
3. Rickel J, Johnson WL. Animated agents for procedural training in virtual reality: perception, cognition, and motor control. Applied Artificial Intelligence 1999; 13: 343-382.
4. Cassell J, Vilhjalmsson H, Bickmore T. BEAT: the behavior expression animation toolkit. In Proceedings of SIGGRAPH 2001, 2001; pp 477-486.
5. McNeill D. Hand and Mind: What Gestures Reveal about Thought. University of Chicago Press: Chicago, 1992.
6. Kopp S, Wachsmuth I. Model-based animation of coverbal gesture. In Proceedings of Computer Animation 2002. IEEE Computer Society Press: Los Alamitos, CA, 2002; pp 252-257.
7. Kopp S, Wachsmuth I. A knowledge-based approach for lifelike gesture animation. In ECAI 2000 Proceedings of the 14th European Conference on Artificial Intelligence, Horn W (ed.). IDS Press: Amsterdam, 2000; pp 661-667.
8. Cassell J, Pelachaud C, Badler N, Steedman M, Achorn B, Becket T, Douville B, Prevost S, Stone M. Animated conversation: rule-based generation of facial expression, gesture and spoken intonation for multiple conversational agents. In Proceedings of SIGGRAPH'94,1994.
9. Churchill EF, Cook L, Hodgson P, Prevost S, Sullivan JW. 'May I help you?': designing embodied conversational agent allies. In Embodied Conversational Agents, Cassell J et al. (eds). MIT Press: Cambridge, MA, 2000; 64-94.
10. Cassell J. Nudge nudge wink wink: elements of face-to-face conversation for embodied conversational agents. In Embodied Conversational Agents, Cassell J et al. (eds). MIT Press: Cambridge, MA, 2000; 64-94.
11. Koga Y, Kondo K, Kuffner J, Latombe J-C. Planning motions with intentions. In Proceedings of the 21st Annual Conference on Computer Graphics, 1994; pp 395-408.
12. Matarić MJ, Zordan VB, Williamson MM. Making complex articulated agents dance. Autonomous Agents and Multi-Agent Systems 1999; 2(1): 23-44.
13. Gibet S, Lebourque T, Marteau P-F. High-level specification and animation of communicative gestures. Journal of Visual Languages and Computing 2001; 12(6): 657-687.
14. Kendon A. Gesticulation and speech: two aspects of the process of utterance. In The Relationship of Verbal and Nonverbal Communication, Key MR (ed.). Mouton: The Hague, 1980; 207-227.
15. Levelt WJ. Speaking. MIT Press: Cambridge, MA, 1989.
16. de Ruiter JP. Gesture and speech production. PhD thesis, University of Nijmegen, 1998. MPI Series in Psycholinguistics.
17. Nobe S. Where do most spontaneous representational gestures actually occur with respect to speech? In Language and Gesture, McNeill D (ed.). Cambridge University Press: Cambridge, UK, 2000.
18. Wilhelms J, Van Gelder A. Fast and easy reach-cone joint limits. Journal of Graphics Tools 2001; 2(6): 27-41.
19. Zeltzer D. Motor control techniques for figure animation. IEEE Computer Graphics and Applications 1982; 2(9): 53-59.
20. Tolani D, Goswami A, Badler NI. Real-time inverse kinematics techniques for anthropomorphic limbs. Graphical Models 2000; 62: 353-388.
21. Soechting JF, Flanders M. Sensorimotor representations for pointing to targets in three dimensional space. Journal of Neurophysiology 1989; 62(2): 582-594.
22. Latash ML. Control of Human Movement. Human Kinetics: Champaign, IL, 1993.
23. Morasso P, Mussa Ivaldi FA. Trajectory formation and handwriting: a computational model. Biological Cybernetics 1982; 45: 131-142.
24. Perlin K. Real-time responsive animation with personality. IEEE Transactions on Visualization and Computer Graphics 1995; 1(1): 5-15.