Multimodal expression in virtual humans

Computer Animation and Virtual Worlds

Volumn 17, Issue 3-4, 2006, Pages 239-248

  De Melo, Celso ^a,b   Paiva, Ana ^a,c  

^a INSTITUTO SUPERIOR TÉCNICO   (Portugal)

^b UNIVERSITY OF LISBON   (Portugal)

^c INESC ID   (Portugal)

Author keywords

Environment expression; Facial expression; Gesticulation expression; Multimodal expression; Virtual humans; Vocal expression

Indexed keywords

ENVIRONMENT EXPRESSION; FACIAL EXPRESSION; GESTICULATION EXPRESSION; MULTIMODAL EXPRESSION; VIRTUAL HUMANS; VOCAL EXPRESSION;

ANIMATION; COMPUTER PROGRAMMING LANGUAGES; GESTURE RECOGNITION; MATHEMATICAL MODELS; PARAMETER ESTIMATION; REAL TIME SYSTEMS;

VIRTUAL REALITY;

EID: 33745810901     PISSN: 15464261     EISSN: 1546427X     Source Type: Journal    
DOI: 10.1002/cav.127     Document Type: Conference Paper

References (39)

1. Gratch J, Rickel J, Andre E, et al. Creating interactive virtual humans: Some assembly required. IEEE Intelligent Systems 2002; 17(4): 54-63.
2. Cavazza M, Earnshaw R, Magnenat-Thalmann N, Thalmann D. Motion control of virtual humans. IEEE Computer Graphics and Applications 1998; 18(5): 24-31.
3. Noh J, Neumann U. A Survey of Facial Modeling and Animation Techniques. USC Technical Report, 1998; 99-705.
4. Blumberg B, Galyean T. Multi-Level Direction of Autonomous Creatures for Real-Time Virtual Environments. In Proceedings of SIGGRAPH "95, 1995; 30(3): 47-54.
5. Perlin K, Goldberg A. Improv: A System for Scripting Interactive Actors. Virtual Worlds in Proceedings of SIGGRAPH'96, 1996; 205-216.
6. Badler N, Phillips C, Webber B. Simulating Humans: Computer Graphics, Animation, and Controls. Oxford University Press: New York, USA 1992.
7. Kalra P, Magnenat-Thalmann N, Moccozet L, Sannier G, Aubel A. Real-time animation of realistic virtual humans. IEEE Computer Graphics and Applications 1998; 18(5): 42-55.
8. McNeill D. Hand and Mind: What Gestures Reveal About Thought. University of Chicago Press: Chicago, USA, 1992.
9. McNeill D. Gesture and Thought. University of Chicago Press: Chicago, USA, 2005.
10. Cassell J, Pelachaud C, Badler N, et al. Animated Conversation: Rule-based Generation of Facial Expression, Gesture & Spoken Intonation for Multiple Conversational Agent. In Proceedings of SIGGRAPH'94, 1994; 413-420.
11. Cassell J, Bickmore T, Billinghurst M, et al. Embodiment in Conversational Interfaces: Rea. In Proceedings of the CHI'99 Conference, Pittsburgh, PA, 1999; 520-527.
12. Kopp S. A knowledge-based approach for lifelike gesture animation. In Proceedings of the 14th European Conference on Artificial Intelligence, Amsterdam, IOS Press, 2000.
13. Kopp S, Tepper P, Cassell J. Towards Integrated Microplanning of Language and Iconic Gesture for Multimodal Output. In Proceedings of the International Conference on Multimodal Interfaces (ICMI'04), ACM Press, 2004; 97-104.
14. Amaya K, Bruderlin A, Calvert T. Emotion from motion. Proceedings Graphics Interface'96, 1996; 222-229.
15. Rose C, Bodenheimer B, Cohen M. Verbs and adverbs: Multidimensional motion interpolation. IEEE Computer Graphics and Applications 1998; 18(5): 32-40.
16. Chi D, Costa M, Zhao L, Badler N. The EMOTE model for effort and shape. Proceedings of SIGGRAPH '00, New Orleans LA, 2000; 173-182.
17. Arafa Y, Kamyab K, Mamdani E. Character Animation Scripting Languages: A Comparison, 2003.
18. VHML. VRML - Virtual Human Markup Language. www.vhml.org/
19. SMIL. SMIL: Synchronized Multimedia, wwrw.w3.org/AudioVideo/e
20. Krandsted A, Kopp S, Wachsmuth I. MURML: A Multimodal Utterance Representation Markup Language for Conversational Agents. In Proceedings of the AAMAS Workshop on "Embodied conversational agents - Let's specify and evaluate them!", Bologna, 2002.
21. NASA. Man-Systems Integration Manual (NASA-STD-3000).
22. Festival. The Festival Speech Synthesis Systems. www.cstr.ed.ac.uk/ projects/festival/
23. SABLE. SABLE: A Synthesis Markup Language - version 1.0. www.bell-labs.com/project/tts/sable.html
24. Waters K. A muscle model for animation three-dimensional facial expression. Proceedings of the 14th Annual Conference on Computer Graphics and interactive Techniques M. C. Stone, Ed. SIGGRAPH 1987. ACM Press, New York, NY, 1987; 17-24.
25. Ekman P. Facial Expressions. In Handbook of Cognition and Emotion, Dalgleish T, Power M, (eds). John Wiley & Sons Ltd.: New York, 1999.
26. de Ruiter J. The production of gesture and speech. In Language and gesture, McNeill D (ed.). Cambridge University Press: Cambridge, UK, 2000; 284-311.
27. Krauss M, Chen Y, Gottesman R. Lexical gestures and lexical access: A process model. In Language and gesture, McNeill D (ed.). Cambridge University Press: Cambridge, UK, 2000; 261-283.
28. Thompson D, Buford W, Myers L, Giurintano D, Brewer J III. A hand biomechanics workstation. Computer Graphics 1988; 22(4): 335-343.
29. Albrecht I, Haber J, Seidel H. Construction and Animation of Anatomically Based Human Hand Models. SIGGRAPH 2003, 2003; 98-109.
30. Secretariado Nacional para a Reabilitação e Integração das Pessoas com Deficiência. Gestuário - Lingua Gestual Portuguesa - 5th edition.
31. Gut U, Looks K, Thies A, Trippel T, Gibbon D. CoGesT - Conversational Gesture Transcription System. Technical Report, University of Bielefeld, 1993.
32. Kipp M. ANVIL - A Generic Annotation Tool for Multimodal Dialogue. Proceedings of the 7th European Conference on Speech Communication and Technology, Aalborg, 2001; 1367-1370.
33. Ortony A, Clore G, Collins A. The Cognitive Structure of Emotions. Cambridge University Press: Cambridge, UK, 1988.
34. Arijon D. Grammar of the Film Language. Silman-James Press: Los Angeles, USA, 1976.
35. Kaya N. Relationship Between Color and Emotion: A Study of College Students. College Student Journal, 2004.
36. Birn J. [digital] Lighting & Rendering. New Riders: Indianapolis, USA, 2000.
37. Juslin P, Sloboda J. Music and Emotion: Theory and Research. Oxford University Press: New York, USA, 2001.
38. de Melo C, Paiva A. A Story about Gesticulation Expression. Accepted at the Intelligent Virtual Agents Conference 2006 (IVA2006), 2006.
39. de Melo C, Paiva A. Environment Expression: Expressing Emotions through Cameras, Lights and Music. Proceedings of Affective Computing Intelligent Interaction (ACII05), Beijing, China, 2005; 715-722.