Studies on gesture expressivity for a virtual agent

Speech Communication

Volumn 51, Issue 7, 2009, Pages 630-639

  Pelachaud, Catherine ^a  

^a UNIVERSITÉ PARIS 8   (France)

Author keywords

Embodied conversational agents; Expressivity; Nonverbal behavior

Indexed keywords

EMBODIED CONVERSATIONAL AGENT; EMBODIED CONVERSATIONAL AGENTS; EXPRESSIVITY; FACIAL EXPRESSIONS; GAZE DIRECTION; NON-VERBAL COMMUNICATIONS; NONVERBAL BEHAVIOR; QUALITATIVE ASPECTS; VIRTUAL AGENT;

ANIMATION; COMMUNICATION;

GESTURE RECOGNITION;

EID: 67249139831     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2008.04.009     Document Type: Article

References (58)

1. Banse R., and Scherer K. Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology 70 (1996) 614-636
2. Bänziger, T., Pirker, H., Scherer, K., 2006. GEMEP - GEneva Multimodal Emotion Portrayals: A corpus for the study of multimodal emotional expressions. In: Workshop on Corpora for Research on Emotion and Affect, LREC 2006 Conference, Genoa, Italy, 24-26 May 2006.
3. Bassili J.N. Emotion recognition: The role of facial movement and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology 37 11 (1979) 2049-2058
4. Bavelas J., and Chovil N. Visible acts of meaning. Journal of Language and Social Psychology 19 2 (2000) 163-194
5. Becker, C., Wachsmuth, I., 2006. Modeling primary and secondary emotions for a believable communication agent. In: International Workshop on Emotion and Computing, in conj. with the 29th annual German Conference on Artificial Intelligent (KI2006), Bremen, Germany, pp. 31-34.
6. Bui, The Duy., Heylen, D., Poel, M., Nijholt, A., 2004. Combination of facial movements on a 3D talking head. In: Computer Graphics International, pp. 284-291.
7. Buisine S., Abrilian S., and Martin J.-C. Evaluation of multimodal behaviour of embodied agents. In: Ruttkay Z., and Pelachaud C. (Eds). From Brows till Trust: Evaluating Embodied Conversational Agents (2004), Kluwer
8. Buisine, S., Abrilian, S., Niewiadomski, R., Martin, J.-C., Devillers, L., Pelachaud, C., 2006. Perception of blended emotions: from video corpus to expressive agent. In: The 6th International Conference on Intelligent Virtual Agents, Marina del Rey, USA, August 2006.
9. Caridakis, G., Raouzaiou, A., Karpouzis, K., Kollias, S., 2006. Synthesizing gesture expressivity based on real sequences. In: Workshop on multimodal corpora: from multimodal behaviour theories to usable models, LREC 2006 Conference, Genoa, Italy, 24-26 May 2006.
10. Cassell, J., Bickmore, J., Billinghurst, M., Campbell, L., Chang, K., Vilhjálmsson, H., Yan, H., 1999. Embodiment in conversational interfaces: Rea. In: CHI'99, Pittsburgh, PA, pp. 520-527.
11. Cassell, J., Vilhjálmsson, H., Bickmore, T., 2001. BEAT: the behavior expression animation toolkit. In: Computer Graphics Proceedings, Annual Conference Series. ACM SIGGRAPH.
12. Cassell J., Kopp S., Tepper P., Ferriman K., and Striegnitz K. Trading spaces: how humans and humanoids use speech and gesture to give directions. In: Nishida T. (Ed). Conversational Informatics (2007), John Wiley & Sons, New York 133-160
13. Chafai, N.E., Pelachaud, C., Pelé, D., Breton, G., 2006. Gesture expressivity modulations in an ECA application. In: The 6th International Conference on Intelligent Virtual Agents, Marina del Rey, August.
14. Chafai, N.E., Pelé, D., Pelachaud, C., 2006. Analysis of gesture expressivity modulations. In: LREC 2006 Workshop on Multimodal Corpora, Genova, May 2006.
15. Chafai, N.E., Pelachaud, C., Pelé, D., 2007. A case study of gesture expressivity breaks. International Journal of Language Resources and Evaluation, Special issue on Multimodal Corpora for Modelling Human Multimodal Behavior.
16. Chi D.M., Costa M., Zhao L., and Badler N.I. The EMOTE model for effort and shape. In: Akeley K. (Ed). Siggraph 2000. Computer Graphics Proceedings (2000), ACM Press/ACM SIGGRAPH/Addison Wesley Longman 173-182
17. De Carolis B., Pelachaud C., Poggi I., and Steedman M. APML, a mark-up language for believable behavior generation. In: Prendinger H., and Ishizuka M. (Eds). Life-like Characters. Tools, Affective Functions and Applications (2004), Springer 65-85
18. Devillers, L., Abrilian, S., Martin, J.-C., 2005. Representing real life emotions in audio-visual data with non basic emotional patterns and context features. In: 1st International Conference on Affective Computing and Intelligent Interaction (ACII'2005), Beijing, China, October 22-24, 2005.
19. Ekman, P., 2003. Emotions Revealed. New York: Times Books (US). London: Weidenfeld and Nicolson (World).
20. Ekman P., and Friesen W. Unmasking the face: a guide to recognizing emotions from facial clues (1975), Prentice-Hall, Inc.
21. Feyereisen, P., 1997. Geste, cognition et communication, chapter La compréhension des gestes référentiels, PULIM, pp. 20-48.
22. Gallaher P.E. Individual differences in nonverbal behavior: dimensions of style. Journal of Personality and Social Psychology 63 1 (1992) 133-145
23. Hartmann, B., Mancini, M., Buisine, S., Pelachaud, C., 2005. Design and evaluation of expressive gesture synthesis for embodied conversational agents. In: Third International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), Utretch, July 2005.
24. Hartmann B., Mancini M., and Pelachaud C. Implementing expressive gesture synthesis for embodied conversational agents. In: Courty N., Gibet S., and Kamp J.-F. (Eds). Gesture Workshop, LNCS/LNAI (2006), Springer
25. Kaiser, S., Wehrle, T., 2006. Modeling appraisal theory of emotion and facial expression. In: Magnenat-Thalmann, N., (Ed.), Proceedings of the 19th International Conference on Computer Animation and Social Agents, CASA 2006, Geneva, July 2006. Computer Graphics Society (CGS).
26. Kendon A. Conducting interaction: pattern of behavior in focused encounter (1990), Cambridge University Press
27. Kendon A. Gesture: Visible Action as Utterance (2004), Cambridge University Press
28. Kopp S., and Wachsmuth I. Synthesizing multimodal utterances for conversational agents. Journal Computer Animation and Virtual Worlds 15 1 (2004) 39-52
29. Krahmer E., and Swerts M. More about brows. In: Ruttkay Z., and Pelachaud C. (Eds). From Brows till Trust: Evaluating Embodied Conversational Agents (2004), Kluwer
30. Liu, K., Hertzmann, A., 2005. Learning physics-based motion style with inverse optimization. In: Computer Graphics Proceedings, Annual Conference Series. ACM SIGGRAPH.
31. Lundeberg, M., Beskow, J., 1999. Developing a 3D-agent for the August dialogue system. In: Proceedings of the ESCA Workshop on Audio-Visual Speech Processing, Santa Cruz, USA.
32. Mancini, M., Pelachaud, C., 2007. Modeling distinctive communicative behaviors. In: Gesture Workshop, Lisbon, May 2007.
33. Martin, J.-C., Abrilian, S., Devillers, L., 2005. Annotating multimodal behaviors occurring during non basic emotions. In: 1st International Conference on Affective Computing and Intelligent Interaction (ACII'2005), Beijing, China, October 22-24, 2005.
34. Martin J.-C., Niewiadomski R., Devillers L., Buisine S., and Pelachaud C. Multimodal complex emotions: Gesture expressivity and blended facial expressions. International Journal of Humanoid Robotics. Special issue on Achieving Human-Like Qualities in Interactive Virtual and Physical Humanoids 20 4-5 (2006) 477-498
35. McNeill D. Hand and Mind: What Gestures Reveal about Thought (1992), University of Chicago
36. Ménardais, S., Kulpa, R., Multon, F., Arnaldi, B., 2004. Synchronization for dynamic blending of motions. In: Proceedings of ACM, SIGGRAPH/EUROGRAPHICS Symposium of Computer Animation, Grenoble, August 2004, pp. 325-335.
37. Neff, M., Fiume, E., 2004. Methods for exploring expressive stance. In: Proceedings of ACM, SIGGRAPH/EUROGRAPHICS Symposium of Computer Animation, Grenoble, August 2004, pp. 49-58.
38. Niewiadomski, R., Pelachaud, C., 2007. Model of facial expressions management for an embodied conversational agent. In: 2nd International Conference on Affective Computing and Intelligent Interaction ACII, Lisbon, September 2007.
39. In: Pandzic I.S., and Forcheimer R. (Eds). MPEG-4 Facial Animation - The standard, implementations and applications (2002), John Wiley and Sons
40. Pelachaud, C., 2005. Multimodal expressive embodied conversational agent. In: ACM Multimedia, Brave New Topics session, Singapore, November 2005.
41. Peters C. A perceptually-based theory of mind model for agent interaction initiation. International Journal of Humanoid Robotics (IJHR) 3 3 (2006) 321-340
42. Poggi, I., 1998. A goal and belief model of persuasion. In: Proceedings of the 6th International Pragmatics Conference, Reims (France), July 19-24.
43. Poggi I. Symbolic gestures. The case of the Italian gestionary. Gesture 2 1 (2002) 71-98
44. Poggi I. Mind markers. In: Trigo N., Rector M., and Poggi I. (Eds). Gestures. Meaning and Use (2003), University Fernando Pessoa Press, Oporto, Portugal
45. Posner R., and Serenari M. The emergence of gestures from body movements. In: Rector M., Poggi I., and Trigo N. (Eds). Gestures, Meaning and Use (2003), Universidad Fernando Pessoa, Porto, Portugal
46. Prillwitz S., Leven R., Zienert H., Hanke T., and Henning J. Hamburg notation system for sign languages: an introductory guide. International Studies on Sign Language and Communication of the Deaf vol. 5 (1989), Signum Press, Hamburg, Germany
47. Raouzaiou A., Tsapatsoulis N., Karpouzis K., and Kollias S. Parameterized facial expression synthesis based on mpeg-4. EURASIP Journal on Applied Signal Processing vol. 2002 (2002), Hindawi Publishing Corporation 1021-1038
48. Rapantzikos, K., Avrithis, Y., 2005. An enhanced spatiotemporal visual attention model for sports video analysis. In: International Workshop on content-based Multimedia indexing (CBMI), Riga, Latvia, June 2005.
49. Ruttkay Z., Noot H., and ten Hagen P. Emotion disc and emotion squares: tools to explore the facial expression face. Computer Graphics Forum 22 1 (2003) 49-53
50. Ruttkay, Z., van Moppes, V., Noot, H., 2003. The jovial, the reserved and the robot. In: proceedings of the AAMAS03 Ws on Embodied Conversational Characters as Individuals, Melbourne, Australia.
51. Sidner C.L., Kidd C.D., Lee C., and Lesh N. Where to look: a study of human-robot interaction. Intelligent User Interfaces Conference (2004), ACM Press 78-84
52. Stone, M., DeCarlo, D., 2003. Crafting the illusion of meaning: Template-based generation of embodied conversational behavior. In: Computer Animation and Social Agents.
53. Stone, M., DeCarlo, D., Oh, I., Rodriguez, C., Stere, A., Lees, A., Bregler, C., 2004. Speaking with hands: Creating animated conversational characters from recordings of human performance. In: Computer Graphics Proceedings, Annual Conference Series. ACM SIGGRAPH.
54. Terzopoulos D., and Waters K. Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Transactions on Pattern Analysis and Machine Intelligence 15 6 (1993) 569-579
55. Thomas F., and Johnston O. Disney animation: The illusion of life (1981), Abbeville Press, New York
56. Wallbott H.G. Hand movement quality: a neglected aspect of nonverbal behavior in clinical judgment and person perception. Journal of Clinical Psychology 41 3 (1985)
57. Wallbott H.G. Bodily expression of emotion. European Journal of Social Psychology 28 (1998) 879-896
58. Wallbott H.G., and Scherer K. Cues and channels in emotion recognition. Journal of Personality and Social Psychology 24 (1986)