Perceiving visual emotions with speech

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4133 LNAI, Issue , 2006, Pages 107-120

  Deng, Zhigang ^a   Bailenson, Jeremy ^b   Lewis, J P ^b   Neumann, Ulrich ^c  

^a University of Houston ^*  (United States)

^b STANFORD UNIVERSITY   (United States)

^c University of Southern California   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CORRELATION METHODS; DATA REDUCTION; FACE RECOGNITION; HUMAN COMPUTER INTERACTION; INTERACTIVE COMPUTER GRAPHICS; LEARNING SYSTEMS; SENSORY PERCEPTION; SPEECH RECOGNITION;

EMBODIED CONVERSATIONAL AGENTS (ECA); EMOTIONS; FACIAL MARKER MOTION; VISUAL PERCEPTION;

GESTURE RECOGNITION;

EID: 33749576339     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11821830_9     Document Type: Conference Paper

References (39)

1. Ahlberg, J., Pandzic, I.S., and You, L: Evaluating MPEG-4 Facial Animation Players, MPEG-4 Facial Animation: the standard, implementation and applications, Pandzic, I.S. and Forchhimer, R. (eds.), 2002, 287-291.
2. Andre, E., Rist, M., and Muller, J: Guiding the User through Dynamically Generated Hypermedia Presentations with a Life-like Character, IUI '98, pp. 21-28.
3. Bassili, J.N: Emotion Recognition: The Role of Facial Movement and the Relative Importance of Upper and Lower Areas of the Face, Journal of the Personality and Social Psychology, 1979(37), 2049-2058.
4. Blanz, V., Basso, C., Poggio, T., and Vetter, T: Reanimating Faces in Images and Video, Computer Graphics Forum, 22(3), 2003
5. Brand, M: Voice Puppetry, Proc. of ACM SIGGRAPH 1999, ACM Press, pp. 21-28.
6. Bregler, C., Covell, M., and Slaney, M: Video Rewrite: Driving Visual Speech with Audio, Proc. of ACM SIGGRAPH'97, ACM Press, pp.353-360.
7. Busso, C., Deng, Z., Neumann, U., and Narayanan, S: Natural Head Motion Synthesis Driven by Acoustic Prosody Features, the Journal of Computer Animation and Virtual Worlds, 16(3-4), July 2005, pp.283-290.
8. Cassell, J., Pelachaud, C., Badler, N., Steedman, M., Achorn, B., Becket, T., Douville, B., Prevost, S., and Stone, M: Animated Conversation: Rule-Based Generation of Facial Expression, Gesture and Spoken intonation for Multiple Conversational Agents, Proc. of ACM SIGGRAPH'94, ACM Press, 413-420.
9. Cassell, J., Sullivan, J., Prevost, S., and Churchill, E: Embodied Conversational Agents, MIT Press, 2000.
10. Chuang, E.S., Deshpande, H., and Bregler, C: Facial Expression Space Learning, Proc. of Pacific Graphics'02, 2002, 68-76.
11. Cohen, M.M., and Massaro, D.W: Modeling Coarticulation in Synthetic Visual Speech, Magnenat-Thalmann, N., Thalmann, D. (Editors), Models and Techniques in Computer Animation, Springer Verlag, 1993, 139-156.
12. Costantini, E., Pianesi, F., and Cosi, P: Evaluation of Synthetic Faces: Human Recognition of Emotional Facial Displays, Affective Dialogue Systems, Dybkiaer, L. Minker, W. and Heisterkamp, P. (eds.), 2004.
13. Costantini, E., Pianesi, F., Prete, M: Recognising emotions in human and synthetic faces: the role of the upper and lower parts of the face, Proc. of IUI'05, ACM Press (2005), 20-27.
14. Deng, Z., Neumann, U., Lewis, J.P., Kim, T.Y., Bulut, M., and Narayanan, S: Expressive Facial Animation Synthesis by Learning Speech Co-Articulation and Expression Space, IEEE Transaction on Visualization and Computer Graphics, 12(6), Nov/Dec, 2006.
15. Deng, Z., Bulut, M., Neumann, U., and Narayanan, S: Automatic Dynamic Expression Synthesis for Speech Animation, Proc. of IEEE Computer Animation and Social Agents 2004, July 2004, pp. 267-274.
16. Deng, Z., Lewis, J.P., and Neumann, U: Synthesizing Speech Animation by Learning Compact Speech Co-Articulation Models, Proc. of Computer Graphics International 2005, June 2005, pp. 19-25.
17. Ekman, P., Friesen, W.V: Unmasking the Face: A Guide to Recognizing Emotions from Facial Clues, Prentice-Hall, 1975
18. Essa, I. A. and Pentland, A.P: Coding, Analysis, Interpretation, and Recognition of Facial Expressions, IEEE Transaction on Pattern Analysis and Machine Intelligence, 19(7), 1997, 757-763
19. Ezzat, T., Geiger, G., and Poggio, T: Trainable Videorealistic Speech Animation, ACM Trans. Graph., 21(3), 2002, 388-398.
20. Gratch, J. and Marsella, S: Evaluating a Computational Model of Emotion, Journal of Autonomous Agents and Multiagent Systems, 11 (1), pp. 23-43.
21. Gratch, J., Rickel, J., Andre, E., Badler, N., Cassell, J., and Petajan, E: Creating Interactive Virtual Humans: Some Assembly Required, IEEE Intelligent Systems, July/August 2002, pp. 54-63.
22. Hastie, T., Ribshirani, R., and Friedman, J: The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer-Verlag, 2001.
23. Katsyri, J., Klucharev, V., Frydrych, M., Sams, M: Identification of Synthetic and Natural Emotional Facial Expressions, Proc. of AVSP'2003, 2003, 239-244.
24. Kshirsagar, S., and Thalmann, N.M: Visyllable Based Speech Animation, Computer Graphics Forum, 22(3), 2003.
25. Walker, J. H., Sproull, L., and Subramani, R: Using a human face in an interface, Proc. of CHI'94, ACM Press (1994), 85-91.
26. Lee, Y., Terzopoulos, D., and Waters, K: Realistic modeling for facial animation, Proc. of ACM SIGGRAPH'95, ACM Press (1995), 55-62.
27. Lewis, J.P: Automated lip-sync: Background and techniques, J. of Visualization and Computer Animation, 1991, 118-122.
28. Lewis, J.P., Purcell, P.: Soft Machine: A Personable Interface, Proc. of Graphics Interface 84, pp. 223-226.
29. Marsella, S. and Gratch, J: Modeling the Interplay of Plans and Emotions in Multi-Agent Simulations, Proc. of the Cognitive Science Society, 2001.
30. Nass, C., Kim, E.Y., and Lee, E.J: When My Face is the Interface: An Experimental Comparison of Interacting with One's Own Face or Someone Else's Face, Proc. of CHI'98, ACM Press (1998), 148-154.
31. Noh, J.Y., and Neumann, U: Expression Cloning, Proc. of ACM SIGGRAPH'01, ACM Press (2001), 277-288.
32. Pandzic, I.S., Ostermann, J., and Millen, D: User evaluation: synthetic talking faces for interactive services, The Visual Computer, 1999(15), 330-340.
33. Parke, F: Computer Generated Animation of Faces, Proc. ACM Nat'l Conf. ACM Press (1972), 451-457.
34. Pelachaud, C., Badler, N., and Steedman, M: Linguistic Issues in Facial Animation, Proc. of Computer Animation'91, 1991.
35. Pelachaud, C., Badler, N. and Steedman, M: Generating Facial Expressions for Speech, Cognitive Science, 20(1), 1994, 1-46.
36. Rist, M., Andre, E., and Muller, J: Adding animated presentation agents to the interface. IUI '97: Proc. of Intelligent user Interfaces, ACM Press (1997), 79-86.
37. Sirovich, L. and Kirby, M: Low-dimensional procedure for the characterization of human faces, J. Opt. Soc. Am. A, 4(3), 1987 March, 519-524
38. Turk, M. A. and Pentland, A.P: Face Recognition Using Eigenfaces, IEEE CVPR 91, 586-591.
39. Uttkay, Z., Doorman, C., and Noot, H: Evaluating ECAs - What and How? Proc. of the AAMAS02 Workshop on Embodied Conversational Agents, 2002.