"may i talk to you? : --)" - Facial animation from text

Proceedings - Pacific Conference on Computer Graphics and Applications

Volumn 2002-January, Issue , 2002, Pages 77-86

  Albrecht, Irene ^a   Haber, Jörg ^a   Kähler, Kolja ^a   Schröder, Marc ^b   Seidel, Hans Peter ^a  

^a MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^b GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

Author keywords

Eyebrows; Eyes; Facial animation; Information analysis; Performance analysis; Real time systems; Signal analysis; Signal synthesis; Speech analysis; Speech synthesis

Indexed keywords

ANIMATION; COMPUTATIONAL LINGUISTICS; COMPUTER GRAPHICS; EYE MOVEMENTS; INFORMATION ANALYSIS; INTERACTIVE COMPUTER SYSTEMS; LINGUISTICS; REAL TIME SYSTEMS; SIGNAL ANALYSIS; SPEECH; SPEECH ANALYSIS; SPEECH SYNTHESIS; SYNTHESIS (CHEMICAL);

EYEBROWS; EYES; FACIAL ANIMATION; PERFORMANCE ANALYSIS; SIGNAL SYNTHESIS;

SPEECH COMMUNICATION;

EID: 84948747926     PISSN: 15504085     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/PCCGA.2002.1167841     Document Type: Conference Paper

References (49)

1. I. Albrecht, J. Haber, and H.-P. Seidel. Automatic Generation of Non-Verbal Facial Expressions from Speech. In Proc. Computer Graphics International 2002, pages 283-293, July 2002.
2. I. Albrecht, J. Haber, and H.-P. Seidel. Speech Synchronization for Physics-based Facial Animation. In Proc. WSCG 2002, pages 9-16, 2002.
3. J. Allen, S. Hunnicutt, and D. H. Klatt. From Text to Speech: The MITalk System. Cambridge University Press, 1987.
4. P. Andersen. Nonverbal Communication. Mayfield Publishing Company, Mountain View, CA, 1999.
5. M. Argyle and M. Cook. Gaze and Mutual Gaze. Cambridge University Press, 1976.
6. G. Bailly. Audiovisual Speech Synthesis. In Proc. ETRW on Speech Synthesis, 2001.
7. A. Black, P. Taylor, and R. Caley. Festival Speech Synthesis System, Edition 1. 4. Technical report, Centre for Speech Technology Research, University of Edinburgh, UK, 1999.
8. A. W. Black and N. Campbell. Optimising selection of units from speech databases for concatenative synthesis. In Proc. Eurospeech, volume 1, pages 581-584, 1995.
9. V. Blanz and T. Vetter. A Morphable Model for the Synthesis of 3D Faces. In Computer Graphics (SIGGRAPH '99 Conf. Proc.), pages 187-194, Aug. 1999.
10. M. Brand. Voice Puppetry. In Computer Graphics (SIGGRAPH '99 Conf. Proc.), pages 21-28, Aug. 1999.
11. T. Brants. TnT-a statistical part-of-speech tagger. In Proc. 6th Conference on Applied Natural Language Processing, Seattle, WA, USA, 2000.
12. J. Cassell, C. Pelachaud, N. Badler, M. Steedman, B. Achorn, T. Bechet, B. Douville, S. Prevost, and M. Stone. Animated Conversation: Rule-Based Generation of Facial Expression Gesture and Spoken Intonation for Multiple Conversational Agents. In Computer Graphics (SIGGRAPH '94 Conf. Proc.), pages 413-420, July 1994.
13. J. Cassell, H. Vilhjálmsson, and T. Bickmore. BEAT: The Behavior Expression Animation Toolkit. In Proc. SIGGRAPH 2001, pages 477-486, 2001.
14. C. Cavé, I. Guäitella, R. Bertrand, S. Santi, F. Harlay, and R. Espesser. About the relationship between eyebrow movements and f0 variations. In Proc. ICSLP '96, 1996.
15. N. Chovil. Discourse-Oriented Facial Displays in Conversation. Research on Language and Social Interaction, 25:163-194, 1991.
16. M. M. Cohen and D. W. Massaro. Modeling Coarticulation in Synthetic Visual Speech. In N. M. Magnenat-Thalmann and D. Thalmann, editors, Models and Techniques in Computer Animation, pages 139-156. Springer-Verlag, 1993.
17. J. Cosnier. Les gestes de la question. In Kerbrat-Orecchioni, editor, La Question, pages 163-171. Presses Universitaires de Lyon, 1991.
18. D. DeCarlo, C. Revilla, M. Stone, and J. J. Venditti. Making Discourse Visible: Coding and Animating Conversational Facial Displays. In Proc. Computer Animation 2002, pages 11-16, June 2002.
19. S. Duncan and D. Fiske. Face-to-Face Interaction. Lawrence Earlbaum Associates, 1977.
20. T. Dutoit. An Introduction to Text-to-Speech Synthesis. Kluwer Academic Publishers, Dordrecht, 1997.
21. T. Dutoit, V. Pagel, N. Pierret, F. Bataille, and O. van der Vrecken. The MBROLA project: Towards a set of high quality speech synthesisers free of use for non commercial purposes. In Proc. 4th Int'l. Conf. of Spoken Language Processing, pages 1393-1396, 1996.
22. P. Ekman. About brows: emotional and conversational signals. In M. v. Cranach, K. Foppa, W. Lepenies, and D. Ploog, editors, Human Ethology: Claims and limits of a new discipline: contributions to the Colloquium, pages 169-248. 1979.
23. D. R. Hill, A. Pearce, and B. Wyvill. Animating Speech: An Automated Approach using Speech Synthesised by Rules. The Visual Computer, 3(5):277-289, Mar. 1988.
24. D. House, J. Beskow, and B. Granström. Timing and Interaction of Visual Cues for Prominence in Audiovisual Speech Perception. In Proc. Eurospeech 2001, 2001.
25. H. H. S. Ip and C. S. Chan. Script-Based Facial Gesture and Speech Animation Using a NURBS Based Face Model. Computers & Graphics, 20(6):881-891, Nov. 1996.
26. K. Kähler, J. Haber, and H.-P. Seidel. Geometry-based Muscle Modeling for Facial Animation. In Proc. Graphics Interface 2001, pages 37-46, June 2001.
27. K. Kähler, J. Haber, H. Yamauchi, and H.-P. Seidel. Head shop: Generating animated head models with anatomical structure. In Proc. ACM SIGGRAPH Symposium on Computer Animation (SCA '02), pages 55-64, July 2002.
28. P. Kalra, A. Mangili, N. Magnenat-Thalmann, and D. Thalmann. SMILE: A Multilayered Facial Animation System. In Proc. IFIP WG 5. 10, pages 189-198, Tokyo, Japan, 1991.
29. E. Klabbers, K. Stöber, R. Veldhuis, P. Wagner, and S. Breuer. Speech synthesis development made easy: The Bonn Open Synthesis System. In Proc. Eurospeech, volume 1, pages 521-524, 2001.
30. Y. Lee, D. Terzopoulos, and K. Waters. Constructing Physics-based Facial Models of Individuals. In Proc. Graphics Interface '93, pages 1-8, May 1993.
31. Y. Lee, D. Terzopoulos, and K. Waters. Realistic Modeling for Facial Animations. In Computer Graphics (SIGGRAPH '95 Conf. Proc.), pages 55-62, Aug. 1995.
32. J. P. Lewis and F. I. Parke. Automated Lip-Synch and Speech Synthesis for Character Animation. In Proc. Graphics Interface '87, pages 143-147, Apr. 1987.
33. M. Lundeberg and J. Beskow. Developing a 3D-agent for the AUGUST dialogue system. In Proc. Audio-Visual Speech Processing (AVSP) '99, 1999.
34. N. Magnenat-Thalmann, E. Primeau, and D. Thalmann. Abstract Muscle Action Procedures for Human Face Animation. The Visual Computer, 3(5):290-297, Mar. 1988.
35. F. I. Parke. Parameterized Models for Facial Animation. IEEE Computer Graphics and Applications, 2(9):61-68, Nov. 1982.
36. F. I. Parke and K. Waters, editors. Computer Facial Animation. AK Peters, Wellesley, MA, 1996.
37. A. Pearce, B. Wyvill, G. Wyvill, and D. R. Hill. Speech and Expression: A Computer Solution to Face Animation. In Proc. Graphics Interface '86, pages 136-140, May 1986.
38. C. Pelachaud, N. Badler, and M. Steedman. Linguistic Issues in Facial Animation. In N. Magnenat-Thalmann and D. Thalmann, editors, Computer Animation '91. 1991.
39. C. Pelachaud, N. Badler, and M. Steedman. Generating Facial Expressions for Speech. Cognitive Science, 20(1):1-46, 1996.
40. F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D. H. Salesin. Synthesizing Realistic Facial Expressions from Photographs. In Computer Graphics (SIGGRAPH '98 Conf. Proc.), pages 75-84, July 1998.
41. I. Poggi and C. Pelachaud. Performative Facial Expressions in Animated Faces. In J. Cassell, J. Sullivan, S. Prevost, and E. Churchill, editors, Embodied Conversational Agents, pages 155-188. MIT Press, 2000.
42. M. Schröder. Emotional speech synthesis: A review. In Proc. Eurospeech, volume 1, pages 561-564, 2001.
43. M. Schröder, R. Cowie, E. Douglas-Cowie, M. Westerdijk, and S. Gielen. Acoustic correlates of emotion dimensions in view of speech synthesis. In Proc. Eurospeech, volume 1, pages 87-90, 2001.
44. M. Schröder and J. Trouvain. The German Text-to-Speech synthesis system MARY: A tool for research, development and teaching. In Proc. 4th ISCA Workshop on Speech Synthesis, Perthshire, Scotland, 2001.
45. W. Skut and T. Brants. Chunk tagger-statistical recognition of noun phrases. In Proc. ESSLLI Workshop on Automated Acquisition of Syntax and Parsing, Saarbrücken, Germany, 1998.
46. J. Stallo. Simulating Emotional Speech for a Talking Head. Honour's thesis, School of Computing, Curtin University of Technology, Australia, 2000.
47. D. Terzopoulos and K. Waters. Physically-based Facial Modelling, Analysis, and Animation. Journal of Visualization and Computer Animation, 1(2):73-80, Dec. 1990.
48. K. Waters. A Muscle Model for Animating Three-Dimensional Facial Expression. In Computer Graphics (SIGGRAPH '87 Conf. Proc.), volume 21, pages 17-24, July 1987.
49. C. Wynn. Implementing Bump-Mapping using Register Combiners. http://www. nvidia. com/ developer/, 2001.