Facial animation based on context-dependent visemes

Computers and Graphics (Pergamon)

Volumn 30, Issue 6, 2006, Pages 971-980

  De Martino, José Mario ^a   Pini Magalhães, Léo ^a   Violaro, Fábio ^a  

^a UNIVERSITY OF CAMPINAS   (Brazil)

Author keywords

Coarticulation; Facial animation; Speech synchronized facial animation; Visemes; Visual speech synthesis

Indexed keywords

FACE RECOGNITION; MATHEMATICAL MODELS; PHOTOGRAMMETRY; SPEECH ANALYSIS; STEREO VISION; WORD PROCESSING;

COARTICULATION; FACIAL ANIMATION; SPEECH SYNCHRONIZED FACIAL ANIMATION; VISEMES; VISUAL SPEECH SYNTHESIS;

ANIMATION;

EID: 33750967027     PISSN: 00978493     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cag.2006.08.017     Document Type: Article

References (30)

1. Pelachaud C., Badler N.I., and Steedman M. Generating facial expressions for speech. Cognitive Science 20 1 (1996) 1-46
2. Fisher C.G. Confusions among visually perceived consonants. Journal of Speech and Hearing Research 11 (1968) 796-804
3. Jeffers J., and Barley M. Speechreading (Lipreading) (1971), Charles C. Thomas Publisher
4. Jackson P.L. The theoretical minimal unit for visual speech perception: Visemes and coarticulation. The Volta Review 11 5 (1988) 99-115
5. Benguerel A.-P., and Pichora-Fuller M.K. Coarticulation effects in lipreading. Journal of Speech and Hearing Research 25 (1982) 600-607
6. Erber N.P. Auditory, visual, and auditory-visual recognition of consonants by children with normal and impaired hearing. Journal of Speech and Hearing Disorders 15 (1972) 413-422
7. Binnie C.A., Montgomery A.A., and Jackson P.L. Auditory and visual contributions to the perception of consonants. Journal of Speech and Hearing Research 17 (1974) 619-630
8. Walden B.E., Prosek R.A., Montgomery A.A., Scheer C.K., and Jones C.J. Effects of training on the visual recognition of consonants. Journal of Speech and Hearing Research 20 1 (1977) 130-145
9. Walden B.E., Erdman S.A., Montgomery A.A., Schwartz D.M., and Prosek R.A. Some effects of training on speech recognition by hearing-impaired adults. Journal of Speech and Hearing Research 24 1 (1981) 201-216
10. Kricos P.B., and Lesner S.A. Differences in visual intelligibility across talkers. The Volta Review 84 (1982) 219-225
11. Kricos P.B., and Lesner S.A. Effect of talker differences on the speechreading of hearing-impaired teenagers. The Volta Review 85 (1985) 5-16
12. Owens E., and Blazek B. Visemes observed by hearing-impaired and normal adult viewers. Journal of Speech and Hearing Research 28 (1985) 381-393
13. Parke F.I., and Waters K. Computer Facial Animation (1996), A K Peters, Ltd
14. Hill D.R., Pearce A., and Wyvill B. Animating speech: an automated approach using speech synthesised by rules. The Visual Computer 3 4 (1988) 277-289
15. Waters K, Levergood TM. DECface: an automatic lip-synchronization algorithm for synthetic faces. Technical Report Series, DEC Cambridge Research Laboratory; September 1993.
16. Cohen M.M., and Massaro D.W. Modelling coarticulation in synthetic visual speech. In: Magnenat-Thalmann N., and Thalmann D. (Eds). Models and techniques in computer animation (1993), Springer, Berlin 139-156
17. Löfqvist A. Speech as audible gesture. In: Hardcastle W., and Marchal A. (Eds). Speech production and speech modeling (1990), Kluwer Academic Publishers, Dordrecht, the Netherlands 289-322
18. Le Goff B, Benoît C. A text-to-audiovisual-speech synthesizer for French. In: Proceedings of the fourth international conference on spoken language processing, vol. 4. Philadelphia, USA, 1996. p. 2163-66.
19. Benoît C., and Le Goff B. Audio-visual speech synthesis from French text: eight years of models, designs and evaluation at the ICP. Journal of Speech and Hearing Research 26 (1998) 117-129
20. Revéret L, Bailly G, Badin P. Mother: a new generation of talking heads providing a flexible control for video-realistic speech animation. In: Proceedings of the sixth international conference on spoken language processing-ICSLP'00, ISCA, Beijing, China, 2000. p. 755-8.
21. Öhman S.E.G. Numerical model of coarticulation. The Journal of the Acoustical Society of America 41 2 (1967) 310-320
22. Albrecht I, Haber J, Seidel H-P. Speech synchronization for physics-based facial animation. In: Proceedings of the tenth international conference in central Europe on computer graphics, visualization and computer vision-WSCG'2002, 2002. p. 9-16.
23. Pelachaud C. Visual text-to-speech. In: Pandzic I.S., and Forchheimer R. (Eds). MPEG-4 facial animation (2002), Wiley, New York 125-140
24. Beskow J. Trainable articulatory control models for visual speech synthesis. International Journal of Speech Technology 7 4 (2004) 335-349
25. TIP Association. Handbook of the international phonetic association-a guide to the use of the international phonetic alphabet (1999), Cambridge University Press, Cambridge
26. Nitchie E. New lessons in lipreading. JB Lippincott, 1950.
27. Ayache N. Artificial vision for mobile robots: stereo vision and multisensory perception (1991), Edinburgh University Press
28. Algorithms for clustering data. Englewood Cliffs, NJ: Prentice-Hall; 1988.
29. Vatikiotis-Bateson E, Ostry DJ. An analysis of the dimensionality of jaw motion in speech. Journal of Phonetics 1995; 101-17.
30. De Martino JM. Speech synchronized facial animation: phonetic context dependent visemes for Brazilian Portuguese. PhD thesis, State University of Campinas, Brazil; July 2005 [in Portuguese].