Near-videorealistic synthetic talking faces: Implementation and evaluation

Speech Communication

Volumn 44, Issue 1-4 SPEC. ISS., 2004, Pages 127-140

  Theobald, B J ^a   Bangham, J A ^a   Matthews, I A ^b   Cawley, G G ^a  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Avatars; Dynamic textures; Shape and appearance models; Talking faces

Indexed keywords

AVATARS; DYNAMIC TEXTURES; PARAMETER SMOOTHING METHOD; TALKING FACES;

ANIMATION; GRAPHIC METHODS; SPEECH ANALYSIS; SPEECH SYNTHESIS; TEXTURES; TRAJECTORIES;

FACE RECOGNITION;

EID: 10444256499     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2004.07.002     Document Type: Article

References (27)

1. Arslan, L., Talkin, D., 1998. 3D face point trajectory synthesis using an automatically derived visual phoneme similarity matrix. In: Proceedings of auditory-visual speech processing. Terrigal, Australia, pp. 175-180.
2. Bailly, G., Benoît, C., Sawallis, T.R. (Eds.), 1992. Talking Machines: Theories, Models and Designs. North-Holland, Amsterdam.
3. Bailly, G., Bérar, M., Elisei, F., Odisio, M., 2003. Audiovisual speech synthesis. International Journal of Speech Technology 6, 331-346.
4. Baker, S., Matthews, I., 2001. Equivalence and efficiency of image alignment algorithms. In: Proceedings of the international conference on computer vision and pattern recognition, Kauai, Hawaii, pp. 1090-1097.
5. Bartels, R., Beatty, J., Barsky, B., 1987. An Introduction to Splines for Use in Computer Graphics and Geometric Modeling. Morgan Kaufmann.
6. Benoît, C., Pols, L., 1992. On the assessment of synthetic speech. In: Bailly, G., Benoît, C., Sawallis, T.R. (Eds.), Talking Machines: Theories Models and Designs. North-Holland, Amsterdam, pp. 435-441.
7. Black, A., Taylor, P., 1997. The festival speech synthesis system. Technical Report No. HCRC/R-83. University of Edinburgh.
8. Brand, M., 1999. Voice puppetry. In: Proceedings of the international conference on computer graphics and interactive techniques (SIGGRAPH), Los Angeles, California, pp. 21-28.
9. Bregler, C., Covell, M., Slaney, M., 1997. Video rewrite: driving visual speech with audio, In: Computer Graphics Annual Conference Series (SIGGRAPH), Los Angeles, California, pp. 353-360.
10. Cootes, T., Edwards, G., Taylor, C., 1998. Active appearance models. In: Burkhardt, H., Neumann, B. (Eds.), Proceedings of the European Conference on Computer Vision, Vol. 2. Springer-Verlag, Freiburg, Germany, pp. 484-498.
11. Cosatto, E., Graf, H., 1998. Sample-based synthesis of photo-realistic talking heads. In: Proceedings of Computer Animation, Philadelphia, Pennsylvania, pp. 103-110.
12. Ezzat, T., Geiger, G., Poggio, T., 2002. Trainable videorealistic speech animation. In: Proceedings of the International Conference on Computer Graphics and Interactive Techniques (SIOGRAPH), San Antonio, Texas, pp. 388-398.
13. Huang, F., Cosatto, E., Graf, H., 2002. Triphone based unit selection for concatenative visual speech synthesis. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Orlando, FL, USA, Vol. II, pp. 2037-2040.
14. Kricos, P., Lesner, S., 1982. Differences in visual intelligibility across talkers. Volta Review 84, 219-225.
15. Massaro, D., 1998. Perceiving Talking Faces. The MIT Press.
16. McGurk, H., MacDonald, J., 1976. Hearing lips and seeing voices. Nature 264, 746-748.
17. Owens, E., Blazek, B., 1986. Visemes observed by the hearing-impaired and normal-hearing adult viewers. Journal of Speech and Hearing Research 28, 381-393.
18. Parke, F., 1974, A parametric model for human faces. Unpublished doctoral dissertation, University of Utah, Saltlake City, Utah.
19. Pelachaud, C., 1991, Communication and coarticualtion in facial animation. Unpublished doctoral dissertation, The Institute for Research in Cognitive Science, University of Pennsylania.
20. Pighin, F., Hecker, J., Lischinski, D., Szeliski, R., Salesin, D., 1998. Synthesizing realistic facial expressions from photographs, In: Proceedings of the International Conference on Computer Graphics and Interactive Techniques (SIG-GRAPH), Orlando, FL, pp. 75-84.
21. Stork, D.G., Hennecke, M.E. (Eds.), 1996. Speechreading by Humans and Machines: Models, Systems and Applications, Vol. 150. Springer-Verlag, Berlin.
22. Theobald, B., 2003. Visual speech synthesis using shape and appearance models. Unpublished doctoral dissertation, University of East Anglia, Norwich, UK.
23. Theobald, B., Bangham, J., Matthews, I., Cawley, G., (2003). Near-videorealistic synthetic visual speech using non-rigid appearance models. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Hong Kong, pp. 800-803.
24. Union, I.T., (1974-1978-1982-1986-1990-1992-1994-1995-1998-1998-2000). Methodology for the subjective assessment of the quality of television pictures.
25. Wakerly, D., Mendenhall, W., Scheaffer, R., 2002, Mathematical statistics with applications. Duxbury Advanced Series.
26. Waters, K., 1987. A muscle model for animating three-dimensional facial expressions. Proceedings of the International Conference on Computer Graphics and Interactive Techniques (SIGGRAPH) 21 (4), 17-24.
27. Young, S., Kershaw, D., Odell, J., Ollason, D., Valtchev, V., Woodland, P., 1999. The HTK Book. Entropic Ltd, Cambridge.