Visual Speech Synthesis Using Statistical Models of Shape and Appearance

Auditory-Visual Speech Processing 2001, AVSP 2001

Volumn , Issue , 2001, Pages 78-83

  Theobald, Barry J ^a   Bangham, J Andrew ^a   Matthews, Iain ^b   Cawley, Gavin C ^a  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

SPEECH PROCESSING; SPEECH SYNTHESIS;

COMPACT REPRESENTATION; HUMAN FACES; SEQUENCE OF IMAGES; SPEECH CORPORA; SPEECH SYNTHESIZER; STATISTIC MODELING; STORAGE COSTS; TRIPHONES; VISUAL SPEECH; VISUAL SPEECH SYNTHESIS;

SUBJECTIVE TESTING;

EID: 0142210581     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. Methedology for the subjective assessment of the quality of television pictures. Technical report, Recommendation ITU-R BT.500-10, 1974-1978-1982-1986-1990-1992-1994-1995-1998-1998-2000.
2. L.M. Arslan and D. Talkin. 3-d face point trajectory synthesis using an automatically derived visual phoneme similarity matrix. In Proceedings of Auditory-Visual Speech Processing, pages 175-180, 1998.
3. J. Beskow. Talking heads - communication, articulation and animation. In Proceedings of Fonetik-96, pages 29-31, 1996.
4. C. Bregler, M. Covell, and M. Slaney. Video rewrite: driving visual speech with audio. In Proceedings of SIGGRAPH, pages 353-360, 1997.
5. N.M. Brooke and S.D. Scott. Two- and three-dimensional audio-visual speech synthesis. In Proceedings of Auditory-Visual Speech Processing, pages 213-218, 1998.
6. J. Cassell, C. Pelachaud, N. Badler, M. Steedman, B. Achron, T. Becket, B. Douvill, S. Prevost, and M. Stone. Animated conversation: rule based generation of facial expression, gesture and spoken intonation for multiple conversational agents. In Proceedings of SIGGRAPH, pages 413-420, 1996.
7. M. Cohen and D Massaro. Modeling coarticualtion in synthetic visual speech. In N.M. Thalmann and Thalmann D, editors, Models and Techniques in Computer Animation, pages 141-155. Springer-Verlag, 1994.
8. T.F. Cootes, G.J. Edwards, and C.J. Taylor. Active appearance models. In H. Burkhardt and B. Neumann, editors, Proceedings of the European Conference on Computer Vision, volume 2, pages 484-498. Springer-Verlag, 1998.
9. P. Ekman and W.V. Friesen. Manual for the Facial Action Coding System. Consulting Psychologists Press Inc., 1978.
10. I. Essa and A. Pentland. Coding, analysis, interpretation and recognition of facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):757-763, July 1997.
11. T. Ezzat and T. Poggio. Visual speech synthesis by morphing visemes. Technical Report 1658/CBCL, MIT, 1999.
12. Bristol University Centre for Deaf Studies. Deaf people and television. Research Notes, 10, 1995.
13. S. Gregory, J. Bishop, and L. Sheldon. Deaf Young People and their Families: Developing Understanding. Cambridge University Press., 1995.
14. A. Hallgren and B. Lyberg. Visual speech synthesis with concatenative speech. In Proceedings of Auditory-Visual Speech Processing, pages 181-183, 1998.
15. R.D. Johnston. Beyond intelligibility - the performance of text-to-speech synthesisers. BT Technology Journal, 14(1):100-111, 1996.
16. Z. Liu, Z. Zhang, C. Jacobs, and M. Cohen. Rapid modeling of animated faces from video. Technical Report MSR-TR-2000-11, Microsoft Corporation, 2000.
17. S. Morishima. Real-time talking head driven by voice and its application to communication and entertainment. In Proceedings of Auditory-Visual Speech Processing, pages 195-199, 1998.
18. F.I. Parke. A Parametric Model for Human Faces. PhD thesis, University of Utah, Saltlake City, Utah, 1974.
19. F.I. Parke and K. Waters. Comptuer Facial Animation. A K Peters, 1996.
20. F. Pighin, J. Hecker, D. Lischinski, R Szeliski, and D. Salesin. Synthesizing realistic facial expressions from photographs. In Proceedings of SIGGRAPH, 1998.
21. L. Reveret and C. Benoit. A new 3d lip model for analysis and synthesis of lip motion in speech production. In Proceedings of Auditory-Visual Speech Processing, 1998.
22. D. Terzopoulos and K. Waters. Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(6):569-579, 1993.
23. Y. Tian, T. Kanade, and J.F. Cohn. Recognizing action units for facial expression analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(2):97-115, February 2001.
24. M. Unser. Splines: a perfect fit for signal and image processing. IEEE Signal Processing Magazine, 16(6):22-38, 1999.
25. K. Waters. A muscle model for animating three-dimensional facial expressions. Computer Graphics (SIGGRAPH'87), 21(4):17-24, 1987.