On Evaluating Synthesised Visual Speech

International Conference on Auditory-Visual Speech Processing 2008, AVSP 2008

Volumn , Issue , 2008, Pages 7-12

  Theobald, Barry John ^a   Wilkinson, Nicholas ^a   Matthews, Iain ^b  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

^b WETA DIGITAL   (New Zealand)

Author keywords

Active appearance models; Evaluation; Visual speech synthesis

Indexed keywords

IMAGE RECOGNITION; SPEECH SYNTHESIS;

ACTIVE APPEARANCE MODELS; EVALUATION; PERFORMANCE; PERFORMANCE METRICES; SENTENCE-LEVEL UTTERANCES; SPEECH SEQUENCES; SUBJECTIVE EVALUATIONS; SYNTHESISED; VISUAL SPEECH; VISUAL SPEECH SYNTHESIS;

BENCHMARKING;

EID: 84865399945     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. Brand, M., “Voice puppetry,” In Proceedings of SIGGRAPH, 21–28, 1999.
2. Cosker, D., Marshall, D., Rosin, S., Paddock, P., and Rushton, S., “Towards perceptually realistic talking heads: Models, metrics and McGurk,” in Proceedings of the Symposium on Applied Perception in Graphics and Visualization, 2004.
3. Gutierrez-Osuna, R., Kakumanu, P., Esposito, A., Garcia, O., Bojorquez, A., and Rudomin. I., “Speech-driven facial animation with realistic dynamics”, IEEE Transactions on Multimedia, 7(1):33–42, February, 2005.
4. Hsieh, C., and Chen, Y., “Partial linear regression for speech-driven talking head application,” Signal Processing: Image Communication, 21:1–12, 2006.
5. Theobald, B., and Wilkinson, N., “A Real-time Speech-Driven Talking Head using Active Appearance Models”, In Proceedings of Auditory Visual Speech Processing, 264–269, 2007.
6. Bregler, C., Covell, M., and Slaney, M., “Video rewrite: Driving visual speech with audio,” in Proceedings of SIGGRAPH, 353–360, 1997.
7. Ezzat, T., Geiger, G., and Poggio, T., “Trainable videorealistic speech animation,” in Proceedings of SIGGRAPH, 388–398, 2002.
8. Fagel, S., “Joint audio-visual unit selection — The JAVUS speech synthesizer”, In Proceedings of the International Conference on Speech and Computer, 2006
9. Govokhina, O., Bailly, G., Breton, G., and Bagshaw, P., “TDA: A new trainable trajectory formation system for facial animation,” In Proceedings of Interspeech, 2474–2477, 2006.
10. Grauwinkel, K., Dewitt, B., and Fagel, S., “Visualization of internal articulator dynamics and its intelligibility in synthetic audiovisual speech”, In International Congress on Phonetic Sciences, 2007.
11. Huang, F., Cosatto, E., and Graf, H., “Triphone based unit selection for concatenative visual speech synthesis,” in Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2:2037–2040, 2002.
12. Massaro, D., “Perceiving Talking Faces”, The MIT Press, 1998.
13. Theobald, B., Bangham, J., Matthews, I., and Cawley, G., “Near-videorealistic synthetic talking faces: Implementation and evaluation”, Speech Communication, 44:127–140, 2004.
14. Bailly, G., Bérar, M., Elisei, F., and Odisio, M., “Audiovisual speech synthesis”, International Journal of Speech Technology, 6:331–346, 2003.
15. Theobald, B., “Audiovisual Speech Synthesis”, International Congress on Phonetic Sciences, 285–290, 2007.
16. Cootes, T., Edwards, G., and Taylor, C., “Active appearance models”, In IEEE Transactions on Pattern Analysis and Machine Intelligence, 23:681–685, June, 2001.
17. Theobald, B., “Visual speech synthesis using shape and appearance models”, Ph.D. dissertation, University of East Anglia, Norwich, UK, 2003.
18. Bailly, G., Gibert, G., and Odisio, M., “Evaluation of movement generation systems using the point-light technique”, IEEE Workshop on Speech Synthesis, 27–30, 2002.