A Real-Time Speech-Driven Talking Head using Active Appearance Models

Auditory-Visual Speech Processing 2007, AVSP 2007

Volumn , Issue , 2007, Pages

  Theobald, Barry John ^a   Wilkinson, Nicholas ^a  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

Author keywords

audio to visual mapping; speech driven facial animation; visual speech synthesis

Indexed keywords

IMAGE RECOGNITION; SPEECH PROCESSING;

ACTIVE APPEARANCE MODELS; AUDIO-TO-VISUAL MAPPING; AUDITORY FEATURE; FACIAL ANIMATION; REAL- TIME; SPEECH-DRIVEN FACIAL ANIMATION; SPEECH-DRIVEN TALKING HEADS; VISUAL FEATURE; VISUAL MAPPING; VISUAL SPEECH SYNTHESIS;

SPEECH SYNTHESIS;

EID: 84919370413     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. D. Stork and M. Hennecke (eds). Speechreading by Humans and Machines: Models, Systems and Applications, volume 150 of NATO ASI Series F: Computer and Systems Sciences. Springer-Verlag, Berlin, 1996.
2. M. Brand. “Voice puppetry,” In Proceedings of SIGGRAPH, pages 21-28, 1999.
3. Y. Du and X. Lin. “Realistic mouth synthesis based on shape appearance dependence mapping,” Pattern Recognition Letters, 23(14), pp. 1875-1885, December 2002.
4. R. Gutierrez-Osuna, P. Kakumanu, A. Esposito, O. Garcia, A. Bojorquez and I. Rudomin. “Speech-driven facial animation with realistic dynamics,” IEEE Transactions on Multimedia, 7(1), pp. 33-42, February, 2005.
5. C. Hsieh and Y. Chen. “Partial linear regression for speech-driven talking head application,” Signal Processing: Image Communication, 21, pp. 1-12, 2006.
6. Z. Wen, P. Hong and T. Huang. “Real time speech driven facial animation using formant analysis,” In Proceedings of the International Conference on Multimedia and Expo, pages 817-820, 2001.
7. C. Bregler, M. Covell, and M. Slaney. “Video rewrite: Driving visual speech with audio,” In Proceedings of SIGGRAPH, pages 353-360, 1997.
8. T. Ezzat, G. Geiger, and T. Poggio. “Trainable videorealistic speech animation.” In Proceedings of SIGGRAPH, pages 388-398, 2002.
9. O. Govokhina, G. Bailly, G. Breton and P. Bagshaw. “TDA: A new trainable trajectory formation system for facial animation,” In Proceedings of InterSpeech, pages 2474-2477, 2006.
10. F. Huang, E. Cosatto, and H. Graf. “Triphone based unit selection for concatenative visual speech synthesis,” In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, volume II, pages 2037-2040, 2002.
11. D. Massaro. Perceiving Talking Faces. The MIT Press, 1998.
12. B. Theobald, A. Bangham, I. Matthews, and G. Cawley. “Near-videorealistic synthetic talking faces: Implementation and evaluation,” Speech Communication, 44, pp. 127-140, 2004.
13. F. Parke and K. Waters. Computer Facial Animation. A K Peters, 1996.
14. T. Ezzat and T. Poggio. “Miketalk: A talking facial display based on morphing visemes,' In Proceedings of the Computer Animation Conference, pages 96-103, 1998.
15. T. Cootes, G. Edwards, and C. Taylor, “Active appearance models,” IEEE Transactions on Pattern Analysis and Machine Intelligence 23, pp. 681-685, June 2001.
16. B. Theobald, I. Matthews, J. Glauert, A. Bangham and G. Cawley. “2.5D Visual speech synthesis using appearance models,” In Proceedings of the British Machine Vision Conference, pages 42-52, 2003.
17. H. Hotelling, “Relations between two sets of variates,” Biometrika, bf 8, pp. 321-377, 1936.
18. T. Kuratate, K. Munhall, P. Rubin, E. Vatikiotis-Bateson, and H. Yehia. “Audio-visual synthesis of talking faces from speech production correlates”. In Proceedings of Eurospeech, pages 1279-1282, 1999.
19. M.E. Sargin, E. Erzin, Y. Yemez, A.M. Tekalp. “Lip feature extraction based on audio visual correlation”. In Proceedings of European Signal Processing Conference,2005.
20. H. Yehia, P. Rubin and E. Vatikiotis-Bateson. “Quantitative association of vocal-tract and facial behaviour,” Speech Communication, 26, pp. 23-43, 1998.
21. I. Matthews and S. Baker, “Active appearance models revisited,” International Journal of Computer Vision 60, pp. 135-164, November 2004.