Comparison of phoneme and viseme based acoustic units for speech driven realistic lip animation

Proceedings of 3DTV-CON

Volumn , Issue , 2007, Pages

  Bozkurt, Elif ^a   Erdem, Çiǧdem Eroǧlu ^a   Erzin, Engin ^b   Erdem, Tanju ^a   Özkan, Mehmet ^a  

^a Momentum A   (Turkey)

^b KOÇ UNIVERSITY   (Turkey)

Author keywords

Character animation; Hidden Markov models; Lip animation; Lip synchronization; Viseme recognition

Indexed keywords

ACOUSTICS; ANIMATION; COMPUTATIONAL GRAMMARS; DIGITAL TELEVISION; MARKOV PROCESSES; OBJECT RECOGNITION; SPEECH; SYNCHRONIZATION; TELEPHONE SYSTEMS; TELEVISION BROADCASTING;

CHARACTER ANIMATION; CONTEXT INFORMATIONS; HMM BASED RECOGNITION SYSTEMS; LIP ANIMATION; LIP SYNCHRONIZATION; OBJECTIVE EVALUATIONS; SPEECH DRIVEN; VISEME RECOGNITION;

HIDDEN MARKOV MODELS;

EID: 47949087133     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/3DTV.2007.4379417     Document Type: Conference Paper

References (16)

1. C. C. Chibelushi, F. Deravi, and J.S.D. Mason, "A review of speech-based bimodal recognition", IEEE Trans. on Multimedia, vol.4, nr.1, pp. 23-37, March 2002.
2. Magnenat-Thalmann, N., and D.Thalmann, Synthetic Actors in Computer Generated Three-Dimensional Films, Springer-Verlag, Tokyo, 1990.
3. T. Ezzat, and T. Poggio, "MikeTalk: A Talking Facial Display Based on Morphing Visemes", Proc. Computer Animation Conference, Pennsylvania, 1998.
4. D. Hill, A. Pearce, and B. Wyvill, "Animating speech: an automated approach using speech synthesis by rules", The Visual Computer, vol. 3, pp. 277-289, 1988.
5. J. Lewis, and F. Parke, "Automated lip-synch and speech synthesis for character animation", Proc. CHI87, ACM, New York, Toronto, pp. 143-147, 1980.
6. E. Yamamoto, S. Nakamura, and K. Shikano, "Lip movement synthesis from speech based on Hidden Markov models," Speech Communication, vol. 26, no. 1-2, pp. 105-115, 1998.
7. L. M. Arslan, and D. Talkin, "Codebook Based Face Point Trajectory Synthesis Algorithm using Speech Input", Speech Communication, vol. 27, pp. 81-93, 1999.
8. T. Ohman, "An audio-visual speech database and automatic measurements of visual speech," Quarterly Progress and Status Report, Department of Speech, Music and Hearing, Royal Institute of Technology, Stockholm, Sweden, 1998.
9. th European Signal Processing Conference, Antalya, September 4-8, 2005.
10. H. McGurk, and J. MacDonald, "Hearing Lips and Seeing Voices", Nature, vol 264, pp. 746-748, December 1976.
11. J. Dongmei, X.. Lei, Z. Rongchun, W. Verhelst, I. Ravyse, and H. Sahli, "Acoustic Viseme Modelling for Speech Driven Animation: A Case Study", IEEE Benelux Workshop on MPCA, November 2002.
12. S. Seneff, and V. Zu. "Transcription and Alignment of the Timit Database", NIST, CD-ROM TIMIT, 1988.
13. S. J. Young, D. Kershaw, J. Odell, and P.Woodland, "The HTK Book (for HTK Version 3.1)", http://htk,eng.cam.ac.uk/. 2001.
14. "Methodology for the Subjective Assessment of the Quality of Television Pictures", Technical Report, Recommendation ITU-R BT.500-11, 2002.
15. A. Verma, N. Rajput, L. V. Subramaniam, "Using Viseme Based Acoustic Models for Speech Driven Lip Synthesis", Proc. IEEE Int. Conf Acoustics, Speech & Signal Proc (ICASSP), 2003.
16. http://www.momentum-dmt.com/paper/tv_fdhc0.avi