Speech driven face animation based on dynamic concatenation model

Journal of Information and Computational Science

Volumn 4, Issue 1, 2007, Pages 271-280

  Tao, Jianhua ^a   Yin, Panrong ^a  

^a INSTITUTE OF AUTOMATION   (China)

Author keywords

Face animation; Speech driven; Talking head

Indexed keywords

CALCULATIONS; COMPUTER SIMULATION; COST FUNCTIONS; DYNAMICS; FACE RECOGNITION; IMAGE QUALITY; MAPPING; MATHEMATICAL MODELS; SPECTRUM ANALYSIS; SPEECH;

DYNAMIC CONCATENATION MODEL; FACE ANIMATION; LIP MOVEMENT; SPEECH DRIVEN; TALKING HEADS; VISUAL DISTANCE; VOICE SPECTRUM DISTANCE;

ANIMATION;

EID: 34547732498     PISSN: 15487741     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (17)

1. K. S. Arun, T. S. Huang and S. D. Blostein, Least-square fitting of two 3D point sets, IEEE Trans, Pattern Analysis and Machine Intelligence 9 (5) 1987 698-700.
2. C. Bregler, M. Covell and M. Slaney, Video rewrite: driving visual speech with audio, in: ACM SIGGRAPH, 1997.
3. E. Cosatto, G. Potamianos and H. P. Graf, Audio-visual unit selection for the synthesis of photorealistic talking-heads, in: IEEE International Conference on Multimedia and Expo, ICME, 2000, pp. 619-622.
4. P. Ekman and W. V. Friesen, Facial Action Coding System, Consulting Psychologists Press, Palo Alto Calif., 1978.
5. T. Ezzat, T. Poggio and MikeTalk, A talking facial display based on morphing visemes, in: Proc. Computer Animation Conference, Philadelphia, USA, 1998.
6. R. Gutierrez-Osuna, P. K. Kakumanu, A. Esposito, O. N. Garcia, A. Bojorquez, J. L. Castillo and I. Rudomin, Speech-driven facial animation with realistic dynamics, IEEE Trans. Multimedia 7 (1) (2005) 33-42.
7. A. Hunt and A. Black, Unit selection in a concatenative speech synthesis system using a large speech database, in: ICASSP, Vol. 1, 1996, pp. 373-376.
8. Pengyu Hong, Zhen Wen and Thomas S. Huang, Real-time speech-driven face animation with expressions using neural networks, IEEE Trans. on Neural Networks 13 (4) (2002) 916-927.
9. S. Kshirsagar, T. Molet, and N. M. Thalmann, Principal components of expressive speech animation, in: Proc. of Computer Graphics International, 2001.
10. Dominic W. Massaro, Jonas Beskow, Michael M. Cohen, Christopher L. Pry and Tony Rodriguez, Picture my voice: audio to visual speech synthesis using artificial neural networks, in: Proceedings of AVSP'99, Santa Cruz, CA., August, 1999, pp. 133-138.
11. A. Murat Tekalp and JoK rn Ostermann, Face and 2D mesh animation in MPEG-4, Signal Processing, Image Communication 15 (2000) 387-421.
12. Ram R. Rao, Tsuhan Chen and Russell M. Mersereau, Audio-to-visual conversion for multimedia communication, IEEE Trans. Industrial Electronics 45 (1) (1998) 15-22.
13. Jian-Qing Wang, Ka-Ho Wong, Pheng-Ann Pheng, H. M. Meng and Tien-Tsin Wong, A real-time Cantonese text-to-audiovisual speech synthesizer, in: Acoustics, Speech, and Signal Processing, 2004, Proceedings, (ICASSP'04), Vol. 1, pp. 653-656.
14. Ashish Verma, L. Venkata Subramaniam, Nitendra Rajput, Chalapathy Neti and Tanveer A. Faruquie, Animating expressive faces across languages, IEEE Trans. Multimedia 6 (6) (2004) 791-800.
15. E. Yamamoto, S. Nakamura and K. Shikano, Lip movement synthesis from speech based on hidden Markov models, Speech Communication 26 (1998) 105-115.
16. Overview of the MPEG-4 Standard, http://www.chiariglione.org/mpeg/standards/mpeg-4/mpeg-4.htm, 2005.
17. The Hidden Markov Model Toolkit (HTK), http://htk.eng.cam.ac.uk/, 2005.