SVM-based phoneme classification and lip shape refinement in real-time lip-synch system

International Journal of Pattern Recognition and Artificial Intelligence

Volumn 20, Issue 7, 2006, Pages 1029-1051

  Ko, Hanseok ^a   Han, David K ^b  

^a Korea University   (South Korea)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

Lip synch; Real time; Speech; Support vector machine; Viseme

Indexed keywords

COMPUTATIONAL METHODS; FEATURE EXTRACTION; LEARNING SYSTEMS; REAL TIME SYSTEMS; SPEECH ANALYSIS;

COMPUTATIONAL LOAD; HIDDEN MARKOV MODEL (HMM); SPEECH UTTERANCE;

CLASSIFICATION (OF INFORMATION);

EID: 33845963091     PISSN: 02180014     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218001406005113     Document Type: Article

References (15)

1. R. Andre-Obrecht, A new statistical approach for the automatic segmentation of continuous speech signals, IEEE Trans. Acoust. Speech Sign. Process. 36(1) (1998) 29-40.
2. P. Clarkson and P. J. Moreno, On the use of support vector machines for phonetic classification, Proc. Int. Conf. Acoust. Speech, Sign. Process. 2 (1999) 585-588.
3. S. Curinga, F. Lavagetto and F. Vignoli, Lip movements synthesis using time delay neural networks, Proc. EUSIPCO 96 (Sept. 1996).
4. S. E. Golowich and D. X. Sun, A support vector/hidden Markov model approach to phoneme recognition, ASA Proc. Statistical Computing Section (1998), pp. 125-130.
5. B. Kim, J. Kim, S. Kim and Y. Lee, A study on the design and the construction of a Korean speech DB for common use, J. Acoust. Soc. Korea 16(4) (1997) 35-41.
6. M.-T. Lin, C.-K. Lee and C.-Y. Lin, Consonant/vowel segmentation for Mandarin syllable recognition, Comput. Speech Lang. 13 (1999) 207-222.
7. D. V. McAllister, R. D. Rodman, D. L. Bitzer and A. S. Freeman, Lip synchronization for Animation, Proc. SIGGRAPH 97, Los Angeles, CA (August 1997).
8. S. Morishima, Real-time talking head driven by voice and its application to communication and entertainment, Proc. AVSP 98, Int. Conf. Auditory-Visual Speech Processing.
9. L. Rabiner and B.-H. Juang, Fundamentals of Speech Recognition (Prentice Hall, 1993) pp. 321-322.
10. H. Shimodaira, K.-ichi Noma, M. Nakai and S. Sagayama, Support vector machine with dynamic time-alignment kernel for speech recognition, Eurospeech 2001, Scandinavia (2001) 1841-1844.
11. light, http://svmlight.joachims.org/
12. M. Tamura, T. Masuko, T. Kobayashi and K. Tokuda, Visual speech synthesis based in parameter generation from HMM: speech driven and text-and-speech driven approaches, Proc. AVSP 98, Int. Conf. Auditory-Visual Speech Processing, pp. 221-226.
13. A. Von Brandt, Detecting and estimating parameters jumps using ladder algorithms and likelihood ratio test, Proc. ICASSP, Boston, MA (1983), pp. 1017-1020.
14. E. Yamamoto, S. Nakamura and K. Shikano, Lip movement synthesis from speech based on Hidden Markov models, Speech Commun. 26(1-2) (1998) 105-115.
15. S. Young, The HTK(Hidden Markov Model Tool Kit) Book (Cambridge University, Engineering Department, 2000), pp. 2-13.