Synthesizing visual speech trajectory with minimum generation error

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2011, Pages 4580-4583

  Wang, Lijuan ^a   Wu, Yi Jian ^a   Zhuang, Xiaodan ^a,b   Soong, Frank K ^a  

^a MICROSOFT RESEARCH ASIA   (China)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

minimum generation error; photo real; talking head; trajectory guided; visual speech synthesis

Indexed keywords

MINIMUM GENERATION ERROR; PHOTO-REAL; TALKING HEADS; TRAJECTORY-GUIDED; VISUAL SPEECH SYNTHESIS;

AUDIO ACOUSTICS; AUDIO SIGNAL PROCESSING; HEURISTIC METHODS; MAXIMUM LIKELIHOOD ESTIMATION; OPTIMIZATION; REFINING; SPEECH SYNTHESIS; TRAJECTORIES;

SPEECH COMMUNICATION;

EID: 80051645754     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2011.5947374     Document Type: Conference Paper

References (11)

1. C. Bregler, M. Covell, M. Slaney, "Video Rewrite: Driving Visual Speech with Audio," In Proc. ACM SIGGRAPH 97, Los Angeles, CA, 1997, pp. 353-360.
2. E. Cosatto and H.P. Graf, "Photo-realistic talking heads from image samples", IEEE Trans. Multimedia, 2000, vol. 2, no. 3, pp. 152-163.
3. S. Sako, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "HMM-based text-to-audio-visual speech synthesis," Proc. ICSLP2000, vol. 3, 2000, pp. 25-28.
4. L. Xie, Z.Q. Liu, "Speech Animation Using Coupled Hidden Markov Models," Proc. ICPR'06, August 2006, pp. 1128-1131.
5. K. Tokuda, H. Zen, etc., "The HMM-based speech synthesis system (HTS)," http://hts.ics.nitech.ac.jp/.
6. S. Fu, etc., "Audio/visual mapping with cross-modal hidden markov models," IEEE Transactions on Multimedia, vol. 7, no. 2, pp. 243-252, April 2005.
7. T. Toda, A. Black, and K. Tokuda, "Voice conversion based on maximum likelihood estimation of spectral parameter trajectory," Audio, Speech, and Language Processing, IEEE Transactions on, vol. 15, no. 8, pp. 2222-2235, Nov. 2007.
8. B.-J. Theobald, S. Fagel, G. Bailly, and F. Elisei, "LIPS 2008: Visual speech synthesis challenge," Proc. Interspeech2008, pp. 2310-2313.
9. Y.-J. Wu and R.-H. Wang, "Minimum generation error training for HMM-based speech synthesis," Proc. ICASSP 2006, Toulouse, France, May 2006, vol. I, pp. 89-92.
10. Y.-J. Wu, L. Qin, K. Tokuda, "An Improved Minimum Generation Error based Model Adaptation for HMM-based Speech Synthesis," Proc. Interspeech2009, Brighton, UK, Sept. 2009, pp.1787-1790.
11. L.-J. Wang, X.-J. Qian, W. Han, and F. Soong, "Synthesizing photo-real talking head via trajectory-guided sample selection," Interspeech2010, Chiba, Japan, Sept. 2010, pp.446-449.