Talking heads synthesis from audio with deep neural networks

2015 IEEE/SICE International Symposium on System Integration, SII 2015

Volumn , Issue , 2016, Pages 100-105

  Shimba, Taiki ^a   Sakurai, Ryuhei ^a   Yamazoe, Hirotake ^a   Lee, Joo Ho ^a  

^a RITSUMEIKAN UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

MEAN SQUARE ERROR; REGRESSION ANALYSIS; SPEECH RECOGNITION; STATISTICAL TESTS;

ACTIVE APPEARANCE MODELS; AUDIO-VISUAL DATA; DEEP NEURAL NETWORKS; LEARNING PROBLEM; LONG SHORT TERM MEMORY; MEAN SQUARED ERROR; MEL-FREQUENCY CEPSTRAL COEFFICIENTS; SEQUENCE MAPPINGS;

GESTURE RECOGNITION;

EID: 84963745989     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SII.2015.7404961     Document Type: Conference Paper

References (10)

1. E. Cosatto and H. P. Graf, "Sample-Based Synthesis of Photo-Realistic Talking Heads", In Computer Animation 98. Proceedings, IEEE, pp. 103-110, 1998.
2. L. Cappelletta and N. Harte, "Phoneme-to-viseme Mapping for Visual Speech Recognition", ICPRAM, pp. 322-329, 2012.
3. B. Fan, L.-J. Wang, F. K. Soong, and L. Xie, "Photo-Real Talking Head With Deep Bidirectional LSTM", ICASSP, Brisbane, Australia, IEEE, April 2015.
4. W. Vincent, A. Robert, B. Art, B. Norbert, C. Langzhou, K. BalaKrishna, L. Javier, M. Ranniery, S. Bjorn, Y. Kayoko, S. Yannis, A. Masami, J. F. Mark and C. Roberto, "Photo-Realistic Expressive Text to Talking Head Synthesis", INTERSPEECH, pp. 2667-2669, 2013.
5. S. Haq and P.J.B. Jackson, "Multimodal Emotion Recognition", In W. Wang (ed), Machine Audition: Principles, Algorithms and Systems, IGI Global Press, ISBN 978-1615209194, DOI 10.4018/978-1-61520-919-4, chapter 17, pp. 398-423, July 2010.
6. S. Furui, "Speaker-Independent isolated Word Recognition Using Dynamic Features of Speech Spectrum", Acoustics, Speech, and Signal Processing, IEEE Transactions on, no. 34, vol. 1, pp. 52-59, 1986.
7. O. W. Kwon, K. Chan, J. Hao and T. W. Lee, "Emotion Recognition by Speech Signals", INTERSPEECH, September 2003.
8. Y. Pan, P. Shen and L. Shen, "Speech Emotion Recognition Using Support Vector Machine", International Journal of Smart Home, no. 6, vol. 2, pp. 101-107, 2012.
9. P. Ekman and W.V. Friesen, "Facial Action Coding System", Consulting Psychologist Press, Palo Alto, CA, 1978.
10. J. Alabort-i-Medina, E. Antonakos, J. Booth, P. Snape and S. Zafeiriou, "Menpo: A Comprehensive Platform for Parametric Image Alignment and Visual Deformable Models", In Proceedings of the ACM International Conference on Multimedia, ACM, pp. 679-682, 2014.