Direct, modular and hybrid audio to visual speech conversion methods - A comparative study

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2009, Pages 2267-2270

  Takacs, Gyorgy ^a  

^a PÁZMÁNY PÉTER CATHOLIC UNIVERSITY   (Hungary)

Author keywords

Audio to visual conversion; Facial animation

Indexed keywords

AUDIO-TO-VISUAL CONVERSION; COMPARATIVE STUDIES; DIRECT CONVERSION; EVALUATION TEST; FACIAL ANIMATION; FACIAL MOTIONS; SPEECH MATERIALS; VISUAL SPEECH;

ANIMATION;

SPEECH COMMUNICATION;

EID: 70450168976     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. J. Beskow, I. Karlsson, J. Kewley, and G. Salvi. "Synface - a talking head telephone for the hearing-impaired". Computers Helping People with Special Needs, 1178-1186, 2004.
2. S. Al Moubayed, M. De Smet, and H. Van Hamme. "Lip synchronization: from phone lattice to pca eigen-projections using neural networks". In Proceedings of Interspeech 2008, Brisbane, Australia, sep 2008.
3. Gyorgy Takacs, Attila Tihanyi, Tamas Bardi, Gergely Feldhoffer, and Balint Srancsik. "Speech to facial animation conversion for deaf customers". In 4th European Signal Processing Conf., Florence, Italy, 2006.
4. Gregor Hofer, Junichi Yamagishi, and Hiroshi Shimodaira. "Speech-driven lip motion generation with a trajectory hmm." In Proc. Interspeech 2008, pages 2314-2317, Brisbane, Australia, 2008.
5. http://avisynth.org.
6. Péter Mihajlik, Zoltán Tüske, Balázs Tarján, Bottyán Németh, and Tibor Fegyó." Improved recognition of spontaneous hungarian speech morphological and acoustic modeling techniques for a less resourced task" IEEE Transaction on Audio Speech and Language Processing (submitted), 2008.
7. P. Mihajlik, T.r Fegyó, B. Németh, and V. Trón. "Towards automatic transcription of large spoken archives in agglutinating languages: Hungarian asr for the malach project" In Speech and Dialogue: 10th International Conference, Pilsen, Czech Republic, 2007.
8. P. Mihajlik, , Z. Tobler, Z. Tüske, and G. Gordos. "Evaluation and optimization of noise robust front-end technologies for the automatic recognition of hungarian telephone speech". In Interspeech 2005 - Eurospeech: 9th European Conference on Speech Communication and Technology, Lisboa, Portugal, 2005.
9. http://alpha.tmit.bme.hu/speech/hdbMRBA.php.
10. P. Mihajlik, T. Révész, and P. Tatai. "Phonetic transcription in automatic speech recognition". ACTA LINGUISTICA HUNGARICA, pages pp. 407-425, 2003.
11. Mehryar Mohri, Fernando C. N. Pereira, and Michael Riley. "Weighted-nite-state transducers in speech recognition" Computer Speech and Language, pages pp. 69-88, 2002.
12. L. Czap and J. Mátyás. "Virtual speaker" Híradástechnika Selected Papers, Vol LX/6:pp.2-5, 2005.
13. Gérard Bailly, Oxana Govokhina, Gaspard Breton, and Fréedéeric Elisei. "A trainable trajectory formation model td-hmm parameterized for the lips" 2008 challenge. In Proceedings of Interspeech 2008, Brisbane, Australia, sep 2008. 7
14. Gergely Feldhoffer, Tamas Bardi, Gyorgy Takacs, and Attila Tihanyi." Temporal asymmetry in relations of acoustic and visual features of speech" In 15th European Signal Processing Conf., Poznan, Poland, 2007.
15. P. Kakumanu,A. Esposito, O. N. Garcia, R. Gutierrez-Osuna, "A comparison of acoustic coding models for speechdriven facial animation", Speech Communication 48 pp 598-615, 2006