An articulation model for audiovisual speech synthesis - Determination, adjustment, evaluation

Speech Communication

Volumn 44, Issue 1-4 SPEC. ISS., 2004, Pages 141-154

  Fagel, Sascha ^a   Clemens, Caroline ^a  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

Author keywords

Articulation model; Audiovisual speech synthesis; Auditory visual speech perception; Talking head

Indexed keywords

ARTICULATION MODEL; AUDIOVISUAL SPEECH; TALKING HEAD;

COMMUNICATION; DATA PROCESSING; HUMAN COMPUTER INTERACTION; SPEECH; SPEECH COMMUNICATION;

SPEECH SYNTHESIS;

EID: 10444283472     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2004.10.006     Document Type: Article

References (25)

1. Benoît, C., 1996. On the production and the perception of audio-visual speech by man and machine. In: Bertoni, H., Wang, Y., Panwar, S. (Eds.), Multimedia and Video Coding. Plenum Press, New York.
2. Beskow, J., 2004. Trainable articulatory control models for visual speech synthesis. Int. J. Speech Technol.
3. Boersma, P., Weenink, D., 2004. Praat: Doing phonetics by computer. Available from: 〈http://www.praat.org〉.
4. Braida, L., 1991. Crossmodal integration in the identification of consonant segments. Quarter. J. Exp. Psychol. 43, 647-677.
5. Bui, T.D., Heylen, D., Nijholt, A., 2004. Combination of facial movements on a 3D talking head. In: Proceedings Computer Graphics International, Crete, 2004, pp. 284-291.
6. Carstens Medizinelektronik, 2002. AG 100 - Electromagnetic Articulography. Available from: 〈http://www.articulograph.de〉.
7. Cohen, M.M., Massaro, D.W., 1993. Modeling co-articulation in synthetic visual speech. In: Magnenat Thalmann, N., Thalmann, D. (Eds.), Models and Techniques in Computer Animation. Springer-Verlag, Tokyo, pp. 139-156.
8. Fagel, S., Sendlmeier, W.F., 2002. Entwurf eines Frameworks für audiovisuelle Sprachsynthesesysteme. In: Tagungsband der 13. Konferenz Elektronische Sprachsignalverarbeitung. Dresden, pp. 372-378.
9. Fisher, C.G., 1968. Confusions among visually perceived consonants. J. Speech Hearing Res. 11, 769-804.
10. Grant, K.G., Seitz, P.F., 1998. Measures of auditory-visual integration in non-sense syllables and sentences. J. Acoust. Soc. Amer. 104, 2438-2450.
11. Le Goff, B., 1997. Automatic modelling of coarticulation in text-to-visual-speech synthesis. In: Proceedings of the 5th Eurospeech Conference, Rhodos, pp. 1667-1670.
12. Le Goff, B., Guiard-Marigny, T., Cohen, M., Benoît, C., 1994. Analysis-synthesis and intelligibility of talking faces. In: Proceedings of the Second ESCA/IEEE Workshop on Speech Synthesis, New York, pp. 53-56.
13. Löfqvist, A., 1990. Speech as audible gestures. In: Hardcastle, A., Marchal, A. (Eds.), Speech Production and Speech Modeling. Kluwer Academic Publishers, Dodrecht, pp. 289-322.
14. Massaro, D.W., 1987. Speech Perception by Ear and Eye: A Paradigm for Psychological Inquiry. Erlbaum, London.
15. McGurk, H., MacDonald, I., 1976. Hearing lips and seeing voices. Nature 264, 746-748.
16. Munhall, K.G., 2003. X-ray database for speech research. Available from: 〈http://psyc.queensu.ca/faculty/munhall/x-ray/〉.
17. Munhall, K.G., Jones, J., 1998. Articulatory evidence for syllabic structure. Behavioral Brain Sci. 21, 524-525.
18. Pandzic, I.S., Ostermann, J., Millen, D., 1999. User evaluation: Synthetic talking faces for interactive services. Visual Comput. J. 15, 330-340.
19. Sendlmeier, W.F., v. Wedel, H., 1986. Ein Verfahren zur Messung von Fehlleistungen beim Sprachverstehen - Überlegungen und erste Ergebnisse. Sprache-Stimme-Gehör 10, 164-169.
20. Sumby, W., Pollack, I., 1954. Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Amer. 26, 212-215.
21. The MBROLA Project, 2003. Available from: 〈http://tcts.fpms.ac.be/synthesis/mbrola.html〉.
22. The Web3D Consortium, 1997. VRML - Virtual Reality Modeling Language. Available from: 〈http://www.web3d.org/technicalinfo/specifications.htm〉.
23. The Web3D Consortium, 2001. H-Anim 2001 - Humanoid Animation Specification. Available from: 〈http://www.h-anim.org/Specifications/H-Anim2001〉.
24. Wirth, G., 1994. Sprech- und Sprachstörungen. Deutscher Ärzte Verlag, KÖln.
25. ZAS - Zentrum fÜr allgemeine Sprachwissenschaft, 2003. Available from: 〈http://www.zas.gwz-berlin.de〉.