Picture My Voice: Audio to Visual Speech Synthesis using Artificial Neural Networks

Auditory-Visual Speech Processing 1999, AVSP 1999

Volumn , Issue , 1999, Pages

  Massaro, Dominic W ^a   Beskow, Jonas ^a   Cohen, Michael M ^a   Fry, Christopher L ^a   Rodriguez, Tony ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC WAVES; SPEECH SYNTHESIS;

ACOUSTIC WAVEFORM; ARTIFICAL NEURAL NETWORKS; CEPSTRAL COEFFICIENTS; CONTROL PARAMETERS; DATA SET; NATURAL SPEECH; PERCEPTUAL EVALUATION; TALKING HEADS; VISUAL SPEECH; VISUAL SPEECH SYNTHESIS;

NEURAL NETWORKS;

EID: 85133709259     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Agelfors, E., Beskow, J., Dahlquist, M., Granstrom, B., Lundeberg, M., Spens, K-E., Ohman, T (1998): “Synthetic Faces as a Lipreading Support”, in Proceedings of ICSLP'98, International Conference on Spoken Language Processing, November 1998, Sydney, Australia.
2. Arslan, L.M. & Talkin, D. (1998) 3-D Face Point Trajectory Synthesis using an Automatically Derived Visual Phoneme Similarity Matrix. In D. Burnham, J. Robert-Ribes & E. Vatikiotis-Bateson (Eds.) Proceedings of the International Conference on Auditory-Visual Speech Processing, December 1998, Terrigal, Australia.
3. Benoit, C., & Le Goff, B. (1998). Audio-visaul speech synthesis from French text: Eight years of models, designs and evaluation at the ICP. Speech Communication, 26, 117-129.
4. Bernstein, L.E. & Eberhardt, S.P. (1986). Johns Hopkins lipreading corpus videodisk set. Baltimore, MD: The Johns Hopkins University.
5. Cohen, M. M., & Massaro, D. W. (1993) Modeling coarticulation in synthetic visual speech. In N.M Thalmann and D. Thalmann (Eds.) Models and Techniques in Computer Animation. Tokyo: Springer-Verlag.
6. Cohen, M. M., Walker, R. L., & Massaro, D. W. (1995) Perception of Synthetic Visual Speech, Speechreading by Man and Machine: Models, Systems and Applications, NATO Advanced Study Institute 940584, Aug 28-Sep 8, 1995, Chateau de Bonas, France.
7. Cromarty, A. (1999). Keynote address: Internetworked Multimedia and Entertainment Distribution. EnterTech Conference, April 25-27, La Costa Resort and Spa.
8. Goldenthal, W., Waters, K., Van Thong, J-M., & Glickman, O. (1997): “Driving Synthetic Mouth Gestures: Phonetic Recognition for FaceMe!”, in proceedings of EUROSPEECH'97, September 1997, Rhodes, Greece
9. Massaro, D. W. (1998) Perceiving Talking Faces: From Speech Perception to a Behavioral Principle. Cambridge, Mass.: MIT Press.
10. Massaro, D. W., & Stork, D. G. (1998) Speech Recognition and Sensory Integration. American Scientist, 86.
11. Morishima, S. (1998) Real-time Talking Head Driven by Voice and its Application to Communication and Entertainment. In D. Burnham, J. Robert-Ribes & E. Vatikiotis-Bateson (Eds.) Proceedings of the International Conference on Auditory-Visual Speech Processing, December 1998, Terrigal, Australia.
12. Reveret, L. & Benoit, C. (1998). A new 3D lip model for analysis and synthesis of lip motion in speech production. In D. Burnham, J. Robert-Ribes & E. Vatikiotis-Bateson (Eds.) Proceedings of the International Conference on Auditory-Visual Speech Processing, December 1998, Terrigal, Australia.
13. Tamura, M., Masuko, T., Kobayashi, T. & Tokuda, K. (1998) Visual speech synthesis based on parameter generation from HMM: Speech driven and text-and-speech driven approaches. In D. Burnham, J. Robert-Ribes & E. Vatikiotis-Bateson (Eds.) Proceedings of the International Conference on Auditory-Visual Speech Processing, December 1998, Terrigal, Australia.
14. The Need for Increased Speech Synthesis Research (1999) Report of the 1998 NSF Workshop for Discussing Research Priorities and Evaluation Strategies in Speech Synthesis. Editors: R. Sproat, M. Ostendorf, and A. Hunt. March, 1999.
15. Wightman, C. W. and Talkin, D. T., (1997). “The Aligner: Text-to-Speech Alignment Using Markov Models", in Progress in Speech Synthesis, J. P. van Santen, et al, (Eds.). Springer Verlag, New York: (pp. 313-323).
16. Yamamoto E., Nakamura, S., & Shikano, K. (1998). Lip movement synthesis from speech based on Hidden Markov Models. Speech Communication, 26, 105-115