CAPTURING DATA AND REALISTIC 3D MODELS FOR CUED SPEECH ANALYSIS AND AUDIOVISUAL SYNTHESIS

Auditory-Visual Speech Processing 2005, AVSP 2005

Volumn , Issue , 2005, Pages 125-130

  Elisei, Frédéric ^a   Bailly, Gérard ^a   Gibert, Guillaume ^a   Brun, Rémi ^b  

^a CNRS   (France)

^b Attitude Studio SA   (France)

Author keywords

[No Author keywords available]

Indexed keywords

SPEECH SYNTHESIS;

3-D TRAJECTORY; CAPTURING DATA; CUED SPEECH; DIPHONES; FACE DEFORMATIONS; MULTI-MODAL; NON LINEAR; REALISTIC 3D MODELING; STATISTIC MODELING; TEXT-TO-SPEECH SYNTHESIS SYSTEM;

DIGITAL STORAGE;

EID: 44949157479     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Yehia, H.C., Rubin, P.E., and Vatikiotis-Bateson, E. (1998) Quantitative association of vocal-tract and facial behavior. Speech Communication, 26: p.23-43.
2. Kuratate, T., Munhall, K.G., Rubin, P.E., Vatikiotis-Bateson, E., and Yehia, H. (1999) Audio-visual synthesis of talking faces from speech production correlates. in EuroSpeech. p.1279-1282.
3. Jiang, J., Alwan, A., Bernstein, L., Keating, P., and Auer, E. (2000) On the Correlation between facial movements, tongue movements and speech acoustics. in International Conference on Speech and Language Processing. Beijing, China. p.42-45.
4. Bailly, G. and Badin, P. (2002) Seeing tongue movements from outside. in International Conference on Speech and Language Processing. Boulder - Colorado. p.1913-1916.
5. Engwall, O. and Beskow, J. (2003) Resynthesis of 3D tongue movements from facial data. in EuroSpeech. Geneva
6. Owens, E. and Blazek, B. (1985) Visemes observed by hearing-impaired and normal-hearing adult viewers. Journal of Speech and Hearing Research, 28: p.381-393.
7. Bernstein, L.E., Demorest, M.E., and Tucker, P.E. (2000) Speech perception without hearing. Perception & Psychophysics, 62: p.233-252.
8. Cornett, R.O. (1967) Cued Speech. American Annals of the Deaf, 112: p.3-13.
9. Cornett, R.O. (1988) Cued Speech, manual complement to lipreading, for visual reception of spoken language. Principles, practice and prospects for automation. Acta Oto-Rhino-Laryngologica Belgica, 42(3): p.375-384.
10. Nicholls, G. and Ling, D. (1982) Cued Speech and the reception of spoken language. Journal of Speech and Hearing Research, 25: p.262-269.
11. Uchanski, R., Delhorne, L., Dix, A., Braida, L., Reed, C., and Durlach, N. (1994) Automatic speech recognition to aid the hearing impaired: Prospects for the automatic generation of cued speech. Journal of Rehabilitation Research and Development, 31: p.20-41.
12. Attina, V., Beautemps, D., and Cathiard, M.-A. (2002) Coordination of hand and orofacial movements for CV sequences in French Cued Speech. in International Conference on Speech and Language Processing. Boulder - USA. p.1945-1948.
13. Attina, V., Beautemps, D., and Cathiard, M.-A. (2003) Temporal organization of French Cued Speech production. in International Conference of Phonetic Sciences. Barcelona, Spain
14. Attina, V., Beautemps, D., Cathiard, M.-A., and Odisio, M. (2004) A pilot study of temporal organization in Cued Speech production of French syllables: rules for a Cued Speech synthesizer. Speech Communication, 44: p.197-214.
15. Duchnowski, P., Lum, D.S., Krause, J.C., Sexton, M.G., Bratakos, M.S., and Braida, L.D. (2000) Development of speechreading supplements based on automatic speech recognition. IEEE Transactions on Biomedical Engineering, 47(4): p.487-496.
16. Attina, V., Beautemps, D., Cathiard, M.-A., and Odisio, M. (2003) Towards an audiovisual synthesizer for Cued Speech: rules for CV French syllables. in Auditory-Visual Speech Processing. St Jorioz - France. p.227-232.
17. Gibert, G., Bailly, G., and Elisei, F. (2004) Audiovisual text-to-cued speech synthesis. in 5th Speech Synthesis Workshop. Pittsburgh, PA. p.85-90.
18. Revéret, L. and Benoît, C. (1998) A new 3D lip model for analysis and synthesis of lip motion in speech production. in Auditory-visual Speech Processing Workshop. Terrigal, Australia. p.207-212.
19. Badin, P., Bailly, G., Revéret, L., Baciu, M., Segebarth, C., and Savariaux, C. (2002) Three-dimensional linear articulatory modeling of tongue, lips and face based on MRI and video images. Journal of Phonetics, 30(3): p.533-553.
20. Elisei, F., Odisio, M., Bailly, G., and Badin, P. (2001) Creating and controlling video-realistic talking heads. in Auditory-Visual Speech Processing Workshop. Scheelsminde, Denmark. p.90-97.
21. Odisio, M. and Bailly, G. (2004) Shape and appearance models of talking faces for model-based tracking. Speech Communication, 44(1-4): p.63-82.
22. Holm, B. and Bailly, G. (2002) Learning the hidden structure of intonation: implementing various functions of prosody. in Speech Prosody. Aix-en-Provence, France. p.399-402.