A pilot study of temporal organization in Cued Speech production of French syllables: Rules for a Cued Speech synthesizer

Speech Communication

Volumn 44, Issue 1-4 SPEC. ISS., 2004, Pages 197-214

  Attina, Virginie ^a   Beautemps, Denis ^a   Cathiard, Marie Agnés ^a   Odisio, Matthias ^a  

^a GRENOBLE INSTITUTE OF TECHNOLOGY   (France)

Author keywords

Audiovisual synthesis; Coarticulation; Cued Speech; Speech production; Temporal organization

Indexed keywords

AUDIOVISUAL SYNTHESIS; CUED SPEECH; SPEECH PRODUCTION; TEMPORAL ORGANIZATION;

ACOUSTIC WAVES; ACOUSTICS; COMPUTATIONAL METHODS; GESTURE RECOGNITION; SPEECH ANALYSIS;

SPEECH SYNTHESIS;

EID: 10444280864     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2004.10.013     Document Type: Article

References (43)

1. Abry, C., Lallouache, M.-T., Cathiard, M.-A., 1996. How can coarticulation models account for speech sensitivity to audio-visual desynchronization? in: Stork, D., Hennecke, M. Speechreading by Humans and MachinesSpringer-VerlagBerlin247-255.
2. Abry, C., Stefanuto, M., Vilain, A., Laboissière, R., 2002, What can the utterance tan, tan of Broca's patient Leborgne tell us about the hypothesis of an emergent "babble-syllable" downloaded by SMA. In: Durand, J., Laks, B. (Eds.), Phonetics, Phonology and Cognition. Oxford University Press, Oxford, pp. 226-243.
3. Alégria, J., Leybaert, J., Charlier, B., Hage, C., 1992. On the origin of phonological representations in the deaf: Hearing lips and hands. In: Alégria, J., Holender, D., Morais, J.J.D., Radeau, M. (Eds.), Analytic Approaches to Human Cognition. Elsevier Science Publishers, Amsterdam, pp. 107-132.
4. Alégria, J., Charlier, B., Mattys, S., 1999. The role of lipreading and Cued-Speech in the processing of phonological information in French-educated deaf children. European Journal of Cognitive Psychology 11 (4), 451-472.
5. Badin, P., Bailly, G., Reveret, L., Baciu, M., Segerbarth, C., Savariaux, C., 2002. Three dimensional articulatory modelling of tongue, lips and face, based on MRI and video images. Journal of Phonetics 30 (3), 533-553.
6. Bailly, G., Alissali, M., 1992. COMPOST: a server for multilingual text-to-speech system. Traitement du Signal 9 (4), 359-366.
7. Beautemps, D., Badin, P., Bailly, G., 2001. Linear degrees of freedom in speech production: Analysis of cineradio and labio-films data for a reference subject, and articulatory-acoustic modelling. Journal of the Acoustical Society of America 109 (5), 2165-2180.
8. Bernstein, L.E., Demorest, M.E., Tucker, P.E., 2000. Speech perception without hearing. Perception & Psychophysics 62, 233-252.
9. Bratakos, M.S., Duchnowski, P., Braida, L.D., 1998. Toward the automatic generation of Cued Speech, Cued Speech Journal 6, 1-37.
10. Browman, C., Goldstein, L., 1998. On separating "physical" from "linguistic" in speech. Les cahiers de l'ICP 4, 55-57.
11. Cathiard, M.A., Bouaouni, F., Attina, V., Beautemps, D., 2004. Etude perceptive du décours de l'information manuofaciale en Langue Française Parlée Complétée. In: Proc. XXVth Journées d'Etudes sur la Parole, Fès, Maroc, 19-22 April, pp. 113-116.
12. Cathiard, M.A., Attina, V., Abry, C., Beautemps, D. La Langue Française Parlée Complétée (LPC): Sa co-production avec la parole et l'organisation temporelle de sa perception. La Parole, in press.
13. Cornell, R.O., 1988. Cued Speech, manual complement to lipreading, for visual reception of spoken language. Principles, practice and prospects for automation. Acta Oto-Rhino-Laryngologica Belgica 42 (3), 375-384.
14. Cornett, R.O., 1982. Le Cued Speech. In: Destombes, F. (Ed.), Aides manuelles à la lecture labiale el perspeclives d'aides automatiques. Centre scientifique IBM-France, Paris, pp. 5-15.
15. Cornett, R.O., 1967. Cued Speech. American Annals of the Deaf 112, 3-13.
16. Duchnowski, P., Braida, L.D., Bratakos, M.S., Lum, D.S., Sexton, M.G., Krause, J.C., 1998. A speechreading aid based on phonetic ASR. In: Proc. 5th Internat. Conf. on Spoken Language Processing, 30 Nov.-4 Dec., 7, Sydney, pp. 3289-3292.
17. Duchnowski, P., Lum, D.S., Krause, J.C., Sexton, M.G., Bratakos, M.S., Braida, L.D., 2000. Development of speechreading supplements based on automatic speech recognition. IEEE Transactions on Biomedical Engineering 47 (4), 487-496.
18. Elisei, F., Odisio, M., Bailly, G., Badin, P., 2001. Creating and controlling video-realistic talking heads, In: Proc. Audio-Visual Speech Processing, Aalborg, Copenhague, pp. 90-97.
19. Gibert, G., Bailly, G., Eliséi, F., Beautemps, D., Brun, R., 2004. Evaluation of a speech euer: from motion capture to a concatenalive text-to-cued speech system, LREC 2004, Lisboa, Portugal, pp. 2123-2126.
20. Lallouache, M.-T., 1991. Un poste Visage-Parole couleur. Acquisition et traitement automatique des contours des lèvres. Ph.D. Thesis, Institut National Polytechnique de Grenoble, Grenoble.
21. Leybaert, J., 1996. La lecture chez l'enfant sourd: l'apport du Langage Parlé Complété. Revue Française de Linguistique Appliquée 1, 81-94.
22. Leybaert, J., 2000, Phonology acquired through the eyes and spelling in deaf children. Journal of Experimental Child Psychology 75, 291-318.
23. Leybaert, J., Lechat, J., 2001. Phonological similarity effects in memory for serial order of Cued Speech. Journal of Speech, Language and Hearing Research 44, 949-963.
24. Leybaert, J., Alegria, J., Hage, C., Charleir, B., 1998. The effect of exposure to phonetically augmented lipspeech in the prelingual deaf. In: Campbell, R., Dodd, B., Burnham, D. (Eds.), Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory-Visual Speech. Psychology Press, Hove, UK, pp. 283-301.
25. Luettin, J., Dupont, S., 1998. Continuous audio-visual speech recognition. In: Proc. 5th European Conf. on Computer Vision, pp. 657-673.
26. MacNeilage, P., 1998, The frame/content theory of evolution of speech production. Behavioral and Brain Sciences 21 (4), 499-548.
27. Massaro, D.W., 1998. Perceiving Talking Faces: From Speech Perception to a Behavioural Principle. MIT Press, Cambridge, MA.
28. Morlec, Y., Bailly, O., Aubergé, V., 2001. Generating prosodic attitudes in French: data, model and evaluation. Speech Communication 33 (4), 357-371.
29. Moulines, E., Charpentier, F., 1990. Pitch synchronous wave-form processing techniques for a text-to-speech synthesis using diphones. Speech Communication 9 (5,6), 453-467.
30. Nicholls, G., Ling, D., 1982. Cued Speech and the reception of spoken language. Journal of Speech and Hearing Research 25, 262-269.
31. Öhman, S.E.G., 1967. Numerical model of coarticulation. Journal of the Acoustical Society of America 41 (2), 310-320.
32. Owens, E., Blazek, B., 1985. Visemes observed by hearing-impaired and normal-hearing adult viewers. Journal of Speech and Hearing Research 28, 381-393.
33. Perkell, J.S., 1990. Testing theories of speech production: Implications of some detailed analyses of variable articulatory data. In: Hardcastle, W.J., Marchai, A. (Eds.), Speech Production and Speech Modelling. Kluwer Academic Publishers, London, pp. 263-288.
34. Perkell, IS., Matthies, M.L., 1992. Temporal measures of anticipatory labial coarticulation for the vowel /u/: Within-and cross-subject variability. Journal of the Acoustical Society of America 91, 2911-2925.
35. Reisberg, D., McLean, J., Goldfield, A., 1987. Easy to hear but hard to understand: a lipreading advantage with intact auditory stimuli. In: Dodd, B., Campbell, R. (Eds.), Hearing by Eye: The Psychology of Lipreading. Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 97-113.
36. Sato, M., Schwartz, J.-L., Cathiard, M.-A., Abry, C., Loevenbruck, H., 2002. Intrasyllabic articulatory control constraints in verbal working memory, In: Proc. VIIth Internat. Congress of Speech and Language Processes, Denver, CO, September 16-20, pp. 669-672.
37. Schmidt, R.A., 1988. Motor Control and Learning: A Behavioral Emphasis. Human Kinetics Publishers, Champaign, IL.
38. Schwartz, J.-L., Robert-Ribès, J., Escudier, P., 1998. Ten years after Summer-field: A taxonomy of models for audio-visual fusion in speech perception. In: Campbell, R., Dodd, B., Burnham, D. (Eds.), Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory-Visual Speech. Psychology Press, Hove, UK, pp. 85-108.
39. Schwartz, J.L., Teissier, P., Escudier, P., 2002. La parole multimodale: deux ou trois sens valent mieux qu'un. In: Mariani, J.J. (Ed.), Traitement automatique du langage parlé - 2: reconnaissance de la parole. Hermes, Paris, pp. 141-178.
40. Summerfield, A.Q., 1987. Some preliminaries to a comprehensive account of audio-visual speech perception. In: Dodd, R., Campbell, R. (Eds.), Hearing by Eye: The Psychology of Lipreading. Lawrence Erlbaum Associates Ltd., Hove, UK, pp. 3-51.
41. Uchanski, R., Delhorne, L., Dix, A., Braida, L., Reed, C., Durlach, N., 1994. Automatic speech recognition to aid the hearing impaired: Prospects for the automatic generation of Cued Speech. Journal of Rehabilitation Research and Development 31, 20-41.
42. Vilain, A., Abry, C., Badin, P., 2000. Coproduction strategies in French VCVs: Confronting öhman's model with adult and developmental articulatory data. In: Proc. 5th Seminar on Speech Production, Models and Data, Kloster Seon, Bavaria, May 1-4, pp. 81-84.
43. Woodward, M.F., Barber, C.G., 1960. Phoneme perception in lipreading. Journal of Speech and Hearing Research 3 (3), 212-222.