Speech face perception is locked to anticipation in speech production

Speech Communication

Volumn 52, Issue 6, 2010, Pages 513-524

  Troille, Emilie ^a,b   Cathiard, Marie Agnès ^a   Abry, Christian ^a  

^a UNIV GRENOBLE ALPES   (France)

^b CNRS   (France)

Author keywords

Anticipation; Auditory visual speech perception; Speech production

Indexed keywords

ANTICIPATORY CONTROL; AUDIO-VISUAL; AUDITORY-VISUAL; CO-ARTICULATION; DESYNCHRONIZATION; HENNECKE; LANGUAGE STUDY; SPEECH IDENTIFICATION; SPEECH PRODUCTION; SPEECHREADING; VISUAL PERCEPTION; VISUAL SPEECH;

LINGUISTICS;

EID: 77951116872     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2009.12.005     Document Type: Article

References (32)

1. Abry C., Boë L.-J., and Schwartz J.-L. Plateaus, catastrophes and the structuring of vowel systems. J. Phonetics 17 (1989) 47-54
2. Abry C., and Lallouache T. Le MEM: Un modèle d'anticipation paramétrable par locuteur. Données sur l'arrondissement en français. Bulletin de la Communication Parlée 3 (1995) 85-99
3. Abry, C., Lallouache, T.M., 1995b. Modeling lip constriction anticipatory behaviour for rounding in French with the MEM. In: Proc. ICPHS, 4, Stockholm, Suède, pp. 152-155.
4. Abry C., Lallouache M.-T., and Cathiard M.-A. How can coarticulation models account for speech sensitivity to audio-visual desynchronization?. In: Stork D., and Hennecke M. (Eds). Speechreading by Humans and Machines, NATO ASI Series F: Computer and Systems Sciences Vol. 150 (1996), Springer-Verlag, Berlin, Heidelberg, New York, London, Paris, Tokyo 247-255
5. Benoît C. Note on the use of correlations in speech timing. J. Acoust. Soc. Amer. 80 6 (1986) 1846-1849
6. Benoit, C., Abry, C., 1986. Vowel-consonant timing across speakers. In: Proc. 12th Internat. Congress of Acoustics, Toronto, Paper A6-1.
7. Byrd D., and Saltzman E. The elastic phrase: modeling the dynamics of boundary-adjacent lengthening. J. Phonetics 31 (2003) 149-180
8. Cathiard M.-A. La perception visuelle de l'anticipation des gestes vocaliques: cohérence des évènements audibles et visibles dans le flux de la parole (1994), Thèse de Psychologie Cognitive, Grenoble
9. Cathiard, M.-A., Abry, C., 2007. Speech structure decisions from speech motion coordinations. Special Session on Audiovisual Speech: Analysis, Synthesis, Perception and Recognition of the XVIth Internat. Congress of Phonetic Sciences, 6-10 août 2007, Saarbrücken, Allemagne, pp. 291-296.
10. Cathiard M.-A., Lallouache M.-T., and Abry C. Does movement on the lips mean movement in the mind?. In: Stork D., and Hennecke M. (Eds). Speechreading by Humans and Machines, NATO ASI Series F: Computer and Systems Sciences Vol. 150 (1996), Springer-Verlag, Berlin, Heidelberg, New York, London, Paris, Tokyo 211-219
11. Cathiard, M.-A., Tiberghien, G., Tseva, A., Lallouache, M.-T., Escudier, P., 1991. Visual perception of anticipatory rounding during acoustic pauses: a cross-language study. In: Proc. XIIth Internat. Congress of Phonetic Sciences, 19-24 Août 1991, Aix-en-Provence, France, 4, pp. 50-53.
12. Escudier, P., Benoît, C., Lallouache, M.-T., 1990. Identification visuelle de stimuli associés à l'opposition /i/-/y/: étude statique. Colloque de physique, supplément au n° 2, tome 51, 1er Congrès Français d'Acoustique, C2-541-544.
13. Evans N., and Levinson S. The myth of language universals: language diversity and its importance for cognitive science. Behav. Brain Res. 32 5 (2009) 429-492
14. Farnetani E. Labial coarticulation. In: Hardcastle W.J., and Hewlett N. (Eds). Coarticulation Theory, Data and Techniques (1999), Cambridge University Press 144-163
15. Finney, D.-J., 1971. Probit Analysis, third ed. Cambridge University Press.
16. Gaitenby J. The Elastic Word, Status Report on Speech Research SR-2 (1965), Haskins Laboratories, New Haven, CT pp. 1-12
17. Ghazanfar A.A., Maier J.X., Hoffman K.L., and Logothetis N.K. Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J. Neurosci. 25 20 (2005) 5004-5012
18. Grosjean F. Spoken word recognition processes and the gating paradigm. Percept. Psychophys. 28 (1980) 267-283
19. Grosjean F. Gating. In: Grosjean F., and Frauenfelder U.H. (Eds). A Guide to Spoken Word Recognition Paradigms (1997), Psychology Press, Hove, England 597-604
20. Lallouache, M.-T., 1991. Un poste «Visage-parole » couleur. Acquisition et traitement automatique des contours des lèvres. Thèse. ENSERG, Grenoble.
21. Munson B. Variability in /s/ production in children and adults: evidence from dynamic measures of spectral mean. J. Speech Lang. Hear. Res. 47 1 (2004) 58-69
22. Nittrouer S.K.G., Munhall J.A.S., Tuller B., and Harris K.S. Patterns of interarticulatot phasing and their relation to linguistic structure. J. Acoust. Soc. Amer. 84 (1988) 1653-1661
23. Noiray, A., Ménard, L., Cathiard, M.-A., Abry, C., Aubin, J., Savariaux, C., 2006. Extending the movement expansion model (MEM) for rounding from French to English. In: Proc. 7th Internat. Seminar on Speech Production, Ubatuba, pp. 319-326.
24. Noiray A., Ménard L., Cathiard M.-A., Abry C., and Savariaux C. Emergence of a vocalic gesture control: the tuning of the anticipatory rounding temporal pattern for French children. In: Kern S., Gayraud F., and Marsico E. (Eds). Emergence of Linguistic Abilities (2008), Cambridge Scholars Publishing, New Castle 100-116
25. Schwartz J.-L., Beautemps D., Abry C., and Escudier P. Inter-individual and cross-linguistic strategies for the production of the [i] vs [y] contrast. J. Phonetics 21 (1993) 411-425
26. Shadle C.H. Articulatory-Acoustic Relationships in Fricative Consonants. Speech Production and Speech Modelling. In: Hardcastle W.J., and Marchal A. (Eds) (1990), Kluwer Academic Press 187-209
27. Smeele, P.M.T., 1994. Perceiving Speech: Integrating Auditory and Visual Speech. Doct. Dissertation, Techn. Univ Delft, Delft.
28. Smeele, P.M.T., Sittig, A.C., Van Heuven, V.J., 1994. Temporal organization of bimodal speech information. In: Proc. Internat. Conf. on Spoken Language Processing, Vol. 3, pp. 1431-1434.
29. Summerfield Q. Some preliminaries to a comprehensive account of audio-visual speech perception. In: Dodd B., and Campbell R. (Eds). Hearing by Eye: The Psychology of Lipreading (1987), Lawrence Erlbaum Associates, London 3-51
30. Troille, E., Cathiard, M.-A., Abry, C., 2007. Consequences on bimodal perception of the timing of the consonant and vowel audiovisual flows. In: Proc. Internat. Conf. on Audio-Visual Speech Processing, 31 August-3 September, Hilvarenbeek, Pays-Bas, pp. 281-286.
31. Tuller B., and Kelso J.A.S. The timing of articulatory gestures: evidence for relational invariants. J. Acoust. Soc. Amer. 76 (1984) 1030-1036
32. Whalen D.H. Subcategorical phonetic mismatches slow phonetic judgements. Percept. Psychophys. 35 1 (1984) 49-64