The effects of temporal asynchrony on the intelligibility of accelerated speech

International Conference on Auditory-Visual Speech Processing 2008, AVSP 2008

Volumn , Issue , 2008, Pages 19-24

  Brungart, Douglas S ^a   Iyer, Nandini ^b   Simpson, Brian D ^a   van Wassenhove, Virginie ^c  

^a AIR FORCE RESEARCH LABORATORY   (United States)

^b GENERAL DYNAMICS   (United States)

^c CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

AV synchrony; Time compressed speech

Indexed keywords

ASYNCHRONY; AUDIO SIGNAL; AUDIO-VISUAL INTEGRATION; AUDIOVISUAL SYNCHRONY; DELAY VALUES; SPEAKING RATE; SPEECH STIMULI; TIME COMPRESSED SPEECH; VISUAL SIGNALS; VISUAL STIMULUS;

SPEECH INTELLIGIBILITY;

EID: 85118683118     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. W.H. Sumby and I. Pollack, “Visual contribution to speech intelligibility in noise,” Journal of the Acoustical Society of America, vol. 26, pp. 212–215, 1954.
2. V. van Wassenhove, K.W. Grant, and D. Poeppel, “Temporal window of integration in auditory-visual speech perception,” Neuropsychologia, vol. 45, pp. 598–607, 2007.
3. D.W. Massaro, M.M Cohen, and P.M. Smeele, “Perception of asynchronous and conflicting visual and auditory speech,” Journal of the Acoustical Society of America, vol. 100, pp. 1777–1786, 1996.
4. K.G. Munhall, P. Gribble, L. Sacco, and M. Ward, “Temporal constraints on the mcgurk effect,” Perception and Psychophysics, vol. 58, pp. 351–362, 1996.
5. B. Conrey and D.B. Pisoni, “Auditory-visual speech perception and synchrony detection for speech and nonspeech signals,” J. Acoust. Soc. Am., vol. 119, pp. 4065–4073, 2006.
6. J. Lewald and R. Guski, “Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli,” Congnitive Brain Research, vol. 16, pp. 468–478, 2003.
7. T. Arai and S. Greenberg, “The temporal properties of spoken japanese are similar to those of english,” Proceedings of Eurospeech 97, Rhodes, Greece, pp. 473–476, 1997.
8. S. Greenberg, Listening to Speech: An Auditory Perspective, chapter A multi-tier framework for understanding spoken language, pp. 412–415, Lawrence Earlbaum, 2006.
9. K.W. Grant and S. Greenberg, “Speech intelligibility derived from asynchronous processing of auditory-visual information,” in Proceedings Auditory-Visual Speech Processing (AVSP 2001), Scheelsminde, Denmark, September 7-9, 2001., 2001.
10. N. J. Versfeld and W. A. Dreschler, “The relationship between the intelligibility of time-compressed speech and speech in noise in young and elderly listeners,” Journal of the Acoustical Society of America, vol. 111, pp. 401–408, 2001.
11. K.P. Green and J.L. Miller, “On the role of visual rate information in phonetic perception,” Percept. Psychophys., vol. 38, pp. 269–279, 1985.
12. Q. Summerfield, “Some preliminaries to a comprehensive account of audio-visual speech perception,” in Hearing by Eye: The Psychology of Lipreading, B. Dodd and R. Campbell, Eds., pp. 3–51. Lawrence Erlbaum Associates, New York, NY, 1987.
13. L. Brancazio and J.L. Miller, “Use of visual information in speech perception: evidence for a visual rate effect both with and without a mcgurk effect,” Perception & Psychophysics, vol. 67, pp. 759–769, 2005.
14. H. McGurk and J. McDonald, “Hearing lips and seeing voices,” Nature, vol. 264, pp. 746–748, 1976.
15. C. Colin, M. Radeau, and P. Deltenre, “Intermodal interactions in speech: a french study,” in Proceedings Auditory-Visual Speech Processing (AVSP 2001), Scheelsminde, Denmark, September 7-9, 2001, 2001.
16. D.S. Brungart, V. van Wassenhove, E. Brandewie, and G. Romigh, “The effects of temporal acceleration and deceleration on av speech perception,” in Auditory-Visual Speech Processing (AVSP 2007), Kasteel Groenendaal, Hilvarenbeek, The Netherlands, 2007, 2007, p. 27.
17. H. Luo and D. Poeppel, “Phase patterns of neuronal responses reliably discriminate speech in human auditory cortex,” Neuron, pp. 1001–1010, 2007.
18. A.L. Giraud, A. Kleinschmidt, D. Poeppel, T.E. Lund, R.S.J. Frackowiak, and H. Laufs, “Endogenous cortical rhythms determine cerebral specialization for speech perception and production,” Neuron, pp. 1127–1134, 2007.
19. K. Munhall and E. Vatikiotis-Bateson, Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory-Visual Speech, chapter The moving face during speech communication, pp. 123–139, Psychology Press, 1998.
20. M. Halle and K. Stevens, “Speech recognition: A model and a program for research,” IEEE Transactions on Information Theory, vol. 8, pp. 155–159, 1962.
21. Kenneth N. Stevens, “Toward a model for lexical access based on acoustic landmarks and distinctive features,” The Journal of the Acoustical Society of America, vol. 111, no. 4, pp. 1872–1891, 2002.
22. J.S. Perkell, “Sensory goals and control mechanims for phonemic articulations,” in International Congress of Phonetic Sciences (ICPhS XVI), Saarbrcken, Germany, 2007, 2007, pp. 169–174.
23. V. van Wassenhove, “Analysis-by-synthesis in auditory-visual speech perception: multisensory-motor interfacing,” in International Congress of Phonetic Sciences (ICPhS XVI), Saarbrcken, Germany, 2007, 2007, pp. 175–180.
24. V. van Wassenhove, K.W. Grant, and D. Poeppel, “Visual speech speeds up the neural processing of auditory speech,” Proceedings of the National Academy of Sciences, 102, p. 1181, 2005.
25. J.I. Skipper, V. van Wassenhove, H.C. Nusbaum, and S.L. Small, “Hearing lips and seeing voices: How cortical areas supporting speech production mediate audiovisual speech perception,” Cerebral Cortex, 2007.
26. D. Poeppel, W.J. Idsardi, and V. van Wassenhove, “Speech perception at the interface of neurobiology and linguistics,” Philos Trans R Soc Lond B Biol Sci, 2007.
27. M.-A. Cathiard and C. Abry, “Speech structure decisions from speech motion coordinations,” in International Congress of Phonetic Sciences (ICPhS XVI), Saarbrcken, Germany, 2007, 2007, pp. 291–296.
28. K.W. Grant and P.F. Seitz, “The use of visible speech for improving auditory detection of spoken sentences,” Journal of the Acoustical Society of America, vol. 108, pp. 1197–1208, 2000.
29. A.S. House, C.E. Williams, M.H.L. Hecker, and K.D. Kryter, “Articulation testing methods: Consonantal differentiation with a closed response set,” Journal of the Acoustical Society of America, vol. 37, pp. 158–166, 1965.
30. P Boersma and D Weenink, “Praat, a system for doing phonetics by computer, version 3.4,” Institute of Phonetic Sciences, University of Amsterdam, vol. 134, pp. 1–182, 1996.
31. C.E. Schroeder, C.E. and J.J Foxe, “The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex,” Cognitive Brain Research, vol. 14, pp. 195–207, 2002.
32. J.L. Miller, K.P. Green, and A. Reeves, “Speaking rate and segments: A look at the relation between speech production and speech perception for the voicing contrast,” Phonetica, pp. 106–115, 1986.
33. Z.M. Smith, B. Delgutte, and A. Oxenham, “Chimaeric sounds reveal dichotomies in auditory perception,” Nature, vol. 416, pp. 87–90, 2002.