Audiovisual cues and perceptual learning of spectrally distorted speech

Language and Speech

Volumn 54, Issue 4, 2011, Pages 487-497

  Pilling, Michael ^a,b   Thomas, Sharon ^a,b  

^a MRC INSTITUTE OF HEARING RESEARCH   (United Kingdom)

^b OXFORD BROOKES UNIVERSITY   (United Kingdom)

Author keywords

audiovisual; perceptual learning; speech

Indexed keywords

EID: 82355184690     PISSN: 00238309     EISSN: None     Source Type: Journal    
DOI: 10.1177/0023830911404958     Document Type: Article

References (40)

1. Bench J.,Kowal A.,Bamford J.The BKB (Bamford-Kowal-Bench) sentence lists for partially-hearing children.British Journal of Audiology. 1979;13:108-112.
2. Bergeson T. R.,Pisoni D. B.,Davis R. A. O.Development of audiovisual comprehension skills in prelingually deaf children with cochlear implants.Ear & Hearing. 2005;26:149-164.
3. Daly N.,Bench J.,Chappell H.Gender differences in speechreadability.Journal of the Academy of Rehabilitative Audiology. 1996;29:27-40.
4. Davis C.,Kim J.Audio-visual interactions with intact clearly audible speech.Quarterly Journal of Experimental Psychology A. 2004;57:1103-1121.
5. Davis M. H.,Johnsrude I. S.,Hervais-Adleman A.,Taylor K.,McGettigan C.Lexical information drives perceptual learning of distorted speech: Evidence from comprehension of noise-vocoded sentences.Journal of Experimental Psychology: General. 2005;34:222-241.
6. Demorest M. E.,Bernstein L. E.Sources of variability in speechreading sentences: A generalizability analysis.Journal of Speech & Hearing Research. 1992;35:876-891.
7. Dohen M.,Lœvenbruck H.,Cathiard M. A.,Schwartz J. L.Visual perception of contrastive focus in reiterant French speech.Speech Communication. 2004;44:155-172.
8. Dorman M. F.,Loizu P. C.,Rainey D.Simulating the effect of cochlear-implant electrode insertion depth on speech understanding.Journal of the Acoustical Society of America. 1997;102:2993-2996.
9. Dorman M. F.,Loizu P. C.,Fitzke J.,Tu Z.The recognition of sentences in noise by normal-hearing listeners using simulations of cochlear-implant signal processors with 6-20 channels.Journal of the Acoustical Society of America. 1998;104:3583-3585.
10. Erber N. P.Auditory-visual perception of speech.Journal of Speech and Hearing Disorders. 1975;40:481-492.
11. Fu Q. J.,Galvin J. J.The effects of short-term training for spectrally mismatched noise-band speech.Journal of the Acoustical Society of America. 2003;113:1065-1072.
12. Fu Q. J.,Nogaki G.,Galvin J. J.Auditory training with spectrally shifted speech: Implications for cochlear implant patient auditory rehabilitation.Journal of the Association for Research in Otolaryngology. 2006;6:180-189.
13. Gagné J. P.,Masterson V. M.,Munhall K. G.,Bilida N.,Querengesser C.Across talker variability in auditory, visual, and audiovisual speech intelligibility for conversational and clear speech.Journal of the Academy of Rehabilitative Audiology. 1994;27:135-158.
14. Grant K. W.,Walden B. E.,Seitz P. F.Auditory-visual speech recognition by hearing-impaired subjects: Consonant recognition, sentence recognition, and auditory-visual integration.Journal of the Acoustical Society of America. 1998;103:2677-2690.
15. Green K. P.Hearing by eye II: Advances in the psychology of speechreading and auditory-visual speech. Campbell R.Dodd B.Burnham D., ed. Hove: Psychology Press; 1997:3-25.
16. Hardison D.Acquisition of second-language speech: Effects of visual cues, context and talker variability.Applied Psycholinguist. 2003;24:495-522.
17. Hazan V.,Sennema A.,Iba M.,Faulkner A.Effect of audiovisual perceptual training on the perception and production of consonants by Japanese learners of English.Speech Communication. 2005;47:360-378.
18. Hazen T. J.Visual model structures and synchrony constraints for audio-visual speech recognition.IEEE Transactions on Audio, Speech, and Language Processing. 2006;14:1082-1089.
19. Helfer K. S.,Freyman R. L.The role of visual speech cues in reducing energetic and informational masking.Journal of the Acoustical Society of America. 2005;117:842-849.
20. Hervais-Adelman A.,Davis M. H.,Johnsrude I. S.,Carlyon R. P.Perceptual learning of noise-vocoded words: Effects of feedback and lexicality.Journal of Experimental Psychology: Human Perception & Performance. 2008;34:460-474.
21. James D.,Brinton J.,Rajput K.,Goswami U.Phonological awareness, vocabulary, and word reading in children who use cochlear implants: Does age of implantation explain individual variability in performance outcomes and growth?.Journal of Deaf Studies and Deaf Education. 2008;13:117-137.
22. Kricos P. B.,Lesner S. A.Differences in visual intelligibility across talkers.The Volta Review. 1982;84:219-225.
23. Lesner S. A.The talker.The Volta Review. 1988;90:89-98.
24. MacLeod A.,Summerfield Q.Quantifying the contribution of vision to speech perception in noise.British Journal of Audiology. 1987;12:131-141.
25. MazzoniD.BrubeckM.CrookJ.JohnsonV.MeyerM. (2006). Audacity: A free digital audio editor. http://audacity.sourceforge.net.
26. McGurk H.,MacDonald J.Hearing lips and seeing voices.Nature. 1976;264:746-748.
27. Munhall K. G.,Gribble P.,Sacco L.,Ward M.Temporal constraints on the McGurk effect.Perception and Psychophysics. 1996;58:351-362.
28. Munhall K. G.,Jones J. A.,Callan D. E.,Kuratate T.,Vatikiotis-Bateson E.Visual prosody and speech intelligibility.Psychological Science. 2004;15:133-137.
29. Rosen S.,Faulkner A.,Wilkinson L.Perceptual adaptation by normal listeners to upwards shifts of spectral information in speech and its relevance for users of cochlear implants.Journal of the Acoustical Society of America. 1999;106:3629-3636.
30. Rota G.,Turicchia L.,Veit R.,Guazzelli M.,Birbaumer N.,Dogilf G.Perceptual learning of speech processed by a Cochlear Implant simulator: An fMRI investigation.International Journal of Psychophysiology. 2008;69:225-226.
31. Saldaña H. M.,Pisoni D. B.,Fellowes J. M.,Remez R. E.Audio-visual speech perception without speech cues. Proceedings of the 4th International Conference on Spoken Language Processing; 1996Philadelphia, PA; 1996. 2187.
32. Schwartz J. L.,Berthommier F.,Savariaux C.Seeing to hear better: Evidence for early audio-visual interactions in speech identification.Cognition. 2004;93:B69-B78.
33. Shannon R. V.,Zeng F. G.,Kamath V.,Wygonski J.,Ekelid M.Speech recognition with primarily temporal cues.Science. 1995;270:303-304.
34. Shannon R. V.,Zeng F. G.,Wygonski J.Speech recognition with altered spectral distribution of envelope cues.Journal of the Acoustical Society of America. 1998;104:2467-2476.
35. Soto-Faraco S.,Navarra J.,Alsius A.Assessing automaticity in audiovisual speech integration: Evidence from the speeded classification task.Cognition. 2004;92:B13-B23.
36. Stacey P.,Summerfield Q.Effectiveness of computer-based auditory training in improving the perception of noise-vocoded speech.Journal of the Acoustical Society of America. 2007;121:2923-2935.
37. Stacey P.,Summerfield Q.Comparison of word-, sentence-, and phoneme-based training strategies in improving the perception of spectrally distorted speech.Journal of Speech, Language & Hearing Research. 2008;51:526-538.
38. Summerfield Q.Hearing by eye: The psychology of lip-reading. Dodd B.Campbell R., ed. London: Lawrence Erlbaum; 1987:3-51.
39. Teinonen T.,Aslin R. N.,Alku P.,Csibra G.Visual speech contributes to phonetic learning in 6-month-old infants.Cognition. 2008;3:850-855.
40. van Wassenhove V.,Grant K. W.,Poeppel D.Visual speech speeds up the neural processing of auditory speech.Proceedings of the National Academy of Science. 2005;102:1181-1186.