Evaluating the effort expended to understand speech in noise using a dual-task paradigm: The effects of providing visual speech cues

Journal of Speech, Language, and Hearing Research

Volumn 53, Issue 1, 2010, Pages 18-33

  Fraser, Sarah ^a   Gagné, Jean Pierre ^b   Alepins, Majolaine ^b   Dubois, Pascale ^b  

^a Gina Cody School of Engineering and Computer Science   (Canada)

^b UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

Audio and audiovisual speech cues in noise; Dual task paradigm; Listening effort; Processing capacity; Speech recognition

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; AUDITORY STIMULATION; CLINICAL TRIAL; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; FEMALE; HEARING; HUMAN; MALE; NEUROPSYCHOLOGICAL TEST; NOISE; PATTERN RECOGNITION; QUESTIONNAIRE; RANDOMIZED CONTROLLED TRIAL; REACTION TIME; SPEECH; SPEECH PERCEPTION; STIMULATION; TASK PERFORMANCE; TOUCH; VISION;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; AUDITORY PERCEPTION; FEMALE; HUMANS; MALE; NEUROPSYCHOLOGICAL TESTS; NOISE; PATTERN RECOGNITION, PHYSIOLOGICAL; PHYSICAL STIMULATION; QUESTIONNAIRES; REACTION TIME; SPEECH; SPEECH PERCEPTION; TASK PERFORMANCE AND ANALYSIS; TOUCH PERCEPTION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 77249160250     PISSN: 10924388     EISSN: None     Source Type: Journal    
DOI: 10.1044/1092-4388(2009/08-0140)     Document Type: Article

References (46)

1. Alsius, A., Navarra, J., Campbell, R., & Soto-Faraco, S. (2005). Audiovisual integration of speech falters under high attention demands. Current Biology, 15, 839-843.
2. Alsius, A., Navarra, J., & Soto-Faraco, S. (2007). Attention to touch weakens audiovisual speech integration. Experimental Brain Research, 183, 399-404.
3. American National Standards Institute. (1996). American national standard specification for audiometers (ANSI S3.6-1996). New York: Author.
4. Arnold, P., & Hill, F. (2001). Bisensory augmentation: A speechreading advantage when speech is clearly audible and intact. British Journal of Psychology, 92, 339-355.
5. Binnie, C. A., Montgomery, A. A., & Jackson, P. L. (1974). Auditory and visual contributions to the perception of consonants. Journal of Speech and Hearing Research, 17, 619-630.
6. Bonnel, A. M., & Hafter, E. R. (1998). Divided attention between simultaneous auditory and visual signals. Perception & Psychophysics, 60, 179-190.
7. Broadbent, D. (1958). Perception and communication. New York: Pergamon Press.
8. Calvert, G. A. (2001). Crossmodal processing in the human brain: Insights from functional neuroimaging studies. Cerebral Cortex, 11, 1110-1123.
9. Crandell, C. (1993). Noise effects on the speech recognition of children with minimal hearing loss. Ear and Hearing, 7, 210-217.
10. Downs, D. W. (1982). Effects of hearing aid use on speech discrimination and listening effort. Journal of Speech and Hearing Disorders, 47, 189-193.
11. Driver, J., &Spence, C. (1998). Crossmodal attention. Current Opinion in Neurobiology, 8, 245-253.
12. Erber, N. P. (1969). Interaction of audition and vision in the recognition of oral speech stimuli. Journal of Speech and Hearing Research, 12, 423-425.
13. Erber, N. P. (1972). Auditory, visual and auditory-visual recognition of consonants by children with normal and impaired hearing. Journal of Speech and Hearing Research, 15, 413-422.
14. Erber, N. P. (1979). Auditory-visual perception of speech with reduced optical clarity. Journal of Speech and Hearing Research, 22, 212-223.
15. Feuerstein, J. F. (1992). Monoaural versus binaural hearing: Ease of listening, word recognition, and attentional effort. Ear and Hearing, 13, 80-86.
16. Finitzo-Hieber, T., & Tillman, T. (1978). Room acoustics effects on monosyllabic word discrimination ability for normal and hearing-impaired children. Journal of Speech and Hearing Research, 21, 440-458.
17. Flexer, C., Wray, D., & Ireland, J. (1989). Preferential seating is not enough: Issues in classroom management of hearing-impaired students. Language, Speech, and Hearing Services in Schools, 20, 11-21.
18. Gagné, J.-P. (1994). Visual and audio-visual speechperception training. In J.-P. Gagné & N. Tye-Murray ( Eds.), Research in audiological rehabilitation: Current trends and future directions (pp. 133-159) [Monograph]. Journal of the Academy of Rehabilitative Audiology, 27(Suppl.).
19. Gagné, J.-P., Le Monday, K., Boisclair, A., Gagnon, L., Lapalme, M., & Ducas, L. (2000). Projet d'expérimentation du système MF-visuel: Rapport final [Experimental evaluation of a visual-FM system: Final report]. Drummondville, Québec, Canada: Déposé à l'Office des Personnes Handicapées du Québec.
20. Gallun, F. J., Mason, C. R., & Kidd, G., Jr. (2007). Taskdependent costs in processing two simultaneous auditory stimuli. Perception and Psychophysics, 69, 757-771.
21. Grant, K. W., & Braida, L. D. (1991). Evaluating the articulation index for auditory-visual input. Journal of the Accoustical Society of America, 89, 2952-2960.
22. Grant, K. W., Walden, B. E., & Seitz, P. F. (1998). Auditory-visual speech recognition by hearing-impaired subjects: Consonant recognition, sentence recognition, and auditory-visual integration. Journal of the Accoustical Society of America, 103, 2677-2690.
23. Hicks, C. B., & Tharpe, A. M. (2002). Listening effort and fatigue in school-age children with or without hearing loss. Journal of Speech, Language, and Hearing Research, 45, 573-584.
24. Humes, L. E. (1999). Dimensions of hearing aid outcome. Journal of the American Academy of Audiology, 10, 26-39.
25. Kahneman, D. (1973). Attention and effort. Englewood Cliffs, NJ: Prentice Hall.
26. Killion, M. (1997). SNR loss: I can hear what people say, but I can't understand them. The Hearing Review, 4, 8-12.
27. Lavie, N. (1995). Perceptual load as a necessary condition for selective attention. Journal of Experimental Psychology: Human Perception and Performance, 21, 451-468.
28. Macaluso, E., & Driver, J. (2005). Multisensory spatial interactions: A window onto functional integration in the human brain. Trends in Neuroscience, 28, 284-271.
29. MacLeod, A., & Summerfield, Q. (1987). Quantifying the contribution of vision to speech reception in noise. British Journal of Audiology, 21, 131-141.
30. MacLeod, A., & Summerfield, Q. (1990). A procedure for measuring auditory and audio-visual speech-reception thresholds for sentences in noise: Rationale, evaluation, and recommendations for use. British Journal of Audiology, 24, 24-43.
31. McCoy, S. L., Tun, P. A., Cox, L. C., Colangelo, M., Stewart, R. A., & Wingfield, A. (2005). The Quarterly Journal of Experimental Psychology, 58A, 22-33.
32. Nabalek, A., & Pickett, J. (1974). Reception of consonants in a classroom as affected by monaural and binaural listening, reverberation, and hearing aids. Journal of the Accoustical Society of America, 56, 628-639.
33. Olsen, W. (1977). Acoustics and amplification in classrooms for the hearing-impaired. InF.Bess (Ed.), Childhood deafness: Causation, assessment and management (pp. 251-264). New York: Grune and Stratton.
34. Pashler, H. (1994). Dual-task interference in simple tasks: Data and theory. Psychological Bulletin, 116, 220-244.
35. Rakerd, B., Seitz, P. F., & Whearty, M. (1996). Assessing the cognitive demands of speech listening for people with hearing losses. Ear and Hearing, 17, 97-106.
36. Rigo, T. G. (1986). The relationship between the visual contribution to speech perception and lipreading ability during focused and divided attention. Ear and Hearing, 7, 266-271.
37. Saults, J. S., & Cowan, N. (2007). A central capacity limit to the simultaneous storage of visual and auditory arrays in working memory. Journal of Experimental Psychology: General, 136, 663-684.
38. Schwartz, J.-L., Berthommier, F., & Savariaux, C. (2004). Seeing to hear better: Evidence for early audio-visual interactions in speech identification. Cognition, 93, B69-B98.
39. Seewald, R. C., Ross, M., Giolas, T. G., & Yonovitz, A. (1985). Primary modality for speech perception in children with normal and impaired hearing. Journal of Speech and Hearing Research, 28, 36-46.
40. SPSS 11.5 brief guide. (2002). Upper Saddle River, NJ: Prentice Hall.
41. Strouse Watt, W. (2004). How visual acuity is measured. Retrieved June 16, 2004, from http://www.mdsupport.org/library/acuity.html.
42. Sumby, W. H., & Pollack, I. (1954). Visual contributions to speech intelligibility in noise. Journal of the Accoustical Society of America, 26, 212-215.
43. Suter, A. (1985). Speech recognition in noise by individuals with mild hearing impairments. Journal of the Acoustical Society of America, 68, 887-900.
44. Tyler, R. S., Tye-Murray, N., & Lansing, C. R. (1988). Electrical simulation as an aid to speechreading. The Volta Review, 90, 119-148.
45. Walden, B. E., Prosek, R. A., & Worthington, D. W. (1975). Auditory and audiovisual feature transmission in hearingimpaired adults. Journal of Speech and Hearing Research, 18, 272-280.
46. Yacullo, W. S., & Hawkins, D. B. (1987). Speech recognition in noise and reverberation by school age children. Audiology, 26, 235-246.