Integration efficiency for speech perception within and across sensory modalities by normal-hearing and hearing-impaired individuals

Journal of the Acoustical Society of America

Volumn 121, Issue 2, 2007, Pages 1164-1176

  Grant, Ken W ^a,d   Tufts, Jennifer B ^b   Greenberg, Steven ^c  

^a WALTER REED ARMY MEDICAL CENTER   (United States)

^b UNIVERSITY OF CONNECTICUT   (United States)

^c Silicon Speech   (United States)

^d NONE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTICS; INFORMATION RETRIEVAL; SENSORY PERCEPTION; SPEECH ANALYSIS; SPEECH COMMUNICATION; SPEECH SYNTHESIS; VISUALIZATION;

FREQUENCY INTEGRATION; HEARING IMPAIRED LISTENERS; OPTIC SPEECH SIGNALS; SPEECH PERCEPTION;

HANDICAPPED PERSONS;

ACOUSTICS; ADULT; AGED; ARTICLE; CONSONANT; CONTROLLED STUDY; FREQUENCY MODULATION; HEARING; HEARING IMPAIRMENT; HUMAN; PRIORITY JOURNAL; SENSORY SYSTEM; SPEECH; SPEECH PERCEPTION; VISION; VOWEL;

ADULT; AGED; ATTENTION; AUDITORY THRESHOLD; CUES; FEMALE; HUMANS; LIPREADING; MALE; MIDDLE AGED; PHONETICS; PRESBYCUSIS; REFERENCE VALUES; SOUND SPECTROGRAPHY; SPEECH ACOUSTICS; SPEECH PERCEPTION;

EID: 33846677360     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.2405859     Document Type: Article

References (48)

1. American National Standards Institute (1989). Specifications for audiometers (ANSI S3.6-1989). (ANSI, New York).
2. Blamey, P. J., Cowan, R. S. C., Alcantara, J. I., Whitford, L. A., and Clark, G. M. (1989). " Speech perception using combinations of auditory, visual, and tactile information., " J. Rehabil. Res. Dev. 26, 15-24.
3. Borg, I., and Lingoes, J. (1987). Multidimensional Similarity Structure Analysis (Springer-Verlag, New York).
4. Braida, L. D. (1991). " Crossmodal integration in the identification of consonant segments., " Q. J. Exp. Psychol. 43, 647-677.
5. Ching, T., Dillon, H., and Byrne, D. (1998). " Speech recognition of hearing-impaired listeners: Predictions from audibility and the limited role of high-frequency amplification., " J. Acoust. Soc. Am. 103, 1128-1140.
6. Christiansen, T. U., Dau, T., and Greenberg, S. (in press). " Spectro-temporal processing of speech-An information-theoretic framework., " 14th International Symposium on Hearing.
7. Christiansen, T. U., and Greenberg, S. (2005). " Frequency selective filtering of the modulation spectrum and its impact on consonant identification., " 21st Danavox Symposium: Hearing Aid Fitting, 21, 585-599.
8. Cienkowski, K. M., and Carney, A. E. (2002). " Auditory-visual speech perception and aging., " Ear Hear. 23, 439-449.
9. Cienkowski, K. M., and Carney, A. E. (2004). " The integration of auditory-visual information for speech in older adults., " J. Speech Lang. Path. Aud. 28, 166-172.
10. Doherty, K. A., and Turner, C. W. (1996). " Use of a correlational method to estimate a listener's weighting function for speech., " J. Acoust. Soc. Am. 100, 3769-3773.
11. Erber, N. P. (2002). " Hearing, vision, communication, and older people., " Seminars in Hearing 23, 35-42.
12. Friesen, L. M., Shannon, R. V., Baskent, D., and Wang, X. (2001). " Speech recognition in noise as a function of the number of spectral channels: Comparison of acoustic hearing and cochlear implants., " J. Acoust. Soc. Am. 110, 1150-1163.
13. Gagné, J. P. (1988). " Excess masking among listeners with a sensorineural hearing loss., " J. Acoust. Soc. Am. 83, 2311-2321.
14. Gordon-Salant, S., and Fitzgibbons, P. J. (1999). " Profile of auditory temporal processing in older listeners., " J. Speech Lang. Hear. Res. 42, 300-311.
15. Grant, K. W. (2002). " Measures of auditory-visual integration for speech understanding: A theoretical perspective (L)., " J. Acoust. Soc. Am. 112, 30-33.
16. Grant, K. W., and Seitz, P. F. (1998). " Measures of auditory-visual integration in nonsense syllables and sentences., " J. Acoust. Soc. Am. 104, 2438-2450.
17. Grant, K. W., and Walden, B. E. (1996). " Evaluating the articulation index for auditory-visual consonant recognition., " J. Acoust. Soc. Am. 100, 2415-2424.
18. Grant, K. W., Walden, B. E., and Seitz, P. F. (1998). " Auditory-visual speech recognition by hearing-impaired subjects: Consonant recognition, sentence recognition, and auditory-visual integration., " J. Acoust. Soc. Am. 103, 2677-2690.
19. Green, D. M., and Swets, J. A. (1966). Signal Detection Theory and Psychophysics (Wiley, New York).
20. Greenberg, S., and Arai, T. (2004). " What are the essential cues for understanding spoken language? " IEICE Trans. Inf. Syst. 87D, 1059-1070.
21. Greenberg, S., Arai, T., and Silipo, R. (1998). " Speech intelligibility from exceedingly sparse spectral information., " Proc. Int. Conf. Spoken Lang. Processing, Sydney, Australia, 74-77.
22. Healy, E. W., and Bacon, S. P. (2002). " Across-frequency comparison of temporal speech information by listeners with normal and impaired hearing., " J. Speech Lang. Hear. Res. 45, 1262-1275.
23. Healy, E. W., Kannabiran, A., and Bacon, S. P. (2002). " An across-frequency processing deficit in listeners with hearing impairment is supported by acoustic correlation., " J. Speech Lang. Hear. Res. 48, 1236-1242.
24. Hill, F. J., McRae, L. P., and McClellan, R. P. (1968). " Speech recognition as a function of channel capacity in a discrete set of channels., " J. Acoust. Soc. Am. 44, 13-18.
25. Hogan, C. A., and Turner, C. W. (1998). " High-frequency audibility: Benefits for hearing-impaired listeners., " J. Acoust. Soc. Am. 104, 432-441.
26. Hornsby, B. W. Y., and Ricketts, T. (2003). " The effects of hearing loss on the contribution of high- and low-frequency speech information to speech understanding., " J. Acoust. Soc. Am. 113, 1706-1717.
27. Hornsby, B. W. Y., and Ricketts, T. (2006). " The effects of hearing loss on the contribution of high- and low-frequency speech information to speech understanding. II. Sloping hearing loss., " J. Acoust. Soc. Am. 119, 1752-1762.
28. Kruskal, J. B., and Wish, M. (1978). Multidimensional Scaling (Sage, Beverly Hills, CA).
29. Macmillan, N. A., Goldberg, R. F., and Braida, L. D. (1988). " Vowel and consonant resolution: Basic sensitivity and context memory., " J. Acoust. Soc. Am. 84, 1262-1280.
30. Massaro, D. W. (1987). Speech Perception by Ear and Eye: A Paradigm for Psychological Inquiry (Lawrence Erlbaum Hillsdale, NJ).
31. Massaro, D. W. (1998). Perceiving Talking Faces: From Speech Perception to a Behavioral Principle (MIT Press, Cambridge, MA).
32. Massaro, D. W., and Cohen, M. M. (2000). " Tests of auditory-visual integration efficiency within the framework of the fuzzy logical model of perception., " J. Acoust. Soc. Am. 108, 784-789.
33. Miller, G. A., and Nicely, P. E. (1955). " An analysis of perceptual confusions among some English consonants., " J. Acoust. Soc. Am. 27, 338-352.
34. Moore, B. C. J. (2004). " Dead regions in the cochlea: Conceptual foundations, diagnosis, and clinical applications., " Ear Hear. 25, 98-116.
35. Müsch, H., and Buus, S. (2001). " Using statistical decision theory to predict speech intelligibility. II. Measurement and prediction of consonant-discrimination performance., " J. Acoust. Soc. Am. 109, 2910-2920.
36. Pickett, J. M. (1999). The Acoustics of Speech Communication (Allyn and Bacon, Boston, MA).
37. Ross, L. A., Saint-Amour, D., Leavitt, V. M., Javitt, D. C., and Foxe, J. J. (2006). " Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments., " Cerebral Cortex Advance Access, published June 19, 2006 at http://cercor.oxfordjournals.org/cgi/reprint/ bhl024v1
38. Shannon, R. V., Zeng, F. G., Kamath, V., Wygonski, J., and Ekelid, M. (1995). " Speech recognition with primarily temporal cues., " Science 270, 303-304.
39. Silipo, R., Greenberg, S., and Arai, T. (1999). " Temporal constraints on speech intelligibility as deduced from exceedingly sparse spectral representations., " Proc. Eurospeech, Budapest, Hungary, 2687-2690.
40. Sommers, M. S., Spehar, B., and Tye-Murray, N. (2005a). " The effects of signal-to-noise ratio on auditory-visual integration: Integration and encoding are not independent (A)., " J. Acoust. Soc. Am. 117, 2574.
41. Sommers, M. S., Tye-Murray, N., and Spehar, B. (2005b). " Auditory-visual speech perception and auditory-visual enhancement in normal-hearing younger and older adults., " Ear Hear. 26, 263-275.
42. Souza, P. E., and Boike, K. T. (2006). " Combining temporal-envelope cues across channels: Effects of age and hearing loss., " J. Speech Lang. Hear. Res. 49, 138-149.
43. Spehar, B., Tye-Murray, N., and Sommers, M. (2004). " Time-compressed visual speech and age: A first report., " Ear Hear. 25, 565-572.
44. Sumby, W. H., and Pollack, I. (1954). " Visual contribution to speech intelligibility in noise., " J. Acoust. Soc. Am. 26, 212-215.
45. Turner, C. W., and Cummings, K. J. (1999). " Speech audibility for listeners with high-frequency hearing loss., " Am. J. Audiol. 8, 47-56.
46. Turner, C. W., and Henry, B. A. (2002). " Benefits of amplification for speech recognition in background noise., " J. Acoust. Soc. Am. 112, 1675-1680.
47. Turner, C. W., Chi, S. L., and Flock, S. (1999). " Limiting spectral resolution in speech for listeners with sensorineural hearing loss., " J. Speech Lang. Hear. Res. 42, 773-784.
48. Wang, M. (1976). " SINFA: Multivariate uncertainty analysis for confusion matrices., " Behav. Res. Methods Instrum. 8, 471-472.