Cortical activity patterns predict robust speech discrimination ability in noise

European Journal of Neuroscience

Volumn 34, Issue 11, 2011, Pages 1823-1838

  Shetake, Jai A ^a   Wolf, Jordan T ^a   Cheung, Ryan J ^a   Engineer, Crystal T ^a   Ram, Satyananda K ^a   Kilgard, Michael P ^a  

^a UNIVERSITY OF TEXAS AT DALLAS   (United States)

Author keywords

Neural basis of speech; Rodent; Similarities between human and animal; Speech in noise; Temporal integration

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; AUDITORY RESPONSE; AUDITORY STIMULATION; BRAIN FUNCTION; CONTROLLED STUDY; FEMALE; INTERPERSONAL COMMUNICATION; NERVOUS SYSTEM ELECTROPHYSIOLOGY; NOISE; NONHUMAN; PRIMARY AUDITORY CORTEX; PRIORITY JOURNAL; RAT; SOUND DETECTION; SPEECH DISCRIMINATION;

ACOUSTIC STIMULATION; ANIMALS; AUDITORY CORTEX; AUDITORY PERCEPTION; BEHAVIOR, ANIMAL; FEMALE; HUMANS; NEURONS; NOISE; PHONETICS; RATS; RATS, SPRAGUE-DAWLEY; SPEECH PERCEPTION;

EID: 82455212801     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/j.1460-9568.2011.07887.x     Document Type: Article

References (93)

1. Abeles, M., Bergman, H., Margalit, E. & Vaadia, E. (1993) Spatiotemporal firing patterns in the frontal cortex of behaving monkeys. J. Neurophysiol., 70, 1629-1638.
2. Ahissar, E., Nagarajan, S., Ahissar, M., Protopapas, A., Mahncke, H. & Merzenich, M.M. (2001) Speech comprehension is correlated with temporal response patterns recorded from auditory cortex. Proc. Natl. Acad. Sci. USA, 98, 13367-13372.
3. Anderson, S., Skoe, E., Chandrasekaran, B. & Kraus, N. (2010) Neural timing is linked to speech perception in noise. J. Neurosci., 30, 4922-4926.
4. Appeltants, D., Gentner, T.Q., Hulse, S.H., Balthazart, J. & Ball, G.F. (2005) The effect of auditory distractors on song discrimination in male canaries (Serinus canaria). Behav. Processes, 69, 331-341.
5. Billings, C.J., Bennett, K.O., Molis, M.R. & Leek, M.R. (2010) Cortical encoding of signals in noise: effects of stimulus type and recording paradigm. Ear Hear., 32, 53-60.
6. Binder, J.R., Liebenthal, E., Possing, E.T., Medler, D.A. & Ward, B.D. (2004) Neural correlates of sensory and decision processes in auditory object identification. Nat. Neurosci., 7, 295-301.
7. Bishop, C.W. & Miller, L.M. (2009) A multisensory cortical network for understanding speech in noise. J. Cogn. Neurosci., 21, 1790-1805.
8. Brinton, L. (2000) The Structure of Modern English: a Linguistic Introduction. John Benjamin Publishing Co., Amsterdam, 1, 42.
9. Buonomano, D.V. & Maass, W. (2009) State-dependent computations: spatiotemporal processing in cortical networks. Nat. Rev. Neurosci., 10, 113-125.
10. Buonomano, D.V. & Merzenich, M.M. (1995) Temporal information transformed into a spatial code by a neural network with realistic properties. Science (New York, N.Y.), 267, 1028-1030.
11. Busch, A.C. & Eldredge, D. (1967) The effect of differing noise spectra on the consistency of identification of consonants. Lang. Speech, 10, 194-202.
12. Butts, D.A., Weng, C., Jin, J., Yeh, C.I., Lesica, N.A., Alonso, J.M. & Stanley, G.B. (2007) Temporal precision in the neural code and the timescales of natural vision. Nature, 449, 92-95.
13. Buus, S. (1985) Release from masking caused by envelope fluctuations. J. Acoust. Soc. Am., 78, 1958-1965.
14. Byrne, D., Harvey, D., Khanh, T., Stig, A., Keith, W., Robyn, C., Bjorn, H., Raymond, H., Joseph, K., Lui, C., Jurgen, K., Kotby, M.N., Nasser, H.A.N., Wafaa, A.H.E.K., Yasuko, N., Herbert, O., Richard, P., Dafydd, S., Rhys, M., Tony, S., George, T., Gregory, I.F., Soren, W. & Carl, L. (1994) An international comparison of long-term average speech spectra. J. Acoust. Soc. Am., 90, 2108-2120.
15. Chase, S.M. & Young, E.D. (2007) First-spike latency information in single neurons increases when referenced to population onset. Proc. Natl. Acad. Sci. USA, 104, 5175-5180.
16. Chen, F. & Loizou, P.C. (2010) Analysis of a simplified normalized covariance measure based on binary weighting functions for predicting the intelligibility of noise-suppressed speech. J. Acoust. Soc. Am., 128, 3715-3723.
17. Cox, S. & Vinagre, L. (2004) Modelling of confusions in aircraft call-signs. Speech Commun., 42, 289-312.
18. Cunningham, J., Nicol, T., Zecker, S.G., Bradlow, A. & Kraus, N. (2001) Neurobiologic responses to speech in noise in children with learning problems: deficits and strategies for improvement. Clin. Neurophysiol., 112, 758-767.
19. Cunningham, J., Nicol, T., King, C., Zecker, S.G. & Kraus, N. (2002) Effects of noise and cue enhancement on neural responses to speech in auditory midbrain, thalamus and cortex. Hear. Res., 169, 97-111.
20. Dorman, M.F., Loizou, P.C. & Rainey, D. (1997) Speech intelligibility as a function of the number of channels of stimulation for signal processors using sine-wave and noise-band outputs. J. Acoust. Soc. Am., 102, 2403-2411.
21. Dubno, J.R. & Levitt, H. (1981) Predicting consonant confusions from acoustic analysis. J. Acoust. Soc. Am., 69, 249-261.
22. Ehret, G. & Gerhardt, H.C. (1980) Auditory masking and effects of noise on responses of the green treefrog (Hyla cinerea) to synthetic mating calls. J. Comp. Physiol., 141, 13-18.
23. Engineer, C.T., Perez, C.A., Chen, Y.H., Carraway, R.S., Reed, A.C., Shetake, J.A., Jakkamsetti, V., Chang, K.Q. & Kilgard, M.P. (2008) Cortical activity patterns predict speech discrimination ability. Nat. Neurosci., 11, 603-608.
24. Engineer, N.D., Riley, J.R., Seale, J.D., Vrana, W.A., Shetake, J.A., Sudanagunta, S.P., Borland, M.S. & Kilgard, M.P. (2011) Reversing pathological neural activity using targeted plasticity. Nature, 470, 101-104.
25. Fitch, R.H., Miller, S. & Tallal, P. (1997) Neurobiology of speech perception. Annu. Rev. Neurosci., 20, 331-353.
26. Foffani, G., Tutunculer, B. & Moxon, K.A. (2004) Role of spike timing in the forelimb somatosensory cortex of the rat. J. Neurosci., 24, 7266-7271.
27. Foffani, G., Chapin, J.K. & Moxon, K.A. (2008) Computational role of large receptive fields in the primary somatosensory cortex. J. Neurophysiol., 100, 268-280.
28. Furukawa, S., Xu, L. & Middlebrooks, J.C. (2000) Coding of sound-source location by ensembles of cortical neurons. J. Neurosci., 20, 1216-1228.
29. Gawne, T.J., Kjaer, T.W. & Richmond, B.J. (1996) Latency: another potential code for feature binding in striate cortex. J. Neurophysiol., 76, 1356-1360.
30. Gerhardt, H.C. & Klump, G.M. (1988) Masking of acoustic signals by the chorus background noise in the green tree frog: a limitation on mate choice. Anim. Behav., 36, 1247-1249.
31. Gutig, R. & Sompolinsky, H. (2006) The tempotron: a neuron that learns spike timing-based decisions. Nat. Neurosci., 9, 420-428.
32. Hall, J.W. III & Grose, J.H. (1991) Relative contributions of envelope maxima and minima to comodulation masking release. Q. J. Exp. Psychol., 43, 349-372.
33. Harris, K.C., Dubno, J.R., Keren, N.I., Ahlstrom, J.B. & Eckert, M.A. (2009) Speech recognition in younger and older adults: a dependency on low-level auditory cortex. J. Neurosci., 29, 6078-6087.
34. Hawkins, J.E. Jr & Stevens, S.S. (1950) The masking of pure tones and of speech by white noise. J. Acoust. Soc. Am., 22, 6-13.
35. Horii, Y., House, A.S. & Hughes, G.W. (1971) A masking noise with speech-envelope characteristics for studying intelligibility. J. Acoust. Soc. Am., 49, 1849-1856.
36. House, A.S., Williams, C.E., Heker, M.H. & Kryter, K.D. (1965) Articulation-testing methods: consonantal differentiation with a closed-response set. J. Acoust. Soc. Am., 37, 158-166.
37. Huetz, C., Gourevitch, B. & Edeline, J.M. (2010) Neural codes in the thalamocortical auditory system: from artificial stimuli to communication sounds. Hear. Res., 241, 147-158.
38. Hulse, S.H., MacDougall-Shackleton, S.A. & Wisniewski, A.B. (1997) Auditory scene analysis by songbirds: stream segregation of birdsong by European starlings (Sturnus vulgaris). J. Comp. Psychol., 111, 3-13.
39. Hygge, S., Ronnberg, J., Larsby, B. & Arlinger, S. (1992) Normal-hearing and hearing-impaired subjects' ability to just follow conversation in competing speech, reversed speech, and noise backgrounds. J. Speech Hear. Res., 35, 208-215.
40. Kawahara, H. (1997) Speech Representation and Transformation using Adaptive Interpolation of Weighted Spectrum: Vocoder Revisited. Proceedings of IEEE Int. Conf. Acoust., Speech, Signal Process, 1997, 1303-1306.
41. Kayser, C., Montemurro, M.A., Logothetis, N.K. & Panzeri, S. (2009) Spike-phase coding boosts and stabilizes information carried by spatial and temporal spike patterns. Neuron, 61, 597-608.
42. Kluender, K.R., Diehl, R.L. & Killeen, P.R. (1987) Japanese quail can learn phonetic categories. Science (New York, N.Y.), 237, 1195-1197.
43. Kozou, H., Kujala, T., Shtyrov, Y., Toppila, E., Starck, J., Alku, P. & Naatanen, R. (2005) The effect of different noise types on the speech and non-speech elicited mismatch negativity. Hear. Res., 199, 31-39.
44. Kuhl, P.K. & Miller, J.D. (1975) Speech perception by the chinchilla: voiced-voiceless distinction in alveolar plosive consonants. Science (New York, N.Y.), 190, 69-72.
45. Lemus, L., Hernandez, A. & Romo, R. (2009) Neural codes for perceptual discrimination of acoustic flutter in the primate auditory cortex. Proc. Natl. Acad. Sci. USA, 106, 9471-9476.
46. Liu, J. & Newsome, W.T. (2005) Correlation between speech perception and neural activity in the middle temporal visual area. J. Neurosci., 25, 711-722.
47. Lohr, B., Wright, T.F. & Dooling, R.J. (2003) Detection and discrimination of natural calls in masking noise by birds: estimating the active space of a signal. Anim. Behav., 65, 763-777.
48. Martin, B.A. & Stapells, D.R. (2005) Effects of low-pass noise masking on auditory event-related potentials to speech. Ear Hear., 26, 195-213.
49. Martin, B.A., Kurtzberg, D. & Stapells, D.R. (1999) The effects of decreased audibility produced by high-pass noise masking on N1 and the mismatch negativity to speech sounds/ba/and/da. J. Speech Lang. Hear. Res., 42, 271-286.
50. Merzenich, M.M., Schreiner, C., Jenkins, W. & Wang, X. (1993) Neural mechanisms underlying temporal integration, segmentation, and input sequence representation: some implications for the origin of learning disabilities. Ann. NY Acad. Sci., 682, 1-22.
51. Merzenich, M.M., Jenkins, W.M., Johnston, P., Schreiner, C., Miller, S.L. & Tallal, P. (1996) Temporal processing deficits of language-learning impaired children ameliorated by training. Science (New York, N.Y.), 271, 77-81.
52. Mesgarani, N., David, S.V., Fritz, J.B. & Shamma, S.A. (2008) Phoneme representation and classification in primary auditory cortex. J. Acoust. Soc. Am., 123, 899-909.
53. Miller, G.A. & Licklider, J.C.R. (1950) The intelligibility of interrupted speech. J. Acoust. Soc. Am., 22, 167-173.
54. Miller, G.A. & Nicely, P.E. (1955) An analysis of perceptual confusions among some English consonants. J. Acoust. Soc. Am., 27, 338-352.
55. Moore, B.C. (1985) Additivity of simultaneous masking, revisited. J. Acoust. Soc. Am., 78, 488-494.
56. Muller-Gass, A., Marcoux, A., Logan, J. & Campbell, K.B. (2001) The intensity of masking noise affects the mismatch negativity to speech sounds in human subjects. Neurosci. Lett., 299, 197-200.
57. Narayan, R., Best, V., Ozmeral, E., McClaine, E., Dent, M., Shinn-Cunningham, B. & Sen, K. (2007) Cortical interference effects in the cocktail party problem. Nat. Neurosci., 10, 1601-1607.
58. Panzeri, S. & Diamond, M.E. (2010) Information carried by population spike times in the whisker sensory cortex can be decoded without knowldege of stimulus time. Front. Syn. Neurosci., 2, 17.
59. Panzeri, S., Petersen, R.S., Schultz, S.R., Lebedev, M. & Diamond, M.E. (2001) The role of spike timing in the coding of stimulus location in rat somatosensory cortex. Neuron, 29, 769-777.
60. Phatak, S.A. & Allen, J.B. (2007) Consonant and vowel confusions in speech-weighted noise. J. Acoust. Soc. Am., 121, 2312-2326.
61. Phatak, S.A., Lovitt, A. & Allen, J.B. (2008) Consonant confusions in white noise. J. Acoust. Soc. Am., 124, 1220-1233.
62. Ramus, F., Hauser, M.D., Miller, C., Morris, D. & Mehler, J. (2000) Language discrimination by human newborns and by cotton-top tamarin monkeys. Science (New York, N.Y.), 288, 349-351.
63. Reed, P., Howell, P., Sackin, S., Pizzimenti, L. & Rosen, S. (2003) Speech perception in rats: use of duration and rise time cues in labeling of affricate/fricative sounds. J. Exp. Anal. Behav., 80, 205-215.
64. Reed, A., Riley, J., Carraway, R., Carrasco, A., Perez, C., Jakkamsetti, V. & Kilgard, M.P. (2011) Cortical map plasticity improves learning but is not necessary for improved performance. Neuron, 70, 121-131.
65. Reinagel, P. & Reid, R.C. (2000) Temporal coding of visual information in the thalamus. J. Neurosci., 20, 5392-5400.
66. Romo, R. & Salinas, E. (2003) Flutter discrimination: neural codes, perception, memory and decision making. Nat. Rev. Neurosci., 4, 203-218.
67. Russo, N., Nicol, T., Musacchia, G. & Kraus, N. (2004) Brainstem responses to speech syllables. Clin. Neurophysiol., 115, 2021-2030.
68. Russo, N., Hornickel, J., Nicol, T., Zecker, S. & Kraus, N. (2010) Biological changes in auditory function following training in children with autism spectrum disorders. Behav. Brain. Funct., 6, 60-68.
69. Sally, S.L. & Kelly, J.B. (1988) Organization of auditory cortex in the albino rat: sound frequency. J. Neurophysiol., 59, 1627-1638.
70. Salvi, R.J., Lockwood, A.H., Frisina, R.D., Coad, M.L., Wack, D.S. & Frisina, D.R. (2002) PET imaging of the normal human auditory system: responses to speech in quiet and in background noise. Hear. Res., 170, 96-106.
71. Schnupp, J.W., Hall, T.M., Kokelaar, R.F. & Ahmed, B. (2006) Plasticity of temporal pattern codes for vocalization stimuli in primary auditory cortex. J. Neurosci., 26, 4785-4795.
72. Skoe, E. & Kraus, N. (2010) Auditory brain stem response to complex sounds: a tutorial. Ear Hear., 31, 302-324.
73. Snowling, M., Goulandris, N., Bowlby, M. & Howell, P. (1986) Segmentation and speech perception in relation to reading skill: a developmental analysis. J. Exp. Child Psychol., 41, 489-507.
74. Song, J., Skoe, E., Banai, K. & Kraus, N. (2010) Perception of speech in noise: neural correlates. J. Cogn. Neurosci., 23, 2268-2279.
75. Sperling, A.J., Lu, Z.-L., Manis, F.R. & Seidenberg, M.S. (2005) Deficits in perceptual noise exclusion in developmental dyslexia. Nat. Neurosci., 8, 862-863.
76. Steeneken, H.J. & Houtgast, T. (1980) A physical method for measuring speech-transmission quality. J. Acoust. Soc. Am., 67, 318-326.
77. Steeneken, H.J.M. & Houtgast, T. (2002) Phoneme-group specific octave-band weights in predicting speech intelligibility. Speech Commun., 38, 399-411.
78. Steinschneider, M., Volkov, I.O., Noh, M.D., Garell, P.C. & Howard, M.A. III (1999) Temporal encoding of the voice onset time phonetic parameter by field potentials recorded directly from human auditory cortex. J. Neurophysiol., 82, 2346-2357.
79. Steinschneider, M., Volkov, I.O., Fishman, Y.I., Oya, H., Arezzo, J.C. & Howard, M.A. III (2005) Intracortical responses in human and monkey primary auditory cortex support a temporal processing mechanism for encoding of the voice onset time phonetic parameter. Cereb. Cortex, 15, 170-186.
80. Stuart, A. & Phillips, D.P. (1996) Word recognition in continuous and interrupted broadband noise by young normal-hearing, older normal-hearing, and presbyacusic listeners. Ear Hear., 17, 478-489.
81. Studebaker, G.A., Pavlovic, C.V. & Sherbecoe, R.L. (1987) A frequency importance function for continuous discourse. J. Acoust. Soc. Am., 81, 1130-1138.
82. Tallal, P., Miller, S. & Fitch, R.H. (1993) Neurobiological basis of speech: a case for the preeminence of temporal processing. Ann. NY Acad. Sci., 682, 27-47.
83. Tallal, P., Miller, S.L., Bedi, G., Byma, G., Wang, X., Nagarajan, S.S., Schreiner, C., Jenkins, W.M. & Merzenich, M.M. (1996) Language comprehension in language-learning impaired children improved with acoustically modified speech. Science (New York, N.Y.), 271, 81-84.
84. Threlkeld, S.W., McClure, M.M., Bai, J., Wang, Y., LoTurco, J.J., Rosen, G.D. & Fitch, R.H. (2007) Developmental disruptions and behavioral impairments in rats following in utero RNAi of Dyx1c1. Brain Res. Bull., 71, 508-514.
85. Villa, A.E., Tetko, I.V., Hyland, B. & Najem, A. (1999) Spatiotemporal activity patterns of rat cortical neurons predict responses in a conditioned task. Proc. Natl. Acad. Sci. USA, 96, 1106-1111.
86. Wang, M.D. & Bilger, R.C. (1973) Consonant confusions in noise: a study of perceptual features. J. Acoust. Soc. Am., 54, 1248-1266.
87. Wang, L., Narayan, R., Grana, G., Shamir, M. & Sen, K. (2007) Cortical discrimination of complex natural stimuli: can single neurons match behavior? J. Neurosci., 27, 582-589.
88. Whiting, K.A., Martin, B.A. & Stapells, D.R. (1998) The effects of broadband noise masking on cortical event-related potentials to speech sounds/ba/and/da. Ear Hear., 19, 218-231.
89. Wong, S.W. & Schreiner, C.E. (2003) Representation of CV-sounds in cat primary auditory cortex: intensity dependence. Speech Commun., 41, 93-106.
90. Wong, P.C., Uppunda, A.K., Parrish, T.B. & Dhar, S. (2008) Cortical mechanisms of speech perception in noise. J. Speech Lang. Hear. Res., 51, 1026-1041.
91. Wong, P.C., Jin, J.X., Gunasekera, G.M., Abel, R., Lee, E.R. & Dhar, S. (2009) Aging and cortical mechanisms of speech perception in noise. Neuropsychologia, 47, 693-703.
92. Ziegler, J.C., Pech-Georgel, C., George, F., Alario, F.X. & Lorenzi, C. (2005) Deficits in speech perception predict language learning impairment. Proc. Natl. Acad. Sci. USA, 102, 14110-14115.
93. Ziegler, J.C., Pech-Georgel, C., George, F. & Lorenzi, C. (2009) Speech-perception-in-noise deficits in dyslexia. Dev. Sci., 12, 732-745.