Neural coding of continuous speech in auditory cortex during monaural and dichotic listening

Journal of Neurophysiology

Volumn 107, Issue 1, 2012, Pages 78-89

  Ding, Nai ^a   Simon, Jonathan Z ^a,b  

^a UNIVERSITY OF MARYLAND   (United States)

^b University of Maryland   (United States)

Author keywords

Attention; Magnetoencephalography; Spectrotemporal response function; Speech segregation

Indexed keywords

ADULT; ARTICLE; ATTENTION; AUDITORY CORTEX; CODING; DICHOTIC LISTENING; EVOKED SOMATOSENSORY RESPONSE; FEMALE; HUMAN; MAGNETOENCEPHALOGRAPHY; MALE; MONAURAL HEARING; NARRATIVE; NERVE POTENTIAL; NORMAL HUMAN; PRIORITY JOURNAL; RIGHT HEMISPHERE; SPEECH;

ADULT; AUDITORY CORTEX; FEMALE; HUMANS; INFORMATION STORAGE AND RETRIEVAL; MALE; MODELS, NEUROLOGICAL; NERVE NET; PATTERN RECOGNITION, PHYSIOLOGICAL; SPEECH PERCEPTION; YOUNG ADULT;

EID: 84255192910     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.00297.2011     Document Type: Article

References (66)

1. Abrams DA, Nicol T, Zecker S, Kraus N. Right-hemisphere auditory cortex is dominant for coding syllable patterns in speech. J Neurosci 28: 3958-3965, 2008.
2. Ahissar E, Nagarajan S, Ahissar M, Protopapas A, Mahncke H, Mer-zenich MM. Speech comprehension is correlated with temporal response patterns recorded from auditory cortex. Proc Natl Acad Sci USA 98: 13367-13372, 2001.
3. Ahveninen J, Hämäläinen M, Jääskeläinen IP, Ahlfors SP, Huang S, Lin FH, Raij T, Sams M, Vasios CE, Belliveau JW. Attention-driven auditory cortex short-term plasticity helps segregate relevant sounds from noise. Proc Natl Acad Sci USA 108: 4182-4187, 2011.
4. Aiken SJ, Picton TW. Human cortical responses to the speech envelope. Ear Hear 29: 139-157, 2008.
5. Bidet-Caulet A, Fischer C, Besle J, Aguera PE, Giard MH, Bertrand O. Effects of selective attention on the electrophysiological representation of concurrent sounds in the human auditory cortex. J Neurosci 27: 9252-9261, 2007.
6. Bitterman Y, Mukamel R, Malach R, Fried I, Nelken I. Ultra-fine frequency tuning revealed in single neurons of human auditory cortex. Nature 451: 197-201, 2008.
7. Bronkhorst AW. The cocktail party phenomenon: a review of research on speech intelligibility in multiple-talker conditions. Acustica 86: 117-128, 2000.
8. Brungart DS, Simpson BD. Within-ear and across-ear interference in a cocktail-party listening task. J Acoust Soc Am 122: 2985-2995 2002.
9. Chang E, Rieger J, Johnson K, Berger M, Barbaro N, Knight R. Categorical speech representation in human superior temporal gyrus. Nat Neurosci 13: 1428-1432, 2010.
10. Cherry EC. Some experiments on the recognition of speech, with one and with two ears. J Acoust Soc Am 25: 975-979, 1953.
11. Conway ARA, Cowan N, Bunting MF. The cocktail party phenomenon revisited: the importance of working memory capacity. Psychon Bull Rev 8: 331-335, 2001.
12. Cover TM, Thomas JA. Elements of Information Theory. New York: Wiley, 1991.
13. David SV, Mesgarani N, Fritz JB, Shamma SA. Rapid synaptic depression explains nonlinear modulation of spectro-temporal tuning in primary auditory cortex by natural stimuli. J Neurosci 29: 3374-3386, 2009.
14. David SV, Mesgarani N, Shamma SA. Estimating sparse spectro-temporal receptive fields with natural stimuli. Network 18: 191-212, 2007.
15. de Cheveigne A, Simon JZ. Denoising based on spatial filtering. J Neurosci Methods 171: 331-339, 2008.
16. de Cheveigne A, Simon JZ. Denoising based on time-shift PCA. J Neurosci Methods 165: 297-305, 2007.
17. deCharms RC, Blake DT, Merzenich MM. Optimizing sound features for cortical neurons. Science 280: 1439-1444, 1998.
18. Depireux DA, Simon JZ, Klein DJ, Shamma SA. Spectro-temporal response field characterization with dynamic ripples in ferret primary auditory cortex. J Neurophysiol 85: 1220-1234, 2001.
19. Ding N, Simon JZ. Neural representations of complex temporal modulations in the human auditory cortex. J Neurophysiol 102: 2731-2743, 2009.
20. Elhilali M, Xiang J, Shamma SA, Simon JZ. Interaction between attention and bottom-up saliency mediates the representation of foreground and background in an auditory scene. PLoS Biol 7: e1000129, 2009.
21. Festen JM, Plomp R. Effects of fluctuating noise and interfering speech on the speech-reception threshold for impaired and normal hearing. J Acoust Soc Am 88: 1725-1736, 1990.
22. Fritz J, Shamma S, Elhilali M, Klein D. Rapid task-related plasticity of spectrotemporal receptive fields in primary auditory cortex. Nat Neurosci 6: 1216-1223, 2003.
23. Fujiki N, Jousmäki V, Hari R. Neuromagnetic responses to frequency-tagged sounds: a new method to follow inputs from each ear to the human auditory cortex during binaural hearing. J Neurosci 22: RC205, 2002.
24. Giraud AL, Kleinschmidt A, Poeppel D, Lund TE, Frackowiak RSJ, Laufs H. Endogenous cortical rhythms determine cerebral specialization for speech perception and production. Neuron 56: 1127-1134, 2007.
25. Greenberg S. Speaking in shorthand-a syllable-centric perspective for understanding pronunciation variation. Speech Commun 29: 159-176, 1999.
26. Gutschalk A, Micheyl C, Oxenham AJ. Neural correlates of auditory perceptual awareness under informational masking. PLoS Biol 6: e138, 2008.
27. Hari R, Hämäläinen M, Kaukoranta E, Mäkelä J, Joutsiniemi SL, Tii-honen J. Selective listening modifies activity of the human auditory cortex. Exp Brain Res 74: 463-470, 1989.
28. Herdman AT, Wollbrink A, Chau W, Ishii R, Ross B, Pantev C. Determination of activation areas in the human auditory cortex by means of synthetic aperture magnetometry. Neuroimage 20: 995-1005, 2003.
29. Hickok G, Poeppel D. The cortical organization of speech processing. Nat Rev Neurosci 8: 393-402, 2007.
30. Hill KT, Miller LM. Auditory attentional control and selection during cocktail party listening. Cereb Cortex 20: 583-590, 2010.
31. Hillyard SA, Hink RF, Schwent VL, Picton TW. Electrical signs of selective attention in the human brain. Science 182: 177-180, 1973.
32. Kerlin JR, Shahin AJ, Miller LM. Attentional gain control of ongoing cortical speech representations in a "cocktail party". J Neurosci 30: 620-628, 2010.
33. Lakatos P, Karmos G, Mehta AD, Ulbert I, Schroeder CE. In monkeys that are paying attention to a rhythmic stimulus, brain oscillations become tuned to the stimulus so that the response in the visual cortex is enhanced. Science 320: 110-113, 2008.
34. Lalor EC, Foxe JJ. Neural responses to uninterrupted natural speech can be extracted with precise temporal resolution. Eur J Neurosci 31: 189-193, 2010.
35. Lazzouni L, Ross B, Voss P, Lepore F. Neuromagnetic auditory steady-state responses to amplitude modulated sounds following dichotic or monaural presentation. Clin Neurophysiol 121: 200-207, 2010.
36. Linden RD, Picton TW, Hamel G, Campbell KB. Human auditory steady-state evoked potentials during selective attention. Electroencephalogr Clin Neurophysiol 66: 145-159, 1987.
37. Luo H, Poeppel D. Phase patterns of neuronal responses reliably discriminate speech in human auditory cortex. Neuron 54: 1001-1010, 2007.
38. Lütkenhöner B, Steinsträter O. High-precision neuromagnetic study of the functional organization of the human auditory cortex. Audiol Neurootol 3: 191-213, 1998.
39. Mesgarani N, David SV, Fritz JB, Shamma SA. Influence of context and behavior on stimulus reconstruction from neural activity in primary auditory cortex. J Neurophysiol 102: 3329-3339, 2009.
40. Miller GA, Licklider JC. The intelligibility of interrupted speech. J Acoust Soc Am 22: 167-173, 1950.
41. Millman RE, Woods WP, Quinlan PT. Functional asymmetries in the representation of noise-vocoded speech. Neuroimage 54: 2364-2373, 2011.
42. Mosher JC, Baillet S, Leahy RM. Equivalence of linear approaches in bioelectromagnetic inverse solutions. In: IEEE Workshop on Statistical Signal Processing. St. Louis, MO: 2003.
43. Narayan R, Best V, Ozmeral E, McClaine E, Dent M, Shinn-Cunningham B, Sen K. Cortical interference effects in the cocktail party problem. Nat Neurosci 10: 1601-1607, 2007.
44. Nourski KV, Reale RA, Oya H, Kawasaki H, Kovach CK, Chen H, Matthew A, Howard I, Brugge JF. Temporal envelope of time-compressed speech represented in the human auditory cortex. J Neurosci 29: 15564-15574, 2009.
45. Pantev C, Lütkenhöner B, Hoke M, Lehnertz K. Comparison between simultaneously recorded auditory-evoked magnetic fields and potentials elicited by ipsilateral, contralateral and binaural tone burst stimulation. Audiology 25: 54-61, 1986.
46. Panzeri S, Brunel N, Logothetis NK, Kayser C. Sensory neural codes using multiplexed temporal scales. Trends Neurosci 33: 111-120, 2010.
47. Penna SD, Brancucci A, Babiloni C, Franciotti R, Pizzella V, Rossi D, Torquati K, Rossini PM, Romani GL. Lateralization of dichotic speech stimuli is based on specific auditory pathway interactions: neuromagnetic evidence. Cereb Cortex 17: 2303-2311, 2007.
48. Pickles JO. An Introduction to the Physiology of Hearing. New York: Academic, 1988.
49. Poeppel D. The analysis of speech in different temporal integration windows: cerebral lateralization as 'asymmetric sampling in time'. Speech Commun 41: 245-255, 2003.
50. Power AJ, Lalor EC, Reilly RB. Endogenous auditory spatial attention modulates obligatory sensory activity in auditory cortex. Cereb Cortex 21: 1223-1230, 2011.
51. Qiu A, Schreiner CE, Escabí MA. Gabor Analysis of Auditory Midbrain Receptive Fields: Spectro-Temporal and Binaural Composition. J Neuro-physiol 90: 456-476, 2003.
52. Rif J, Hari R, Hämäläinen MS, Sams M. Auditory attention affects two different areas in the human supratemporal cortex. Electroencephalogr Clin Neurophysiol 79: 464-472, 1991.
53. Rosen S. Temporal information in speech: acoustic, auditory and linguistic aspects. Philos Trans R Soc Lond B Biol Sci 336: 367-373, 1992.
54. Ross B, Borgmann C, Draganova R, Roberts LE, Pantev C. A high-precision magnetoencephalographic study of human auditory steady-state responses to amplitude-modulated tones. J Acoust Soc Am 108: 679-691, 2000.
55. Ross B, Herdman AT, Pantev C. Right hemispheric laterality of human 40 Hz auditory steady-state responses. Cereb Cortex 15: 2029-2039, 2005.
56. Ross B, Hillyard SA, Picton TW. Temporal dynamics of selective attention during dichotic listening. Cereb Cortex 20: 1360-1371, 2010.
57. Schönwiesner M, Zatorre RJ. Spectro-temporal modulation transfer function of single voxels in the human auditory cortex measured with high-resolution fMRI. Proc Natl Acad Sci USA 106: 14611-14616, 2009.
58. Schroeder CE, Lakatos P. Low-frequency neuronal oscillations as instruments of sensory selection. Trends Neurosci 32: 9-18, 2009.
59. Scott SK, Rosen S, Beaman CP, Davis JP, Wise RJ. The neural processing of masked speech: evidence for different mechanisms in the left and right temporal lobes. J Acoust Soc Am 125: 1737-1743, 2009.
60. Shannon RV, Zeng FG, Kamath V, Wygonski J, Ekelid M. Speech recognition with primarily temporal cues. Science 270: 303-304, 1995.
61. Shomstein S, Yantis S. Parietal cortex mediates voluntary control of spatial and nonspatial auditory attention. J Neurosci 26: 435-439, 2006.
62. Simon JZ, Depireux DA, Klein DJ, Fritz JB, Shamma SA. Temporal symmetry in primary auditory cortex: implications for cortical connectivity. Neural Comput 19: 583-638, 2007.
63. Uutela K, Hämäläinen M, Salmelin R. Global optimization in the localization of neuromagnetic sources. IEEE Trans Biomed Eng 45: 716-723, 1998.
64. Woldorff MG, Gallen CC, Hampson SA, Hillyard SA, Pantev C, Sobel D, Bloom FE. Modulation of early sensory processing in human auditory cortex during auditory selective attention. Proc Natl Acad Sci USA 90: 8722-8726, 1993.
65. Xiang J, Simon J, Elhilali M. Competing streams at the cocktail party: exploring the mechanisms of attention and temporal integration. J Neurosci 30: 12084-12093, 2010.
66. Yang X, Wang K, Shamma SA. Auditory representations of acoustic signals. IEEE Trans Info Theory 38: 824-839, 1992.