Cortical entrainment to continuous speech: Functional roles and interpretations

Frontiers in Human Neuroscience

Volumn 8, Issue MAY, 2014, Pages

  Ding, Nai ^a   Simon, Jonathan Z ^b,c  

^a NEW YORK UNIVERSITY   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c Bldg 142   (United States)

Author keywords

Auditory cortex; Cocktail party problem; Entrainment of rhythms; Speech envelope; Speech intelligibility; Speech perception in noise

Indexed keywords

AUDITORY CORTEX; BRAIN FUNCTION; BRAIN NERVE CELL; BRAIN REGION; CELL ACTIVITY; ELECTROENCEPHALOGRAM; EVOKED BRAIN STEM AUDITORY RESPONSE; FREQUENCY MODULATION; FUNCTIONAL ASSESSMENT; HUMAN; LANGUAGE ABILITY; MENTAL PERFORMANCE; MENTAL TASK; MOLECULAR DYNAMICS; NEUROANATOMY; REVIEW; SPEECH DISCRIMINATION; SPEECH PERCEPTION;

EID: 84901623370     PISSN: None     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2014.00311     Document Type: Review

References (73)

1. Ahissar, E., Nagarajan, S., Ahissar, M., Protopapas, A., Mahncke, H., and Merzenich, M. M. (2001). Speech comprehension is correlated with temporal response patterns recorded from auditory cortex. Proc. Natl. Acad. Sci. U.S.A. 98, 13367-13372. doi: 10.1073/pnas.201400998
2. Aiken, S. J., and Picton, T. W. (2008). Human cortical responses to the speech envelope. Ear Hear. 29, 139-157. doi: 10.1097/AUD.0b013e31816453dc
3. Bendor, D., and Wang, X. (2005). The neuronal representation of pitch in primate auditory cortex. Nature 436, 1161-1165. doi: 10.1038/nature03867
4. Chi, T., Ru, P., and Shamma, S. A. (2005). Multiresolution spectrotemporal analysis of complex sounds. J. Acoust. Soc. Am. 118, 887-906. doi: 10.1121/1.1945807
5. Cooke, M. (2006). A glimpsing model of speech perception in noise. J. Acoust. Soc. Am. 119, 1562-1573. doi: 10.1121/1.2166600
6. Cummins, F. (2012). Oscillators and syllables: a cautionary note. Front. Psychol. 3:364. doi: 10.3389/fpsyg.2012.00364
7. Cutler, A., Mehler, J., Norris, D., and Segui, J. (1986). The syllable's differing role in the segmentation of French and English. J. Mem. Lang. 25, 385-400. doi: 10.1016/0749-596X(86)90033-1
8. Ding, N., Chatterjee, M., and Simon, J. Z. (2014). Robust cortical entrainment to the speech envelope relies on the spectro-temporal fine structure. Neuroimage 88C, 41-46. doi: 10.1016/j.neuroimage.2013.10.054 [Epub ahead of print].
9. Ding, N., and Simon, J. Z. (2012a). Emergence of neural encoding of auditory objects while listening to competing speakers. Proc. Natl. Acad. Sci. U.S.A. 109, 11854-11859. doi: 10.1073/pnas.1205381109
10. Ding, N., and Simon, J. Z. (2012b). Neural coding of continuous speech in auditory cortex during monaural and dichotic listening. J. Neurophysiol. 107, 78-89. doi: 10.1152/jn.00297.2011
11. Ding, N., and Simon, J. Z. (2013a). Adaptive temporal encoding leads to a background-insensitive cortical representation of speech. J. Neurosci. 33, 5728-5735. doi: 10.1523/JNEUROSCI.5297-12.2013
12. Ding, N., and Simon, J. Z. (2013b). Power and phase properties of oscillatory neural responses in the presence of background activity. J. Comput. Neurosci. 34, 337-343. doi: 10.1007/s10827-012-0424-6
13. Doelling, K., Arnal, L., Ghitza, O., and Poeppel, D. (2014). Acoustic landmarks drive delta-theta oscillations to enable speech comprehension by facilitating perceptual parsing. Neuroimage 85, 761-768. doi: 10.1016/j.neuroimage.2013.06.035
14. Drullman, R., Festen, J. M., and Plomp, R. (1994a). Effect of reducing slow temporal modulations on speech reception. J. Acoust. Soc. Am. 95, 2670-2680. doi: 10.1121/1.409836
15. Drullman, R., Festen, J. M., and Plomp, R. (1994b). Effect of temporal envelope smearing on speech reception. J. Acoust. Soc. Am. 95, 1053-1064. doi: 10.1121/1.408467
16. Du, Y., He, Y., Ross, B., Bardouille, T., Wu, X., Li, L., et al. (2011). Human auditory cortex activity shows additive effects of spectral and spatial cues during speech segregation. Cereb. Cortex 21, 698-707. doi: 10.1093/cercor/bhq136
17. Elhilali, M., Xiang, J., Shamma, S. A., and Simon, J. Z. (2009). Interaction between attention and bottom-up saliency mediates the representation of foreground and background in an auditory scene. PLoS Biol. 7:e1000129. doi: 10.1371/journal.pbio.1000129
18. Elliott, T., and Theunissen, F. (2009). The modulation transfer function for speech intelligibility. PLoS Comput. Biol. 5:e1000302. doi: 10.1371/journal.pcbi.1000302
19. Erb, J., Henry, M. J., Eisner, F., and Obleser, J. (2013). The brain dynamics of rapid perceptual adaptation to adverse listening conditions. J. Neurosci. 33, 10688-10697. doi: 10.1523/JNEUROSCI.4596-12.2013
20. Farbood, M. M., Marcus, G., and Poeppel, D. (2013). Temporal dynamics and the identification of musical key. J. Exp. Psychol. Hum. Percept. Perform. 39, 911-918. doi: 10.1037/a0031087
21. Ghitza, O. (2011). Linking speech perception and neurophysiology: speech decoding guided by cascaded oscillators locked to the input rhythm. Front. Psychol. 2:130. doi: 10.3389/fpsyg.2011.00130
22. Ghitza, O. (2013). The theta-syllable: a unit of speech information defined by cortical function. Front. Psychol.4:138. doi: 10.3389/fpsyg.2013.00138
23. Ghitza, O., Giraud, A.-L., and Poeppel, D. (2012). Neuronal oscillations and speech perception: critical-band temporal envelopes are the essence. Front. Hum. Neurosci. 6:340. doi: 10.3389/fnhum.2012.00340
24. Giraud, A.-L., and Poeppel, D. (2012). Cortical oscillations and speech processing: emerging computational principles and operations. Nat. Neurosci. 15, 511-517. doi: 10.1038/nn.3063
25. Goswami, U., and Leong, V. (2013). Speech rhythm and temporal structure: converging perspectives? Lab. Phonol.4, 67-92. doi: 10.1515/lp-2013-0004
26. Greenberg, S., Carvey, H., Hitchcock, L., and Chang, S. (2003). Temporal properties of spontaneous speech-a syllable-centric perspective. J. Phon. 31, 465-485. doi: 10.1016/j.wocn.2003.09.005
27. Gross, J., Hoogenboom, N., Thut, G., Schyns, P., Panzeri, S., Belin, P., et al. (2013). Speech rhythms and multiplexed oscillatory sensory coding in the human brain. PLoS Biol. 11:e1001752. doi: 10.1371/journal.pbio.1001752
28. Hämäläinen, J. A., Rupp, A., Soltész, F., Szücs, D., and Goswami, U. (2012). Reduced phase locking to slow amplitude modulation in adults with dyslexia: an MEG study. Neuroimage 59, 2952-2961. doi: 10.1016/j.neuroimage.2011.09.075
29. Henry, M. J., and Obleser, J. (2012). Frequency modulation entrains slow neural oscillations and optimizes human listening behavior. Proc. Natl. Acad. Sci. U.S.A. 109, 20095-20100. doi: 10.1073/pnas.1213390109
30. Herrmann, B., Schlichting, N., and Obleser, J. (2014). Dynamic range adaptation to spectral stimulus statistics in human auditory cortex. J. Neurosci. 34, 327-331. doi: 10.1523/JNEUROSCI.3974-13.2014
31. Howard, M. F., and Poeppel, D. (2010). Discrimination of speech stimuli based on neuronal response phase patterns depends on acoustics but not comprehension. J. Neurophysiol. 104, 2500-2511. doi: 10.1152/jn.00251.2010
32. Howard, M. F., and Poeppel, D. (2012). The neuromagnetic response to spoken sentences: co-modulation of theta band amplitude and phase. Neuroimage 60, 2118-2127. doi: 10.1016/j.neuroimage.2012.02.028
33. Kerlin, J. R., Shahin, A. J., and Miller, L. M. (2010). Attentional gain control of ongoing cortical speech representations in a "cocktail party". J. Neurosci. 30, 620-628. doi: 10.1523/JNEUROSCI.3631-09.2010
34. Lalor, E. C., Power, A. J., Reilly, R. B., and Foxe, J. J. (2009). Resolving precise temporal processing properties of the auditory system using continuous stimuli. J. Neurophysiol. 102, 349-359. doi: 10.1152/jn.90896.2008
35. Lee, A. K., Larson, E., Maddox, R. K., and Shinn-Cunningham, B. G. (2014). Using neuroimaging to understand the cortical mechanisms of auditory selective attention. Hear. Res. 307, 111-120. doi: 10.1016/j.heares.2013.06.010
36. Luo, H., and Poeppel, D. (2007). Phase patterns of neuronal responses reliably discriminate speech in human auditory cortex. Neuron 54, 1001-1010. doi: 10.1016/j.neuron.2007.06.004
37. Mesgarani, N., and Chang, E. F. (2012). Selective cortical representation of attended speaker in multi-talker speech perception. Nature 485, 233-236. doi: 10.1038/nature11020
38. Millman, R. E., Prendergast, G., Hymers, M., and Green, G. G. (2012). Representations of the temporal envelope of sounds in human auditory cortex: can the results from invasive intracortical "depth" electrode recordings be replicated using non-invasive MEG "virtual electrodes"? Neuroimage 64, 185-196. doi: 10.1016/j.neuroimage.2012.09.017
39. Ng, B. S. W., Schroeder, T., and Kayser, C. (2012). A precluding but not ensuring role of entrained low-frequency oscillations for auditory perception. J. Neurosci. 32, 12268-12276. doi: 10.1523/JNEUROSCI.1877-12.2012
40. Nourski, K. V., Reale, R. A., Oya, H., Kawasaki, H., Kovach, C. K., Chen, H., et al. (2009). Temporal envelope of time-compressed speech represented in the human auditory cortex. J. Neurosci. 29, 15564-15574. doi: 10.1523/JNEUROSCI.3065-09.2009
41. Obleser, J., Herrmann, B., and Henry, M. J. (2012). Neural oscillations in speech: don't be enslaved by the envelope. Front. Hum. Neurosci. 6:250. doi: 10.3389/fnhum.2012.00250
42. O'Sullivan, J. A., Power, A. J., Mesgarani, N., Rajaram, S., Foxe, J. J., Shinn-Cunningham, B. G., et al. (2014). Attentional selection in a cocktail party environment can be decoded from single-trial EEG. Cereb. Cortex. doi: 10.1093/cercor/bht355
43. Pasley, B. N., David, S. V., Mesgarani, N., Flinker, A., Shamma, S. A., Crone, N. E., et al. (2012). Reconstructing speech from human auditory cortex. PLoS Biol. 10:e1001251. doi: 10.1371/journal.pbio.1001251
44. Patel, A. D. (2008). Music, Language, and the Brain. New York, NY: Oxford University Press.
45. Peelle, J. E., Gross, J., and Davis, M. H. (2013). Phase-locked responses to speech in human auditory cortex are enhanced during comprehension. Cereb. Cortex 23, 1378-1387. doi: 10.1093/cercor/bhs118
46. Pellegrino, F., Coupé, C., and Marsico, E. (2011). Across-language perspective on speech information rate. Language 87, 539-558. doi: 10.1353/lan.2011.0057
47. Peña, M., and Melloni, L. (2012). Brain oscillations during spoken sentence processing. J. Cogn. Neurosci. 24, 1149-1164. doi: 10.1162/jocn_a_00144
48. Picton, T. W. (2007). "Audiometry using auditory steady-state responses, " in Auditory Evoked Potentials: Basic Principles and Clinical Application, eds. R. F. Burkard, J. J. Eggermont, and M. Don (Baltimore: Lippincott Williams & Wilkins), 441-462.
49. Picton, T. W., Skinner, C. R., Champagne, S. C., Kellett, A. J. C., and Maiste, A. C. (1987). Potentials evoked by the sinusoidal modulation of the amplitude or frequency of a tone. J. Acoust. Soc. Am. 82, 165-178. doi: 10.1121/1.395560
50. Power, A. J., Foxe, J. J., Forde, E. J., Reilly, R. B., and Lalor, E. C. (2012). At what time is the cocktail party? A late locus of selective attention to natural speech. Eur. J. Neurosci. 35, 1497-1503. doi: 10.1111/j.1460-9568.2012.08060.x
51. Power, A. J., Lalor, E. C., and Reilly, R. B. (2010). Endogenous auditory spatial attention modulates obligatory sensory activity in auditory cortex. Cereb. Cortex 21, 1223-1230. doi: 10.1093/cercor/bhq233
52. Prendergast, G., Johnson, S. R., and Green, G. G. (2010). Temporal dynamics of sinusoidal and non-sinusoidal amplitude modulation. Eur. J. Neurosci. 32, 1599-1607. doi: 10.1111/j.1460-9568.2010.07423.x
53. Rosen, S. (1992). Temporal information in speech: acoustic, auditory and linguistic aspects. Philos. Trans. R. Soc. Lond. B Biol. Sci. 336, 367-373. doi: 10.1098/rstb.1992.0070
54. Ross, B., Borgmann, C., Draganova, R., Roberts, L. E., and Pantev, C. (2000). A high-precision magnetoencephalographic study of human auditory steady-state responses to amplitude-modulated tones. J. Acoust. Soc. Am. 108, 679-691. doi: 10.1121/1.429600
55. Ruggles, D., Bharadwaj, H., and Shinn-Cunningham, B. G. (2011). Normal hearing is not enough to guarantee robust encoding of suprathreshold features important in everyday communication. Proc. Natl. Acad. Sci. U.S.A. 108, 15516-15521. doi: 10.1073/pnas.1108912108
56. Schroeder, C. E., and Lakatos, P. (2009). Low-frequency neuronal oscillations as instruments of sensory selection. Trends Neurosci. 32, 9-18. doi: 10.1016/j.tins.2008.09.012
57. Schroeder, C. E., Lakatos, P., Kajikawa, Y., Partan, S., and Puce, A. (2008). Neuronal oscillations and visual amplification of speech. Trends Cogn. Sci. 12, 106-113. doi: 10.1016/j.tics.2008.01.002
58. Shamma, S. (2001). On the role of space and time in auditory processing. Trends Cogn. Sci. 5, 340-348. doi: 10.1016/S1364-6613(00)01704-6
59. Shamma, S. A., Elhilali, M., and Micheyl, C. (2011). Temporal coherence and attention in auditory scene analysis. Trends Neurosci. 34, 114-123. doi: 10.1016/j.tins.2010.11.002
60. Shannon, R. V., Zeng, F.-G., Kamath, V., Wygonski, J., and Ekelid, M. (1995). Speech recognition with primarily temporal cues. Science 270, 303-304. doi: 10.1126/science.270.5234.303
61. Steinschneider, M., Nourski, K. V., and Fishman, Y. I. (2013). Representation of speech in human auditory cortex: is it special? Hear. Res. 305, 57-73. doi: 10.1016/j.heares.2013.05.013
62. Stevens, K. N. (2002). Toward a model for lexical access based on acoustic landmarks and distinctive features. J. Acoust. Soc. Am. 111, 1872-1891. doi: 10.1121/1.1458026
63. Walker, K. M., Bizley, J. K., King, A. J., and Schnupp, J. W. (2011). Multiplexed and robust representations of sound features in auditory cortex. J. Neurosci. 31, 14565-14576. doi: 10.1523/JNEUROSCI.2074-11.2011
64. Wang, D. (2005). "On ideal binary mask as the computational goal of auditory scene analysis, " in Speech Separation By Humans and Machines, ed. P. Divenyi (New York: Springer), 181-197.
65. Wang, X., Lu, T., and Liang, L. (2003). Cortical processing of temporal modulations. Speech Commun. 41, 107-121. doi: 10.1016/S0167-6393(02)00097-3
66. Wang, Y., Ding, N., Ahmar, N., Xiang, J., Poeppel, D., and Simon, J. Z. (2012). Sensitivity to temporal modulation rate and spectral bandwidth in the human auditory system: MEG evidence. J. Neurophysiol. 107, 2033-2041. doi: 10.1152/jn.00310.2011
67. Wild, C. J., Yusuf, A., Wilson, D. E., Peelle, J. E., Davis, M. H., and Johnsrude, I. S. (2012). Effortful listening: the processing of degraded speech depends critically on attention. J. Neurosci. 32, 14010-14021. doi: 10.1523/JNEUROSCI.1528-12.2012
68. Woodfield, A., and Akeroyd, M. A. (2010). The role of segmentation difficulties in speech-in-speech understanding in older and hearing-impaired adults. J. Acoust. Soc. Am. 128, EL26-EL31. doi: 10.1121/1.3443570
69. Xiang, J., Simon, J., and Elhilali, M. (2010). Competing streams at the cocktail Party: exploring the mechanisms of attention and temporal integration. J. Neurosci. 30, 12084-12093. doi: 10.1523/JNEUROSCI.0827-10.2010
70. Yang, X., Wang, K., and Shamma, S. A. (1992). Auditory representations of acoustic signals. IEEE Trans. Inf. Theory38, 824-839. doi: 10.1109/18.119739
71. Zacharias, N., König, R., and Heil, P. (2012). Stimulation-history effects on the M100 revealed by its differential dependence on the stimulus onset interval. Psychophysiology 49, 909-919. doi: 10.1111/j.1469-8986.2012.01370.x
72. Zion Golumbic, E. M., Ding, N., Bickel, S., Lakatos, P., Schevon, C. A., Mckhann, G. M., et al. (2013). Mechanisms underlying selective neuronal tracking of attended speech at a "cocktail party". Neuron 77, 980-991. doi: 10.1016/j.neuron.2012.12.037
73. Zion Golumbic, E. M., Poeppel, D., and Schroeder, C. E. (2012). Temporal context in speech processing and attentional stream selection: a behavioral and neural perspective. Brain Lang. 122, 151-161. doi: 10.1016/j.bandl.2011.12.010