Cortical tracking of hierarchical linguistic structures in connected speech

Nature Neuroscience

Volumn 19, Issue 1, 2015, Pages 158-164

  Ding, Nai ^a,b   Melloni, Lucia ^c,d,e   Zhang, Hang ^a,f,g   Tian, Xing ^a,h   Poeppel, David ^a,i  

^a NEW YORK UNIVERSITY   (United States)

^b ZHEJIANG UNIVERSITY   (China)

^c NEW YORK UNIVERSITY MEDICAL CENTER   (United States)

^d MAX PLANCK INSTITUTE FOR BRAIN RESEARCH   (Germany)

^e Och Spine at New York Presbyterian Hospitals   (United States)

^f PEKING UNIVERSITY   (China)

^g Tsinghua University   (China)

^h NEW YORK UNIVERSITY SHANGHAI   (China)

ⁱ MAX PLANCK INSTITUTE FOR EMPIRICAL AESTHETICS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; BRAIN CORTEX; CHINESE; COMPREHENSION; CONTROLLED STUDY; ELECTROCORTICOGRAPHY; FEMALE; GRAMMAR; HUMAN; HUMAN EXPERIMENT; LANGUAGE PROCESSING; LEARNING; LINGUISTICS; MAGNETOENCEPHALOGRAPHY; MALE; NERVE CELL; NERVE POTENTIAL; NORMAL HUMAN; PRIORITY JOURNAL; SPEECH; LANGUAGE; MIDDLE AGED; NERVE CELL NETWORK; PHYSIOLOGY; PROCEDURES; SPEECH PERCEPTION; TIME FACTOR; YOUNG ADULT;

ADULT; CEREBRAL CORTEX; COMPREHENSION; ELECTROCORTICOGRAPHY; FEMALE; HUMANS; LANGUAGE; LINGUISTICS; MAGNETOENCEPHALOGRAPHY; MALE; MIDDLE AGED; NERVE NET; SPEECH; SPEECH PERCEPTION; TIME FACTORS; YOUNG ADULT;

EID: 84953836282     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.4186     Document Type: Article

References (58)

1. Berwick R.C., Friederici A.D., Chomsky N., & Bolhuis J.J. Evolution, brain, and the nature of language. Trends Cogn. Sci. 17, 89-98 (2013).
2. Chomsky N. Syntactic Structures (Mouton de Gruyter, 1957).
3. Phillips C. Linear order and constituency. Linguist. Inq. 34, 37-90 (2003).
4. Bemis D.K., & Pylkkänen L. Basic linguistic composition recruits the left anterior temporal lobe and left angular gyrus during both listening and reading. Cereb. Cortex. 23, 1859-1873 (2013).
5. Giraud A.-L., & Poeppel D. Cortical oscillations and speech processing: emerging computational principles and operations. Nat. Neurosci. 15, 511-517 (2012).
6. Sanders L.D., Newport E.L., & Neville H.J. Segmenting nonsense: an event-related potential index of perceived onsets in continuous speech. Nat. Neurosci. 5, 700-703 (2002).
7. Bastiaansen M., Magyari L., & Hagoort P. Syntactic unification operations are reflected in oscillatory dynamics during on-line sentence comprehension. J. Cogn. Neurosci. 22, 1333-1347 (2010).
8. Buiatti M., Peña M., & Dehaene-Lambertz G. Investigating the neural correlates of continuous speech computation with frequency-Tagged neuroelectric responses. Neuroimage. 44, 509-519 (2009).
9. Pallier C., Devauchelle A.-D., & Dehaene S. Cortical representation of the constituent structure of sentences. Proc. Natl. Acad. Sci. USA. 108, 2522-2527 (2011).
10. Schroeder C.E., Lakatos P., Kajikawa Y., Partan S., & Puce A. Neuronal oscillations and visual amplification of speech. Trends Cogn. Sci. 12, 106-113 (2008).
11. Buzsáki G. Neural syntax: cell assemblies, synapsembles and readers. Neuron. 68, 362-385 (2010).
12. Bernacchia A., Seo H., Lee D., & Wang X.-J. A reservoir of time constants for memory traces in cortical neurons. Nat. Neurosci. 14, 366-372 (2011).
13. Lerner Y., Honey C.J., Silbert L.J., & Hasson U. Topographic mapping of a hierarchy of temporal receptive windows using a narrated story. J. Neurosci. 31, 2906-2915 (2011).
14. Kiebel S.J., Daunizeau J., & Friston K.J. A hierarchy of time-scales and the brain. PLoS Comput. Biol. 4, e1000209 (2008).
15. Luo H., & Poeppel D. Phase patterns of neuronal responses reliably discriminate speech in human auditory cortex. Neuron. 54, 1001-1010 (2007).
16. Ding N., & Simon J.Z. Emergence of neural encoding of auditory objects while listening to competing speakers. Proc. Natl. Acad. Sci. USA. 109, 11854-11859 (2012).
17. Zion Golumbic E.M., et al. Mechanisms underlying selective neuronal tracking of attended speech at a "cocktail party". Neuron. 77, 980-991 (2013).
18. Peelle J.E., Gross J., & Davis M.H. Phase-locked responses to speech in human auditory cortex are enhanced during comprehension. Cereb. Cortex. 23, 1378-1387 (2013).
19. Pasley B.N., et al. Reconstructing speech from human auditory cortex. PLoS Biol. 10, e1001251 (2012).
20. Steinhauer K., Alter K., & Friederici A.D. Brain potentials indicate immediate use of prosodic cues in natural speech processing. Nat. Neurosci. 2, 191-196 (1999).
21. Peña M., Bonatti L.L., Nespor M., & Mehler J. Signal-driven computations in speech processing. Science. 298, 604-607 (2002).
22. Saffran J.R., Aslin R.N., & Newport E.L. Statistical learning by 8-month-old infants. Science. 274, 1926-1928 (1996).
23. Ray S., & Maunsell J.H. Different origins of gamma rhythm and high-gamma activity in macaque visual cortex. PLoS Biol. 9, e1000610 (2011).
24. Einevoll G.T., Kayser C., Logothetis N.K., & Panzeri S. Modeling and analysis of local field potentials for studying the function of cortical circuits. Nat. Rev. Neurosci. 14, 770-785 (2013).
25. Hagoort P., & Indefrey P. The neurobiology of language beyond single words. Annu. Rev. Neurosci. 37, 347-362 (2014).
26. Grodzinsky Y., & Friederici A.D. Neuroimaging of syntax and syntactic processing. Curr. Opin. Neurobiol. 16, 240-246 (2006).
27. Hickok G., & Poeppel D. The cortical organization of speech processing. Nat. Rev. Neurosci. 8, 393-402 (2007).
28. Friederici A.D., Meyer M., & von Cramon D.Y. Auditory language comprehension: an event-related fMRI study on the processing of syntactic and lexical information. Brain Lang. 74, 289-300 (2000).
29. Canolty R.T., et al. High gamma power is phase-locked to theta oscillations in human neocortex. Science. 313, 1626-1628 (2006).
30. Lakatos P., et al. An oscillatory hierarchy controlling neuronal excitability and stimulus processing in the auditory cortex. J. Neurophysiol. 94, 1904-1911 (2005).
31. Sirota A., Csicsvari J., Buhl D., & Buzsáki G. Communication between neocortex and hippocampus during sleep in rodents. Proc. Natl. Acad. Sci. USA. 100, 2065-2069 (2003).
32. Arnal L.H., & Giraud A.-L. Cortical oscillations and sensory predictions. Trends Cogn. Sci. 16, 390-398 (2012).
33. Poeppel D., Idsardi W.J., & van Wassenhove V. Speech perception at the interface of neurobiology and linguistics. Phil. Trans. R. Soc. Lond. B. 363, 1071-1086 (2008).
34. Peña M., & Melloni L. Brain oscillations during spoken sentence processing. J. Cogn. Neurosci. 24, 1149-1164 (2012).
35. Gross J., et al. Speech rhythms and multiplexed oscillatory sensory coding in the human brain. PLoS Biol. 11, e1001752 (2013).
36. Ding N., & Simon J.Z. Cortical entrainment to continuous speech: functional roles and interpretations. Front. Hum. Neurosci. 8, 311 (2014).
37. Jackendoff R. Foundations of Language: Brain, Meaning, Grammar, Evolution (Oxford University Press, 2002).
38. Hagoort P. On Broca, brain, and binding: a new framework. Trends Cogn. Sci. 9, 416-423 (2005).
39. Cutler A., Dahan D., & van Donselaar W. Prosody in the comprehension of spoken language: a literature review. Lang. Speech. 40, 141-201 (1997).
40. Frazier L., Carlson K., & Clifton C. Jr. Prosodic phrasing is central to language comprehension. Trends Cogn. Sci. 10, 244-249 (2006).
41. Singer W., & Gray C.M. Visual feature integration and the temporal correlation hypothesis. Annu. Rev. Neurosci. 18, 555-586 (1995).
42. Friederici A.D. Towards a neural basis of auditory sentence processing. Trends Cogn. Sci. 6, 78-84 (2002).
43. Kutas M., & Federmeier K.D. Electrophysiology reveals semantic memory use in language comprehension. Trends Cogn. Sci. 4, 463-470 (2000).
44. Neville H., Nicol J.L., Barss A., Forster K.I., & Garrett M.F. Syntactically based sentence processing classes: evidence from event-related brain potentials. J. Cogn. Neurosci. 3, 151-165 (1991).
45. Lau E.F., Phillips C., & Poeppel D. A cortical network for semantics: (de)constructing the N400. Nat. Rev. Neurosci. 9, 920-933 (2008).
46. Halgren E., et al. N400-like magnetoencephalography responses modulated by semantic context, word frequency and lexical class in sentences. Neuroimage. 17, 1101-1116 (2002).
47. Van Petten C., & Kutas M. Interactions between sentence context and word frequency in event-related brain potentials. Mem. Cognit. 18, 380-393 (1990).
48. Oconnell R.G., Dockree P.M., & Kelly S.P. A supramodal accumulation-To-bound signal that determines perceptual decisions in humans. Nat. Neurosci. 15, 1729-1735 (2012).
49. Koechlin E., Ody C., & Kouneiher F. The architecture of cognitive control in the human prefrontal cortex. Science. 302, 1181-1185 (2003).
50. Nozaradan S., Peretz I., Missal M., & Mouraux A. Tagging the neuronal entrainment to beat and meter. J. Neurosci. 31, 10234-10240 (2011).
51. Oldfield R.C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia. 9, 97-113 (1971).
52. de Cheveigné A., & Simon J.Z. Denoising based on time-shift PCA. J. Neurosci. Methods. 165, 297-305 (2007).
53. de Cheveigné A., & Simon J.Z. Denoising based on spatial filtering. J. Neurosci. Methods. 171, 331-339 (2008).
54. Ding N., & Simon J.Z. Adaptive temporal encoding leads to a background-insensitive cortical representation of speech. J. Neurosci. 33, 5728-5735 (2013).
55. Ding N., & Simon J.Z. Neural coding of continuous speech in auditory cortex during monaural and dichotic listening. J. Neurophysiol. 107, 78-89 (2012).
56. Wang Y., et al. Sensitivity to temporal modulation rate and spectral bandwidth in the human auditory system: MEG evidence. J. Neurophysiol. 107, 2033-2041 (2012).
57. Efron B., & Tibshirani R. An Introduction to the Bootstrap (CRC press, 1993).
58. Yang A.I., et al. Localization of dense intracranial electrode arrays using magnetic resonance imaging. Neuroimage. 63, 157-165 (2012).