Grounding language processing on basic neurophysiological principles

Trends in Cognitive Sciences

Volumn 19, Issue 6, 2015, Pages 329-338

  Friederici, Angela D ^a   Singer, Wolf ^b,c,d  

^a MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

^b MAX PLANCK INSTITUTE FOR BRAIN RESEARCH   (Germany)

^c ERNST STRÜNGMANN INSTITUTE ESI FOR NEUROSCIENCE IN COOPERATION WITH MAX PLANCK SOCIETY   (Germany)

^d FRANKFURT INSTITUTE FOR ADVANCED STUDIES   (Germany)

Author keywords

Language; Neural networks; Oscillation

Indexed keywords

NEURAL NETWORKS;

COGNITIVE FUNCTIONS; DISTRIBUTED COMPUTATIONS; FUNCTIONAL NETWORK; GROUNDING LANGUAGE; HIERARCHICAL LEVEL; LANGUAGE; LARGE-SCALE DYNAMICS; OSCILLATION;

BRAIN;

ANIMAL COMMUNICATION; AUDITORY CORTEX; BRAIN CORTEX; COGNITION; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; LANGUAGE DEVELOPMENT; LANGUAGE PROCESSING; MEDIAL TEMPORAL LOBE; NERVE CELL; NERVE POTENTIAL; NEUROPHYSIOLOGY; NONHUMAN; RESTING STATE NETWORK; REVIEW; SEMANTIC MEMORY; SOMATOSENSORY CORTEX; SOUND ANALYSIS; SUPERIOR TEMPORAL GYRUS; ANIMAL; BRAIN; LANGUAGE; NERVE TRACT; PERIODICITY; PHYSIOLOGY;

ANIMALS; BRAIN; HUMANS; LANGUAGE; NEURAL PATHWAYS; NEURONS; PERIODICITY;

EID: 84931576534     PISSN: 13646613     EISSN: 1879307X     Source Type: Journal    
DOI: 10.1016/j.tics.2015.03.012     Document Type: Review

References (142)

1. Broca P. Remarques sur le siége de la faculté du langage articulé, suivies d'une observation d'aphémie (parte de la parole). Bull. Soc. Anat. (Paris) 1861, 6:330-357. (in French).
2. Wernicke C. Der Aphasische Symptomencomplex 1874, Springer Verlag, (in German).
3. Hauser M.D., et al. The faculty of language: what is it, who has it, and how did it evolve?. Science 2002, 298:1569-1579.
4. Berwick R.C., et al. Evolution, brain and the nature of language. Trends Cogn. Sci. 2013, 17:89-98.
5. Darwin C.R. The Descent of Man, and Selection in Relation to Sex 1871, D. Appleton.
6. Deacon T. The Symbolic Species 1997, W.W. Norton.
7. Fitch W.T. The Evolution of Language 2010, Cambridge University Press.
8. Friederici A.D. The brain basis of language processing: from structure to function. Physiol. Rev. 2011, 91:1357-1392.
9. Balaban E., et al. Dynamic coordination in the brain - evolution of dynamic coordination. Dynamic Coordination in the Brain. From Neurons to Mind 2010, 59-82. MIT Press and FIAS. C. Von der Malsburg (Ed.).
10. Douglas R.J., Martin K.A.C. Neuronal circuits of the neocortex. Annu. Rev. Neurosci. 2004, 27:419-451.
11. Markov N.T., Kennedy H. The importance of being hierarchical. Curr. Opin. Neurobiol. 2013, 23:187-194.
12. Bullmore E., Sporns O. Complex brain networks: graph theoretical analysis of structural and functional systems. Nat. Rev. Neurosci. 2009, 10:186-198.
13. Sharma J., et al. Induction of visual orientation modules in auditory cortex. Nature 2000, 404:841-847.
14. Singer W. Cortical dynamics revisited. Trends Cogn. Sci. 2013, 17:616-626.
15. Emmorey K. The psycholinguistics of signed and spoken languages: how biology affects processing. The Oxford Handbook of Psycholinguistics 2007, 703-721. Oxford University Press. G. Gaskell (Ed.).
16. Fitch W.T., Hauser M.D. Computational constraints on syntactic processing in a nonhuman primate. Science 2004, 303:377-380.
17. Gentner T.Q., et al. Recursive syntactic pattern learning by songbirds. Nature 2006, 440:1204-1207.
18. Wilson B., et al. Auditory artificial grammar learning in macaque and marmoset monkeys. J. Neurosci. 2013, 33:18825-18835.
19. Abe K., Watanabe D. Songbirds possess the spontaneous ability to discriminate syntactic rules. Nat. Neurosci. 2011, 14:1067-1074.
20. Beckers G.J.L., et al. Birdsong neurolinguistics: songbird context-free grammar claim is premature. Neuroreport 2012, 23:139-145.
21. Berwick R.C., et al. A bird's eye view of human language evolution. Front. Evol. Neurosci. 2012, 4:5.
22. Petkov C.I., Jarvis E. Birds, primates, and spoken language origins: behavioral phenotypes and neurobiological substrates. Front. Evol. Neurosci. 2012, 4:12.
23. Chomsky N. Problems of projection. Lingua 2013, 130:33-49.
24. Tankus A., et al. Structured neuronal encoding and decoding of human speech features. Nat. Commun. 2012, 3:1015.
25. Mesgarani N., et al. Phonetic feature encoding in human superior temporal gyrus. Science 2014, 343:1006-1010.
26. Quian Quiroga R., et al. Invariant visual representation by single neurons in the human brain. Nature 2005, 435:1102-1107.
27. Hirabayashi T., Miyashita Y. Dynamically modulated spike correlation in monkey inferior temporal cortex depending on the feature configuration within a whole object. J. Neurosci. 2005, 25:10299-10307.
28. Rabinovich M., et al. Transient dynamics for neural processing. Science 2008, 321:48-50.
29. Gentner T.Q., Margoliash D. Neuronal populations and single cells representing learned auditory objects. Nature 2003, 424:669-674.
30. Singer W. Neuronal synchrony: a versatile code for the definition of relations?. Neuron 1999, 24:49-65.
31. Churchland M.M., et al. Neural population dynamics during reaching. Nature 2012, 487:51-56.
32. Georgopoulos A.P., et al. Neuronal population coding of movement direction. Science 1986, 233:1416-1419.
33. Hubel D.H., Wiesel T.N. Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J. Physiol. 1962, 160:106-154.
34. Recanzone G.H., et al. Correlation between the activity of single auditory cortical neurons and sound-localization behavior in the macaque monkey. J. Neurophysiol. 2000, 83:2723-2739.
35. Mountcastle V.B. Modality and topographic properties of single neurons of cat's somatic sensory cortex. J. Neurophysiol. 1957, 20:408-434.
36. Vinje W.E., Gallant J.L. Sparse coding and decorrelation in primary visual cortex during natural vision. Science 2000, 287:1273-1276.
37. David S.V., et al. Natural stimulus statistics alter the receptive field structure of V1 neurons. J. Neurosci. 2004, 24:6991-7006.
38. Buschman T.J., et al. Synchronous oscillatory neural ensembles for rules in the prefrontal cortex. Neuron 2012, 76:838-846.
39. Olshausen B.A., Field D.J. Sparse coding of sensory inputs. Curr. Opin. Neurobiol. 2004, 14:481-487.
40. Sajin S.M., Connine C.M. Semantic richness: the role of semantic features in processing spoken words. J. Mem. Lang. 2014, 70:13-35.
41. Li X., et al. Mental representation of verb meaning: behavioral and electrophysiological evidence. J. Cogn. Neurosci. 2006, 18:1774-1787.
42. Levelt W.J.M., et al. The time course of lexical access in speech production - a study of picture naming. Psychol. Rev. 1991, 98:122-142.
43. Maess B., et al. Semantic category interference in overt picture naming: sharpening current density localization by PCA. J. Cogn. Neurosci. 2002, 14:455-462.
44. Tyler L.K., et al. Processing objects at different levels of specificity. J. Cogn. Neurosci. 2004, 16:351-362.
45. Halle M. On distinctive features and their articulatory implementation. Nat. Lang. Linguist. Theory 1983, 1:91-105.
46. Pulvermüller F., et al. Nouns and verbs in the intact brain: evidence from event-related potentials and high-frequency cortical responses. Cereb. Cortex 1999, 9:497-506.
47. Giraud A.L., Poeppel D. Cortical oscillations and speech processing: emerging computational principles and operations. Nat. Neurosci. 2012, 15:511-517.
48. Waydo S., et al. Sparse representation in the human medial temporal lobe. J. Neurosci. 2006, 26:10232-10234.
49. Gray C.M., et al. Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties. Nature 1989, 338:334-337.
50. Singer W. Distributed processing and temporal codes in neuronal networks. Cogn. Neurodyn. 2009, 3:189-196.
51. Salazar R.F., et al. Content-specific fronto-parietal synchronization during visual working memory. Science 2012, 338:1097-1100.
52. Buzsáki G., et al. Scaling brain size, keeping timing: evolutionary preservation of brain rhythms. Neuron 2013, 80:751-764.
53. Steinmann S.S., et al. Conscious auditory perception related to long-range synchrony of gamma oscillations. Neuroimage 2014, 100:435-443.
54. Nourski K.V., et al. Functional organization of human auditory cortex: investigation of response latencies through direct recordings. Neuroimage 2014, 101:598-609.
55. Morillon B., et al. Neurophysiological origin of human brain asymmetry for speech and language. Proc. Natl. Acad. Sci. U.S.A. 2010, 107:18688-18693.
56. Bastiaansen M.C.M., et al. Theta responses are involved in lexical-semantic retrieval during language processing. J. Cogn. Neurosci. 2005, 17:530-541.
57. Hagoort P., et al. Integration of word meaning and world knowledge in language comprehension. Science 2004, 304:438-441.
58. Hald L.A., et al. EEG theta and gamma responses to semantic violations in online sentence processing. Brain Lang. 2006, 96:90-105.
59. Penolazzi B., et al. Gamma EEG activity induced by semantic violation during sentence reading. Neurosci. Lett. 2009, 465:74-78.
60. Obleser J., Kotz S.A. Multiple brain signatures of integration in the comprehension of degraded speech. Neuroimage 2011, 55:713-723.
61. Mellem M.S., et al. Gamma- and theta-band synchronization during semantic priming reflect local and long-range lexical-semantic networks. Brain Lang. 2013, 127:440-451.
62. Strauß A., et al. Alpha and theta brain oscillations index dissociable processes in spoken word recognition. Neuroimage 2014, 97:387-395.
63. Sarnthein J., et al. Synchronization between prefrontal and posterior association cortex during human working memory. Proc. Natl. Acad. Sci. U.S.A. 1998, 95:7092-7096.
64. Weiss S., Rappelsberger P. Long-range EEG synchronization during word encoding correlates with successful memory performance. Cogn. Brain Res. 2000, 9:299-312.
65. Fell J., et al. Medial temporal theta/alpha power enhancement precedes successful memory encoding: evidence based on intracranial EEG. J. Neurosci. 2011, 31:5392-5397.
66. Siapas A.G., et al. Prefrontal phase locking to hippocampal theta oscillations. Neuron 2005, 46:141-151.
67. Sigurdsson T., et al. Impaired hippocampal-prefrontal synchrony in a genetic mouse model of schizophrenia. Nature 2010, 464:763-767.
68. Sauseng P., et al. Fronto-parietal EEG coherence in theta and upper alpha reflect central executive functions of working memory. Int. J. Psychophysiol. 2005, 57:97-103.
69. Summerfield C., Mangels J.A. Coherent theta-band EEG activity predicts item-context binding during encoding. Neuroimage 2005, 24:692-703.
70. Roehm D., et al. The role of theta and alpha oscillations for language comprehension in the human electroencephalogram. Neurosci. Lett. 2001, 310:137-140.
71. Weiss S., Mueller H.M. The contribution of EEG coherence to the investigation of language. Brain Lang. 2003, 85:325-343.
72. Weiss S., et al. Increased neuronal communication accompanying sentence comprehension. Int. J. Psychophysiol. 2005, 57:129-141.
73. Bastiaansen M., et al. Syntactic unification operations are reflected in oscillatory dynamics during on-line sentence comprehension. J. Cogn. Neurosci. 2010, 22:1333-1347.
74. de Diego-Balaguer R., et al. Brain dynamics sustaining rapid rule extraction from speech. J. Cogn. Neurosci. 2011, 23:3105-3120.
75. Meyer L., et al. Left parietal alpha enhancement during working memory-intensive sentence processing. Cortex 2013, 49:711-721.
76. Meyer L., et al. Spatiotemporal dynamics of argument retrieval and reordering: an fMRI and EEG study on sentence processing. Front. Psychol. 2012, 3:523.
77. Canolty R.T., et al. High gamma power is phase-locked to theta oscillations in human neocortex. Science 2006, 313:1626-1628.
78. Aru J., et al. Untangling cross-frequency coupling in neuroscience. Curr. Opin. Neurobiol. 2015, 31:51-61.
79. Johnsrude I.S., et al. Functional imaging of the auditory system: the use of positron emission tomography. Audiol. Neurootol. 2002, 7:251-276.
80. Mummery C.J., et al. Functional neuroimaging of speech perception in six normal and two aphasic subjects. J. Acoust. Soc. Am. 1999, 106:449-457.
81. Binder J.R., et al. Human temporal lobe activation by speech and nonspeech sounds. Cereb. Cortex 2000, 10:512-528.
82. Hickok G., Poeppel D. The cortical organization of speech perception. Nat. Rev. Neurosci. 2007, 8:393-402.
83. Giraud A.L., et al. Endogenous cortical rhythms determine cerebral specialization for speech perception and production. Neuron 2007, 56:1127-1134.
84. Meyer M., et al. fMRI reveals brain regions mediating slow prosodic modulations in spoken sentences. Hum. Brain Mapp. 2002, 17:73-88.
85. Friederici A.D., Alter K. Lateralization of auditory language functions: a dynamic dual pathway model. Brain Lang. 2004, 89:267-276.
86. Patterson K., et al. Where do you know what you know? The representation of semantic knowledge in the human brain. Nat. Rev. Neurosci. 2007, 8:976-987.
87. Damasio H., et al. Neural systems behind word and concept retrieval. Cognition 2004, 92:179-229.
88. Binder J.R., et al. Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. Cereb. Cortex 2009, 19:2767-2796.
89. Vigneau M., et al. Meta-analyzing left hemisphere language areas: phonology, semantics, and sentence processing. Neuroimage 2006, 30:1414-1432.
90. Visser M., et al. Semantic processing in the anterior temporal lobes: a meta-analysis of the functional neuroimaging literature. J. Cogn. Neurosci. 2009, 22:1083-1094.
91. Obleser J., et al. Functional integration across brain regions improves speech perception under adverse listening conditions. J. Neurosci. 2007, 27:2283-2289.
92. Bornkessel I., et al. Who did what to whom? The neural basis of argument hierarchies during language comprehension. Neuroimage 2005, 26:221-233.
93. Thompson-Schill S.L., et al. Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. Proc. Natl. Acad. Sci. U.S.A. 1997, 94:14792-14797.
94. Fiez J.A. Phonology, semantics, and the role of the left inferior prefrontal cortex. Hum. Brain Mapp. 1997, 5:79-83.
95. Friederici A.D., Gierhan S.M.E. The language network. Curr. Opin. Neurobiol. 2013, 23:250-254.
96. Petersen S., Singer W. Macrocircuits. Curr. Opin. Neurobiol. 2013, 23:159-161.
97. Chomsky N. On binding. Linguist. Inq. 1980, 11:1-46.
98. Zaccarella E., Friederici A.D. Reflections of word processing in the insular cortex: a sub-regional parcellation based functional assessment. Brain Lang. 2015, 142:1-7.
99. Grodzinsky Y., Friederici A.D. Neuroimaging of syntax and syntactic processing. Curr. Opin. Neurobiol. 2006, 16:240-246.
100. Makuuchi M., et al. Segregating the core computational faculty of human language from working memory. Proc. Natl. Acad. Sci. U.S.A. 2009, 106:8362-8367.
101. Meyer M., et al. Distinct fMRI responses to laughter, speech, and sounds along the human peri-sylvian cortex. Cogn. Brain Res. 2005, 24:291-306.
102. den Ouden D-B., et al. Network modulation during complex syntactic processing. Neuroimage 2012, 59:815-823.
103. Makuuchi M., Friederici A.D. Hierarchical functional connectivity between the core language system and the working memory system. Cortex 2013, 49:2416-2423.
104. Skeide M., et al. Brain functional and structural predictors of language performance. Cereb. Cortex 2015, Published online March 13, 2015. 10.1093/cercor/bhv042.
105. Hickok G., Poeppel D. Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language. Cognition 2004, 92:67-99.
106. Rauschecker J.P., Scott S.K. Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing. Nat. Neurosci. 2009, 12:718-724.
107. Bornkessel-Schlesewsky I., et al. Neurobiological roots of language in primate audition: common computational properties. Trends Cogn. Sci. 2015, 19:142-150.
108. Ungerleider L.G., Mishkin M. Two cortical visual systems. Analysis of Visual Behavior 1982, 564-586. MIT Press. D.J. Ingle (Ed.).
109. Haxby J.V., et al. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 2001, 293:2425-2430.
110. Tsao D.Y., et al. Faces and objects in macaque cerebral cortex. Nat. Neurosci. 2003, 6:989-995.
111. Sporns O., et al. Theoretical neuroanatomy and the connectivity of the cerebral cortex. Behav. Brain Res. 2002, 135:69-74.
112. Tononi G., et al. Complexity and coherency: integrating information in the brain. Trends Cogn. Sci. 1998, 2:474-484.
113. Catani M., et al. Perisylvian language networks of the human brain. Ann. Neurol. 2005, 57:8-16.
114. Kelly C., et al. Broca's region: linking human brain functional connectivity data and non-human primate tracing anatomy studies. Eur. J. Neurosci. 2010, 32:383-398.
115. Thiebaut de Schotten M., et al. Monkey to human comparative anatomy of the frontal lobe association tracts. Cortex 2012, 48:82-96.
116. Weisz N., Obleser J. Synchronisation signatures in the listening brain: a perspective from non-invasive neuroelectrophysiology. Hear. Res. 2014, 307:16-28.
117. Deco G., et al. Emerging concepts for the dynamical organization of resting-state activity in the brain. Nat. Rev. Neurosci. 2011, 12:43-56.
118. Deco G., Jirsa V.K. Ongoing cortical activity at rest: criticality, multistability, and ghost attractors. J. Neurosci. 2012, 32:3366-3375.
119. Perani D., et al. The neural language networks at birth. Proc. Natl. Acad. Sci. U.S.A. 2011, 108:16056-16061.
120. Taubert M., et al. Long-term effects of motor training on resting-state networks and underlying brain structure. Neuroimage 2011, 57:1492-1498.
121. Fair D.A., et al. Development of distinct control networks through segregation and integration. Proc. Natl. Acad. Sci. U.S.A. 2007, 104:13507-13512.
122. Uhlhaas P.J., et al. The development of neural synchrony reflects late maturation and restructuring of functional networks in humans. Proc. Natl. Acad. Sci. U.S.A. 2009, 106:9866-9871.
123. Friederici A.D., et al. Maturation of the language network: from inter- to intrahemispheric connectivities. PLoS ONE 2011, 6:e20726.
124. Friederici A.D. Pathways to language: fiber tracts in the human brain. Trends Cogn. Sci. 2009, 13:175-181.
125. Clark A. Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behav. Brain Sci. 2013, 36:181-204.
126. Friederici A.D., et al. The brain differentiates human and non-human grammars: functional localization and structural connectivity. Proc. Natl. Acad. Sci. U.S.A. 2006, 103:2458-2463.
127. Sanides F. Architectonics of the human frontal lobe of the brain. With a demonstration of the principles of its formation as a reflection of phylogenetic differentiation of the cerebral cortex. Monogr. Gesamtgeb. Neurol. Psychiatr. 1962, 98:1-201.
128. Amunts K., Zilles K. Architecture and organizational principles of Broca's region. Trends Cogn. Sci. 2012, 16:418-426.
129. Bolhuis J.J., et al. Twitter evolution: converging mechanisms in birdsong and human speech. Nat. Rev. Neurosci. 2010, 11:747-759.
130. Bierwisch M. Formal and lexical semantics. Linguist. Ber. 1982, 80:3-17.
131. Collins A.M., Loftus E.F. Spreading activation theory of semantic processing. Physiol. Rev. 1975, 82:407-428.
132. Miller G.A. Semantic relations among words. Linguistic Theory and Psychological Reality 1978, 60-118. MIT Press. M. Halle (Ed.).
133. Jackendoff R. Semantics and Cognition 1983, MIT Press.
134. Pustejovsky J. The Generative Lexicon 1995, MIT Press.
135. Lakoff G. Women, Fire, and Dangerous Things. What Categories Reveal about the Mind 1987, University of Chicago Press.
136. Beckmann C.F., et al. Investigations into resting-state connectivity using independent component analysis. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 2005, 360:1001-1013.
137. Fox M.D., Raichle M.E. Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging. Nat. Rev. Neurosci. 2007, 8:700-711.
138. Buckner R.L., Vincent J.L. Unrest at rest: default activity and spontaneous network correlations. Neuroimage 2007, 37:1091-1096.
139. Raichle M.E., Snyder A.Z. A default mode of brain function: a brief history of an evolving idea. Neuroimage 2007, 37:1083-1090.
140. Greicius M.D., et al. Persistent default-mode network connectivity during light sedation. Hum. Brain Mapp. 2008, 29:839-847.
141. Lohmann G., et al. Setting the frame: the human brain activates a basic low-frequency network for language processing. Cereb. Cortex 2010, 20:1286-1292.
142. Mnih V., et al. Human-level control through deep reinforcement learning. Nature 2014, 518:529-533.