Real-Time Parallel Processing of Grammatical Structure in the Fronto-Striatal System: A Recurrent Network Simulation Study Using Reservoir Computing

PLoS ONE

Volumn 8, Issue 2, 2013, Pages

  Hinaut, Xavier ^a,b   Dominey, Peter Ford ^a,b  

^a STEM CELL AND BRAIN RESEARCH INSTITUTE   (France)

^b UNIVERSITÉ LYON 1   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BRAIN FUNCTION; BRAIN REGION; BRAIN SIZE; BRODMANN AREA 47; CORPUS STRIATUM; DISCOURSE ANALYSIS; EVOKED CORTICAL RESPONSE; FRONTAL CORTEX; GRAMMAR; LANGUAGE PROCESSING; MATHEMATICAL COMPUTING; NERVE CELL NETWORK; NERVE CELL PLASTICITY; NEUROPHYSIOLOGY; ONLINE SYSTEM; PREDICTION; PREFRONTAL CORTEX; SIGNAL NOISE RATIO; SIMULATION; SYNAPSE;

ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; CORPUS STRIATUM; FRONTAL LOBE; HUMANS; NEURAL NETWORKS (COMPUTER); SEMANTICS; SPEECH PERCEPTION;

EID: 84873259375     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0052946     Document Type: Article

References (72)

1. Friederici AD, Bahlmann J, Heim S, Schubotz RI, Anwander A, (2006) The brain differentiates human and non-human grammars: functional localization and structural connectivity. Proc Natl Acad Sci U S A 103: 2458-2463.
2. Friederici AD, Mecklinger A, Spencer KM, Steinhauer K, Donchin E, (2001) Syntactic parsing preferences and their on-line revisions: a spatio-temporal analysis of event-related brain potentials. Brain Res Cogn Brain Res 11: 305-323.
3. Hagoort P, (2008) The fractionation of spoken language understanding by measuring electrical and magnetic brain signals. Philos Trans R Soc Lond B Biol Sci 363: 1055-1069.
4. Hagoort P, van Berkum J, (2007) Beyond the sentence given. Philos Trans R Soc Lond B Biol Sci 362: 801-811.
5. Van Berkum JJ, Brown CM, Zwitserlood P, Kooijman V, Hagoort P, (2005) Anticipating upcoming words in discourse: evidence from ERPs and reading times. J Exp Psychol Learn Mem Cogn 31: 443-467.
6. Moro A, Tettamanti M, Perani D, Donati C, Cappa SF, et al. (2001) Syntax and the brain: disentangling grammar by selective anomalies. Neuroimage 13: 110-118.
7. Friederici AD, Kotz SA, (2003) The brain basis of syntactic processes: functional imaging and lesion studies. Neuroimage 20: S8-S17.
8. Hochstadt J, Nakano H, Lieberman P, Friedman J, (2006) The roles of sequencing and verbal working memory in sentence comprehension deficits in Parkinson's disease. Brain Lang 97: 243-257.
9. Ullman MT, (2004) Contributions of memory circuits to language: the declarative/procedural model. Cognition 92: 231-270.
10. Ullman MT, (2001) A neurocognitive perspective on language: the declarative/procedural model. Nat Rev Neurosci 2: 717-726.
11. Friederici AD, Kotz SA, Werheid K, Hein G, von Cramon DY, (2003) Syntactic comprehension in Parkinson's disease: investigating early automatic and late integrational processes using event-related brain potentials. Neuropsychology 17: 133-142.
12. Frisch S, Kotz SA, von Cramon DY, Friederici AD, (2003) Why the P600 is not just a P300: the role of the basal ganglia. Clin Neurophysiol 114: 336-340.
13. Hagoort P, (2003) Interplay between syntax and semantics during sentence comprehension: ERP effects of combining syntactic and semantic violations. J Cogn Neurosci 15: 883-899.
14. Hagoort P, Brown CM, (2000) ERP effects of listening to speech compared to reading: the P600/SPS to syntactic violations in spoken sentences and rapid serial visual presentation. Neuropsychologia 38: 1531-1549.
15. Kotz SA, Frisch S, von Cramon DY, Friederici AD, (2003) Syntactic language processing: ERP lesion data on the role of the basal ganglia. J Int Neuropsychol Soc 9: 1053-1060.
16. Service E, Helenius P, Maury S, Salmelin R (2007) Localization of syntactic and semantic brain responses using magnetoencephalography. J Cogn Neurosci 19: 1193-1205.
17. Van Hoesen GW, Yeterian EH, Lavizzo-Mourey R, (1981) Widespread corticostriate projections from temporal cortex of the rhesus monkey. J Comp Neurol 199: 205-219.
18. Chevalier G, Deniau JM, (1990) Disinhibition as a basic process in the expression of striatal functions. Trends Neurosci 13: 277-280.
19. Yeterian EH, Pandya DN, (1989) Thalamic connections of the cortex of the superior temporal sulcus in the rhesus monkey. J Comp Neurol 282: 80-97.
20. Toni I, Rowe J, Stephan KE, Passingham RE, (2002) Changes of cortico-striatal effective connectivity during visuomotor learning. Cereb Cortex 12: 1040-1047.
21. Gibson E, (1998) Linguistic complexity: locality of syntactic dependencies. Cognition 68: 1-76.
22. Gibson E, Pearlmutter NJ, (2000) Distinguishing serial and parallel parsing. J Psycholinguist Res 29: 231-240.
23. Dominey PF, Hoen M, (2006) Structure mapping and semantic integration in a construction-based neurolinguistic model of sentence processing. Cortex 42: 476-479.
24. Dominey PF, Hoen M, Blanc JM, Lelekov-Boissard T, (2003) Neurological basis of language and sequential cognition: evidence from simulation, aphasia, and ERP studies. Brain Lang 86: 207-225.
25. Dominey PF, Hoen M, Inui T, (2006) A neurolinguistic model of grammatical construction processing. J Cogn Neurosci 18: 2088-2107.
26. Dominey PF, Inui T, (2009) Cortico-striatal function in sentence comprehension: insights from neurophysiology and modeling. Cortex 45: 1012-1018.
27. Dominey PF, Inui T, Hoen M, (2009) Neural network processing of natural language: II. Towards a unified model of corticostriatal function in learning sentence comprehension and non-linguistic sequencing. Brain & Language 109: 80-92.
28. Dominey PF, Ramus F, (2000) Neural network processing of natural language: I. Sensitivity to serial, temporal and abstract structure of language in the infant. Language and Cognitive Processes 15: 87-127.
29. Hinaut X, Dominey P (2012) On-Line Processing of Grammatical Structure Using Reservoir Computing. In: Villa A, Duch W, Érdi P, Masulli F, Palm G, editors. ICANN 2012 - Lecture Notes in Computer Science: Springer Berlin/Heidelberg. 596-603.
30. Goldberg A (1995) Constructions: A Construction Grammar Approach to Argument Structure; Fauconnier G, Lakoff G, Sweetser E, editors. Chicago: University of Chicago Press. 265 p.
31. Dominey P, Boucher J, (2005) Learning to talk about events from narrated video in a construction grammar framework. Artificial Intelligence 167: 31-61.
32. Bates E, Wulfeck B, MacWhinney B, (1991) Cross-linguistic research in aphasia: an overview. Brain Lang 41: 123-148.
33. Bates E, McNew S, MacWhinney B, Devescovi A, Smith S, (1982) Functional constraints on sentence processing: a cross-linguistic study. Cognition 11: 245-299.
34. Caplan D, Baker C, Dehaut F, (1985) Syntactic determinants of sentence comprehension in aphasia. Cognition 21: 117-175.
35. Jaeger H, Haas H, (2004) Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304: 78-80.
36. Maass W, Natschlager T, Markram H, (2002) Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput 14: 2531-2560.
37. Verstraeten D, Schrauwen B, D'Haene M, Stroobandt D, (2007) An experimental unification of reservoir computing methods. Neural Netw 20: 391-403.
38. Lukosevicius M, Jaeger H, (2009) Reservoir computing approaches to recurrent neural network training. Computer Science Review 3: 127-149.
39. Dominey PF, (1995) Complex sensory-motor sequence learning based on recurrent state representation and reinforcement learning. Biol Cybern 73: 265-274.
40. Jaeger H, Lukosevicius M, Popovici D, Siewert U, (2007) Optimization and applications of echo state networks with leaky-integrator neurons. Neural Netw 20: 335-352.
41. Ogawa K, Inui T, Ohba M, (2008) Syntactic processing of complex sentences in left lateral premotor cortex. Neuroreport 19: 811-815.
42. Roland D, Dick F, Elman JL, (2007) Frequency of Basic English Grammatical Structures: A Corpus Analysis. J Mem Lang 57: 348-379.
43. Elman J, (1991) Distributed representations, Simple recurrent networks, and grammatical structure. Machine Learning 7: 195-225.
44. Tong MH, Bicket AD, Christiansen EM, Cottrell GW, (2007) Learning grammatical structure with Echo State Networks. Neural Netw 20: 424-432.
45. Voegtlin T, Dominey PF, (2005) Linear recursive distributed representations. Neural Netw 18: 878-895.
46. Lieven E, Behrens H, Speares J, Tomasello M, (2003) Early syntactic creativity: a usage-based approach. J Child Lang 30: 333-370.
47. Tomasello M (2003) Constructing a language: A usage based approach to language acquisition. Cambridge, MA: Harvard University Press. 388 p.
48. Kutas M, Hillyard SA, (1980) Reading senseless sentences: brain potentials reflect semantic incongruity. Science 207: 203-205.
49. Yildiz IB, Jaeger H, Kiebel SJ, (2012) Re-visiting the echo state property. Neural Netw 35: 1-9.
50. Liu Y, Starzyk JA, Zhu Z, (2008) Optimized approximation algorithm in neural networks without overfitting. IEEE Trans Neural Netw 19: 983-995.
51. Goldman-Rakic PS, (1987) Circuitry of Primate Prefrontal Cortex and Regulation of Behavior by Representational Memory. Handbook of Neurophysiology 5: 373-417.
52. Centonze D, Picconi B, Gubellini P, Bernardi G, Calabresi P, (2001) Dopaminergic control of synaptic plasticity in the dorsal striatum. Eur J Neurosci 13: 1071-1077.
53. Di Filippo M, Picconi B, Tantucci M, Ghiglieri V, Bagetta V, et al. (2009) Short-term and long-term plasticity at corticostriatal synapses: implications for learning and memory. Behav Brain Res 199: 108-118.
54. Dominey PF, Arbib MA, Joseph JP, (1995) A Model of Corticostriatal Plasticity for Learning Oculomotor Associations and Sequences J Cogn Neurosci. 7: 311-336.
55. Wacongne C, Changeux JP, Dehaene S, (2012) A neuronal model of predictive coding accounting for the mismatch negativity. J Neurosci 32: 3665-3678.
56. beim Graben P, Gerth S, Vasishth S, (2008) Towards dynamical system models of language-related brain potentials. Cognitive Neurodynamics 2: 229-255.
57. Friston K, (2005) A theory of cortical responses. Philos Trans R Soc Lond B Biol Sci 360: 815-836.
58. Frank SL, Bod R, (2011) Insensitivity of the human sentence-processing system to hierarchical structure. Psychol Sci 22: 829-834.
59. Frisch S, Schlesewsky M, Saddy D, Alpermann A, (2002) The P600 as an indicator of syntactic ambiguity. Cognition 85: B83-B92.
60. Hopf JM, Bader M, Meng M, Bayer J, (2003) Is human sentence parsing serial or parallel? Evidence from event-related brain potentials. Brain Res Cogn Brain Res 15: 165-177.
61. Lewis RL, (2000) Falsifying serial and parallel parsing models: empirical conundrums and an overlooked paradigm. J Psycholinguist Res 29: 241-248.
62. Elman J, (1990) Finding structure in time. Cognitive Sci 14: 179-211.
63. McClelland JL, St. John M, Taraban R, (1989) Sentence comprehension: A parallel distributed processing approach. Language and Cognitive Processes 4: SI287-SI335.
64. Miikkulainen R, (1996) Subsymbolic case-role analysis of sentences with embedded clauses. Cognitive Sci 20: 47-73.
65. van der Velde F, de Kamps M, (2006) Neural blackboard architectures of combinatorial structures in cognition. Behavioral and Brain Sciences 29: 37-108.
66. Chang F, (2002) Symbolically speaking: A connectionist model of sentence production. Cognitive Sci 93: 1-43.
67. Chang F, Dell GS, Bock K, Griffin ZM, (2000) Structural Priming as Implicit Learning: A Comparison of Models of Sentence Production. J Psycholinguist Res 29: 217-230.
68. Barnickel T, Weston J, Collobert R, Mewes H-W, Stümpflen V, (2009) Large Scale Application of Neural Network Based Semantic Role Labeling for Automated Relation Extraction from Biomedical Texts. PLoS One 4: e6393.
69. Collobert R, Weston J (2008) A unified architecture for natural language processing: deep neural networks with multitask learning. Proceedings of the 25th international conference on Machine learning. Helsinki, Finland: ACM. 160-167.
70. Busing L, Schrauwen B, Legenstein R, (2010) Connectivity, dynamics, and memory in reservoir computing with binary and analog neurons. Neural Comput 22: 1272-1311.
71. Hochstadt J, (2009) Set-shifting and the on-line processing of relative clauses in Parkinson's disease: results from a novel eye-tracking method. Cortex 45: 991-1011.
72. Hinaut X, Dominey PF, (2011) A three-layered model of primate prefrontal cortex encodes identity and abstract categorical structure of behavioral sequences. J Physiol Paris 105: 16-24.