Corticostriatal response selection in sentence production: Insights from neural network simulation with reservoir computing

Brain and Language

Volumn 150, Issue , 2015, Pages 54-68

  Hinaut, Xavier ^a   Lance, Florian ^b   Droin, Colas ^b   Petit, Maxime ^b   Pointeau, Gregoire ^b   Dominey, Peter Ford ^b  

^a CNRS   (France)

^b STEM CELL AND BRAIN RESEARCH INSTITUTE   (France)

Author keywords

Corticostriatal system; Language; Model; Neural network; Sentence production

Indexed keywords

ARTICLE; BRAIN CORTEX; COGNITION; CORPUS STRIATUM; CORTICOSTRIATAL SYSTEM; LANGUAGE ABILITY; LANGUAGE PROCESSING; LEARNING; LINGUISTICS; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; MENTAL FUNCTION; NERVE CELL NETWORK; SENTENCE PRODUCTION; ANIMAL; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; HUMAN; LANGUAGE; PHYSIOLOGY; PRIMATE; PSYCHOLOGICAL MODEL;

ANIMALS; CEREBRAL CORTEX; CORPUS STRIATUM; HUMANS; LANGUAGE; LEARNING; LINGUISTICS; MODELS, NEUROLOGICAL; MODELS, PSYCHOLOGICAL; NEURAL NETWORKS (COMPUTER); PRIMATES;

EID: 84940492841     PISSN: 0093934X     EISSN: 10902155     Source Type: Journal    
DOI: 10.1016/j.bandl.2015.08.002     Document Type: Article

References (89)

1. Alexander G.E., DeLong M.R., Strick P.L. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annual Review of Neuroscience 1986, 9:357-381. 10.1146/annurev.ne.09.030186.002041.
2. Altmann L.J., Troche M.S. High-level language production in Parkinson's disease: A review. Parkinson's Disease 2011, 11.
3. Antonelo E., Schrauwen B. Learning slow features with reservoir computing for biologically-inspired robot localization. Neural Networks 2012, 25(1):178-190. 10.1016/j.neunet.2011.08.004.
4. Argyropoulos G.P., Tremblay P., Small S.L. The neostriatum and response selection in overt sentence production: An fMRI study. Neuroimage 2013, 82:53-60.
5. Barone P., Joseph J.P. Prefrontal cortex and spatial sequencing in macaque monkey. Experimental Brain Research 1989, 78(3):447-464.
6. Bates E., MacWhinney B. Competition, variation, and language learning. Mechanisms of language acquisition 1987, 157-193. Erlbaum, Hillsdale, NJ. B. MacWhinney, E. Bates (Eds.).
7. Binzegger T., Douglas R., Martin K. 2009 special issue: Topology and dynamics of the canonical circuit of cat V1. Neural Networks 2009, 22(8):1071-1078.
8. Buonomano D.V., Merzenich M.M. Cortical plasticity: From synapses to maps. Annual Review of Neuroscience 1998, 21(1):149-186.
9. Calabresi P., Picconi B., Tozzi A., Di Filippo M. Dopamine-mediated regulation of corticostriatal synaptic plasticity. Trends in Neurosciences 2007, 30(5):211-219.
10. Chan S.-H., Ryan L., Bever T.G. Role of the striatum in language: Syntactic and conceptual sequencing. Brain and Language 2013, 125(3):283-294.
11. Chang F. Symbolically speaking: A connectionist model of sentence production. Cognitive Science 2002, 93:1-43.
12. Chang F. Learning to order words: A connectionist model of heavy NP shift and accessibility effects in Japanese and English. Journal of Memory and Language 2009, 61(3):374-397.
13. Christiansen M.H., Chater N. Connectionist natural language processing: The state of the art. Cognitive Science 1999, 23(4):417-437.
14. Cleeremans A., McClelland J.L. Learning the structure of event sequences. Journal of Experimental Psychology: General 1991, 120(3):235.
15. Dell G.S., Chang F. The P-chain: Relating sentence production and its disorders to comprehension and acquisition. Philosophical Transactions of the Royal Society B: Biological Sciences 2014, 369(1634):20120394.
16. Dominey P.F. Complex sensory-motor sequence learning based on recurrent state representation and reinforcement learning. [Research Support, Non-U.S. Gov't]. Biological Cybernetics 1995, 73(3):265-274.
17. Dominey P.F. A model of learning syntactic comprehension for natural and artificial grammars. Basic functions of language, reading and reading disability 2002, 61-77. Springer.
18. Dominey P.F. A conceptuocentric shift in the characterization of language: Comment on Jackendoff. Behavioral and Brain Sciences 2003, 26(6):674.
19. Dominey P.F. Aspects of descriptive, referential, and information structure in phrasal semantics: A construction-based model. Interaction Studies 2005, 6(2):287-310.
20. Dominey P.F. Recurrent temporal networks and language acquisition-from corticostriatal neurophysiology to reservoir computing. Frontiers in Psychology 2013, 4:1-14. 10.3389/fpsyg.2013.00500.
21. Dominey P.F., Arbib M.A., Joseph J.P. A model of corticostriatal plasticity for learning oculomotor associations and sequences. Journal of Cognitive Neuroscience 1995, 7(3):25.
22. Dominey P.F., Boucher J.D. Learning to talk about events from narrated video in a construction grammar framework. Artificial Intelligence 2005, 167(1-2):31-61.
23. Dominey P.F., Boussaoud D. Encoding behavioral context in recurrent networks of the fronto-striatal system: A simulation study. Brain Research. Cognitive Brain Research 1997, 6(1):53-65.
24. Dominey P.F., Hoen M. Structure mapping and semantic integration in a construction-based neurolinguistic model of sentence processing. Cortex 2006, 42(4):476-479.
25. Dominey P.F., Hoen M., Blanc J.M., Lelekov-Boissard T. Neurological basis of language and sequential cognition: Evidence from simulation, aphasia, and ERP studies. Brain and Language 2003, 86(2):207-225.
26. Dominey P.F., Hoen M., Inui T. A neurolinguistic model of grammatical construction processing. Journal of Cognitive Neuroscience 2006, 18(12):2088-2107.
27. Dominey P.F., Inui T. Cortico-striatal function in sentence comprehension: Insights from neurophysiology and modeling. Cortex 2009, 45(8):1012-1018.
28. Dominey P.F., Inui T., Hoen M. Neural network processing of natural language: II. Towards a unified model of corticostriatal function in learning sentence comprehension and non-linguistic sequencing. Brain and Language 2009, 109(2-3):80-92.
29. Dominey P.F., Ramus F. Neural network processing of natural language: I. Sensitivity to serial, temporal and abstract structure of language in the infant. Language and Cognitive Processes 2000, 15(1):40.
30. Dominey P.F. A model of learning syntactic comprehension for natural and artificial grammars. Basic mechanisms of language and language disorders 2001, 61-77. Kluwer Academic Publishers, Dordrecht. E. Witruk, A.D. Friederici, T. Lachmann (Eds.).
31. Douglas R.J., Koch C., Mahowald M., Martin K., Suarez H.H. Recurrent excitation in neocortical circuits. Science 1995, 269(5226):981-985.
32. Elman J. Finding structure in time. Cognitive Science 1990, 14:179-211.
33. Elman J. Distributed representations, simple recurrent networks, and grammatical structure. Machine Learning 1991, 7:30.
34. Elman J.L. Learning and development in neural networks: The importance of starting small. Cognition 1993, 48(1):71-99.
35. Fitz H., Chang F., Christiansen M.H. A connectionist account of the acquisition and processing of relative clauses. The Acquisition of Relative Clauses: Processing, Typology and Function 2011, 8:39-60.
36. Friederici A.D., Kotz S.A. The brain basis of syntactic processes: Functional imaging and lesion studies. Neuroimage 2003, 20(Suppl. 1):S8-17.
37. Friederici A.D., Kotz S.A., Werheid K., Hein G., von Cramon D.Y. Syntactic comprehension in Parkinson's disease: Investigating early automatic and late integrational processes using event-related brain potentials. Neuropsychology 2003, 17(1):133-142.
38. Frisch S., Kotz S.A., von Cramon D.Y., Friederici A.D. Why the P600 is not just a P300: The role of the basal ganglia. Clinical Neurophysiology 2003, 114(2):336-340.
39. Givón T. Syntax: An introduction 2001, Vol. 1. John Benjamins Publishing.
40. Goldberg A. Constructions: A construction grammar approach to argument structure 1995, University of Chicago Press, Chicago.
41. Goldberg A.E. Constructions: a new theoretical approach to language. Trends in Cognitive Sciences 2003, 7(5):219-224.
42. Grahn J.A., Parkinson J.A., Owen A.M. The role of the basal ganglia in learning and memory: Neuropsychological studies. Behavioural Brain Research 2009, 199(1):53-60.
43. Hermans M., Schrauwen B. Recurrent kernel machines: Computing with infinite echo state networks. Neural Computation 2012, 24(1):104-133. 10.1162/NECO_a_00200.
44. Hikosaka O., Nakamura K., Sakai K., Nakahara H. Central mechanisms of motor skill learning. Current Opinion in Neurobiology 2002, 12(2):217-222.
45. Hinaut X., Dominey P.F. Real-time parallel processing of grammatical structure in the fronto-striatal system: A recurrent network simulation study using reservoir computing. PLoS One 2013, 8(2):1-18. 10.1371/journal.pone.0052946.
46. Hinaut X., Petit M., Pointeau G., Dominey P.F. Exploring the acquisition and production of grammatical constructions through human-robot interaction with echo state networks. Frontiers in Neurorobotics 2014, 8.
47. Hochstadt J. Set-shifting and the on-line processing of relative clauses in Parkinson's disease: Results from a novel eye-tracking method. Cortex 2009, 45(8):991-1011.
48. Hochstadt J., Nakano H., Lieberman P., Friedman J. The roles of sequencing and verbal working memory in sentence comprehension deficits in Parkinson's disease. Brain and Language 2006, 97(3):243-257.
49. Hoen M., Pachot-Clouard M., Segebarth C., Dominey P.F. When Broca experiences the Janus syndrome: An ER-fMRI study comparing sentence comprehension and cognitive sequence processing. Cortex 2006, 42(4):605-623.
50. Hollerman J.R., Schultz W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nature Neuroscience 1998, 1(4):304-309. 10.1038/1124.
51. Jackendoff R. Foundations of language: Brain, meaning, grammar, evolution 2002, Oxford University Press.
52. Jaeger H., Haas H. Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication. Science 2004, 304(5667):78-80. 10.1126/science.1091277.
53. Jiménez L., Méndez C., Cleeremans A. Comparing direct and indirect measures of sequence learning. Journal of Experimental Psychology. Learning, Memory, and Cognition 1996, 22(4):948.
54. Johnson-Laird P. Mental models in cognitive science. Cognitive Science 1980, 4:71-115.
55. Johnson-Laird P. The history of mental models. Psychology of Reasoning: Theoretical and Historical Perspectives 2004, 179.
56. Johnson-Laird P.N. Mental models and human reasoning. Proceedings of the National Academy of Sciences of the United States of America 2010, 107(43):18243-18250. 10.1073/pnas.1012933107.
57. Time in language 2013, Routledge. W. Klein (Ed.).
58. Kotz S.A., Frisch S., von Cramon D.Y., Friederici A.D. Syntactic language processing: ERP lesion data on the role of the basal ganglia. [Comparative Study]. Journal of the International Neuropsychological Society 2003, 9(7):1053-1060. 10.1017/S1355617703970093.
59. Li P., Macwhinney B. Competition model. The Encyclopedia of Applied Linguistics 2013.
60. Ljungberg T., Apicella P., Schultz W. Responses of monkey dopamine neurons during learning of behavioral reactions. Journal of Neurophysiology 1992, 67(1):145-163.
61. Lukosevicius M., Jaeger H. Reservoir computing approaches to recurrent neural network training. Computer Science Review 2009, 3(3):22.
62. Luria A., Tsvetkova L. Towards the mechanisms of "dynamic aphasia". Acta neurologica et psychiatrica Belgica 1967, 67(11):1045-1057.
63. Maass W., Natschlager T., Markram H. Real-time computing without stable states: A new framework for neural computation based on perturbations. Neural Computation 2002, 14(11):2531-2560. 10.1162/089976602760407955.
64. Manjunath G., Jaeger H. Echo state property linked to an input: Exploring a fundamental characteristic of recurrent neural networks. Neural Computation 2013, 25(3):671-696.
65. Mega M.S., Alexander M.P. Subcortical aphasia the core profile of capsulostriatal infarction. Neurology 1994, 44(10):1824.
66. Moro A., Tettamanti M., Perani D., Donati C., Cappa S.F., Fazio F. Syntax and the brain: Disentangling grammar by selective anomalies. Neuroimage 2001, 13(1):110-118.
67. Nadeau S.E., Crosson B. Subcortical aphasia. Brain and Language 1997, 58(3):355-402.
68. Nikolic D., Hausler S., Singer W., Maass W. Distributed fading memory for stimulus properties in the primary visual cortex. PLoS Biology 2009, 7(12):e1000260. 10.1371/journal.pbio.1000260.
69. Pickering M.J., Garrod S. Toward a mechanistic psychology of dialogue. Behavioral and Brain Sciences 2004, 27(2):169-190. (discussion 190-226).
70. Pickering M.J., Garrod S. An integrated theory of language production and comprehension. Behavioral and Brain Sciences 2013, 36(04):329-347.
71. Rigotti M., Barak O., Warden M.R., Wang X.-J., Daw N.D., Miller E.K., Fusi S. The importance of mixed selectivity in complex cognitive tasks. Nature 2013, 15.
72. Rigotti M., Rubin D.B.D., Wang X.-J., Fusi S. Internal representation of task rules by recurrent dynamics: The importance of the diversity of neural responses. Frontiers in Computational Neuroscience 2010, 4.
73. Roelofs A. A dorsal-pathway account of aphasic language production: The WEAVER++/ARC model. Cortex 2014, 59:33-48.
74. Servan-Schreiber D., Cleeremans A., McClelland J.L. Graded state machines: The representation of temporal contingencies in simple recurrent networks. Machine Learning 1991, 7(2-3):161-193.
75. Steedman M. Information structure and the syntax-phonology interface. Linguistic Inquiry 2000, 31(4):649-689.
76. Sussillo D. Neural circuits as computational dynamical systems. Current Opinion in Neurobiology 2014, 25:156-163.
77. Takac M., Benuskova L., Knott A. Mapping sensorimotor sequences to word sequences: A connectionist model of language acquisition and sentence generation. Cognition 2012, 125(2):288-308. 10.1016/j.cognition.2012.06.006.
78. Teichmann M., Dupoux E., Kouider S., Brugières P., Boissé M.-F., Baudic S., Bachoud-Lévi A.-C. The role of the striatum in rule application: The model of Huntington's disease at early stage. Brain 2005, 128(5):1155-1167.
79. Tomasello M. The item-based nature of children's early syntactic development. Trends in Cognitive Sciences 2000, 4(4):156-163.
80. Tomasello M. Constructing a language: A usage based approach to language acquisition 2003, MIT Press, Boston.
81. Ullman M.T. The declarative/procedural model of lexicon and grammar. Journal of Psycholinguistic Research 2001, 30(1):37-69.
82. Ullman M.T. A neurocognitive perspective on language: the declarative/procedural model. Nature Reviews Neuroscience 2001, 2(10):717-726. 10.1038/35094573.
83. Ullman M.T. Contributions of memory circuits to language: The declarative/procedural model. Cognition 2004, 92(1-2):231-270. 10.1016/j.cognition.2003.10.008.
84. Ullman M.T., Corkin S., Coppola M., Hickok G., Growdon J.H., Koroshetz W.J., Pinker S. A neural dissociation within language: Evidence that the mental dictionary is part of declarative memory, and that grammatical rules are processed by the procedural system. Journal of Cognitive Neuroscience 1997, 9(2):266-276.
85. Warglien M., Gärdenfors P., Westera M. Event structure, conceptual spaces and the semantics of verbs. Theoretical Linguistics 2012, 38:159-193.
86. Wise S.P., Murray E.A., Gerfen C.R. The frontal cortex-basal ganglia system in primates. Critical Reviews™ in Neurobiology 1996, 10(3-4).
87. Wray A., Perkins M.R. The functions of formulaic language: An integrated model. Language & Communication 2000, 20(1):1-28.
88. Yelnik J., Francis C., Percheron G., Tandéa D. Morphological taxonomy of the neurons of the primate striatum. Journal of Comparative Neurology 1991, 313(2):273-294.
89. Yeterian E., Pandya D. Corticostriatal connections of the superior temporal region in rhesus monkeys. The Journal of Comparative Neurology 1998, 399(3):384-402.