What artificial grammar learning reveals about the neurobiology of syntax

Brain and Language

Volumn 120, Issue 2, 2012, Pages 83-95

  Petersson, Karl Magnus ^a,b,c,d   Folia, Vasiliki ^a,b,c   Hagoort, Peter ^a,b  

^a MAX PLANCK INSTITUTE FOR PSYCHOLINGUISTICS   (Netherlands)

^b RADBOUD UNIVERSITY   (Netherlands)

^c KAROLINSKA INSTITUTE   (Sweden)

^d UNIVERSITY OF ALGARVE   (Portugal)

Author keywords

Adaptive dynamical systems; Artificial grammar learning; Artificial language; Broca's area; Chomsky hierarchy; Complexity; Computability; FMRI; Natural language; Syntax

Indexed keywords

ADULT; ARTICLE; CONTROLLED STUDY; DECLARATIVE MEMORY; DIAGONAL BAND OF BROCA; FEMALE; FRONTAL LOBE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; LANGUAGE ABILITY; LANGUAGE PROCESSING; MALE; NATURAL LANGUAGE PROCESSING; NERVE CELL NETWORK; NEUROBIOLOGY; NEUROIMAGING; NORMAL HUMAN; ONLINE ANALYSIS; PREDICTION; STIMULUS RESPONSE; TASK PERFORMANCE; TEMPORAL LOBE;

ADULT; BRAIN; BRAIN MAPPING; FEMALE; HUMANS; LANGUAGE; LEARNING; LINGUISTICS; MAGNETIC RESONANCE IMAGING; MALE;

EID: 84856596921     PISSN: 0093934X     EISSN: 10902155     Source Type: Journal    
DOI: 10.1016/j.bandl.2010.08.003     Document Type: Article

References (127)

1. Adler R.J. The geometry of random fields 1981, Wiley and Sons, New York.
2. Adler R.J., Taylor J.E. Random fields and geometry 2007, Springer, New York.
3. Bahlmann, J., Schubotz, R. I., Mueller, J. L., Koester, D., & Friederici, A. D. (in press). Neural circuits of hierarchical visuo-spatial sequence processing. Brain Research, doi:10.1016/j.brainres.2009.1008.1017.
4. Bahlmann J., Schubotz R.I., Friederici A.D. Hierarchical artificial grammar processing engages Broca's area. NeuroImage 2008, 42:525-534.
5. Ben-Shachar M., Hendler T., Kahn I., Ben-Bashat D., Grodzinsky Y. The neural reality of syntactic transformations: Evidence from functional magnetic resonance imaging. Psychological Science 2003, 14:433-440.
6. Ben-Shachar M., Palti D., Grodzinsky Y. Neural correlates of syntactic movement: Converging evidence from two fMRI experiments. NeuroImage 2004, 21:1320-1336.
7. Bookheimer S. Functional MRI of language: New approaches to understanding the cortical organization of semantic processing. Annu. Rev. Neurosci. 2002, 25:151-188.
8. Brett M., Johnsrude I.S., Owen A.M. The problem of functional localization in the human brain. Nat. Rev. Neurosci. 2002, 3:243-249.
9. Buonomano D.V., Maass W. State-dependent computations: Spatiotemporal processing in cortical networks. Nature Reviews Neuroscience 2009, 10:113-125.
10. Casey M. The dynamics of discrete-time computation with application to recurrent neural networks and finite state machine extraction. Neural Computation 1996, 8:1135-1178.
11. Chomsky N. Three models for the description of language. IEEE Transactions on Information Theory 1956, 2:113-124.
12. Chomsky N. Syntactic Structures 1957, Mouton, Den Haag.
13. Chomsky N. Aspects of the theory of syntax 1965, MIT Press, Cambridge, MA.
14. Chomsky N., Fitch W.T., Hauser M.D. The evolution of the language faculty: Clarifications and implications. Cognition 2005, 97:179-210.
15. Christiansen M.H., Chater N. Toward a connectionist model of recursion in human linguistic performance. Cognitive Science 1999, 23:157-205.
16. Christiansen, M. H., Kelly, L., Shillock, R., & Greenfield, K. (2009). Impaired artificial grammar learning in agrammatism.Unpublished manuscript.
17. Christiansen M.H., MacDonald M.C. A usage-based approach to recursion in sentence processing. Language Learning 2009, 59(Suppl. 1):126-161.
18. Culicover P.W., Nowak A. Dynamical Grammar: Volume two of foundations of syntax 2003, Oxford University Press, Oxford, UK.
19. Cutland N.J. Computability: An introduction to recursive function theory 1980, Cambridge University Press, Cambridge, UK.
20. Davis M., Sigal R., Weyuker E.J. Computability, complexity, and languages: Fundamentals of Theoretical Computer Science 1994, Academic Press, San Diego CA.
21. de Vries M.H., Monaghan P., Knecht S., Zwitserlood P. Syntactic structure and artificial grammar learning: The learnability of embedded hierarchical structures. Cognition 2008, 107:763-774.
22. Dominey P.F., Hoen M. Structure mapping and semantic integration in a construction-based neurolinguistic model of sentence processing. Cortex 2006, 42:476-479.
23. Elman J. Distributed representations, simple recurrent networks, and grammatical structure. Machine Learning 1991, 7:195-224.
24. Evans J.L., Saffran J.R., Robe-Torres K. Statistical learning in children with specific language impairment. J. Speech. Lang. Hear. Res. 2009, 52:321-335.
25. Fitch W.T., Hauser M.D. Computational constraints on syntactic processing in a nonhuman primate. Science 2004, 303:377-380.
26. Folia V., Forkstam C., Hagoort P., Petersson K.M. Language comprehension: The interplay between form and content. Proceedings of the Cognitive Science Society 2009, 2009:1686-1691.
27. Folia V., Uddén J., Forkstam C., Ingvar M., Hagoort P., Petersson K.M. Implicit learning and dyslexia. Annals of the New York Academy of Sciences 2008, 1145:132-150.
28. Forkstam C., Elwér å., Ingvar M., Petersson K.M. Instruction effects in implicit artificial grammar learning: A preference for grammaticality. Brain Research 2008, 1221:80-92.
29. Forkstam C., Hagoort P., Fernandez G., Ingvar M., Petersson K.M. Neural correlates of artificial syntactic structure classification. NeuroImage 2006, 32:956-967.
30. Forkstam C., Petersson K.M. Towards an explicit account of implicit learning. Current Opinion in Neurology 2005, 18:435-441.
31. Friederici A.D. Processing local transitions vs. long-distance syntactic hierarchies. Trends in Cognitive Sciences 2004, 8:245-247.
32. Friederici A.D., Bahlmann J., Heim S., Schubotz R.I., Anwander A. The brain differentiates human and non-human grammars: Functional localization and structural connectivity. Proceedings of the National Acadamic Science USA 2006, 103:2458-2463.
33. Friederici A.D., Fiebach C.J., Schlesewsky M., Bornkessel I.D., von Cramon D.Y. Processing linguistic complexity and grammaticality in the left frontal cortex. Cerebral Cortex 2006, 16:1709-1717.
34. Friston K.J. Testing for anatomically specified regional effects. Human Brain Mapping 1997, 5:133-136.
35. Statistical parametric mapping: The analysis of functional brain images 2007, Academic Press, San Diego, CA. K.J. Friston, J.T. Ashburner, S.J. Kiebel, T.E. Nichols, W.D. Penny (Eds.).
36. Genovese C.L., Lazar N.A., Nichols T. Thresholding of statistical maps in functional neuroimaging using the false discovery rate. NeuroImage 2002, 15:870-878.
37. Gentner T.Q., Fenn K.M., Margoliash D., Nusbaum H.C. Recursive syntactic pattern learning by songbirds. Nature 2006, 440:1204-1207.
38. Gómez R.L., Gerken L. Infant artificial language learning and language acquisition. Trends in Cognitive Sciences 2000, 4:178-186.
39. Hagoort P. Interplay between syntax and semantics during sentence comprehension: ERP effects of combining syntactic and semantic violations. Journal of Cognitive Neuroscience 2003, 15:883-899.
40. Hagoort P. On Broca, brain, and binding: A new framework. Trends in Cognitive Sciences 2005, 9:416-423.
41. Hagoort, P. (2009). Reflections on the neurobiology of syntax. In XXX (Ed.), Biological foundations and origin of syntax (pp. 1-27). Cambridge, MA: MIT Press.
42. Hagoort P., Hald L., Bastiaansen M., Petersson K.M. Integration of word meaning and world knowledge in language comprehension. Science 2004, 304:438-441.
43. Hauser M.D., Chomsky N., Fitch W.T. The faculty of language: What is it, who has it, and how did it evolve?. Science 2002, 298:1569-1579.
44. Hoen M., Golembiowski M., Guyot E., Deprez V., Caplan D., Dominey P.F. Training with cognitive sequences improves syntactic comprehension in agrammatic aphasics. NeuroReport 2003, 14:495-499.
45. Hoen M., Pachot-Clouard M., Segebarth C., Dominey P.F. When Broca experiences the Janus syndrome: An ER-fMRI study comparing sentence comprehension and cognitive sequence processing. Cortex 2006, 42:605-623.
46. Hopcroft J.E., Motwani R., Ullman J.D. Introduction to automata theory languages, and computation. Reading 2000, Addison-Wesley, MA.
47. Hornstein N. A theory of syntax: Minimal operations and universal grammar 2009, Cambridge University Press, Cambridge, UK.
48. Hsu, H. -J., Christiansen, M. H., Tomblin, J. B., Zhang, X., & Gómez, R. L. (2006). Statistical learning of nonadjacent dependencies in adolescents with and without language impairment. In Symposium on research in child language disorders. Madison, WI.
49. Indefrey P., Levelt W.J.M. The spatial and temporal signatures of word production components. Cognition 2004, 92:101-144.
50. Jackendoff R. A parallel architecture perspective on language processing. Brain Research 2007, 1146:2-22.
51. Jackendoff R., Pinker S. The nature of the language faculty and its implications for evolution of language. Cognition 2005, 97:211-225.
52. Janata P., Grafton S.T. Swinging in the brain: Shared neural substrates for behaviors related to sequencing and music. Nature Neuroscience 2003, 6:682-687.
53. Joshi A.K., Schabes Y. Tree-adjoining grammars. Handbook of formal languages 1997, Vol. 3: Beyond words:erlag. Springer, Berlin.
54. Kaan E., Swaab T.Y. The brain circuitry of syntactic comprehension. Trends in Cognitive Sciences 2002, 6:350-356.
55. Kleene S. Introduction to metamathematics 1952, Van Nostrand, NewYork.
56. Knowlton B.J., Squire L.R. Artificial grammar learning depends on implicit acquisition of both abstract and exemplar-specific information. Journal of Experimental Psychology Learning Memory Cognition 1996, 22:169-181.
57. Koch C. Biophysics of computation: Information processing in single neurons 1999, Oxford University Press, New York.
58. Koch C., Laurent G. Complexity and the nervous system. Science 1999, 284:96-98.
59. Koelsch S., Gunter T.C., von Cramon D.Y., Zysset S., Lohmann G., Friederici A.D. Bach speaks: A cortical ''language-network'' serves the processing of music. NeuroImage 2002, 17:956-966.
60. Lasnik H. Syntactic structures revisited: Contemporary lectures on classic transformational theory 2000, MIT Press, Cambridge, MA.
61. Levelt W.J.M. Formal grammars in linguistics and psycholinguistics 1974, Vol. III. Mouton, The Hague.
62. Lewis H., Papadimitriou C.H. Elements of the theory of computation 1981, Prentice Hall, Upper Saddle River, NJ.
63. Maass W., Joshi P., Sontag E. Computational aspects of feedback in neural circuits. PLoS Computational Biology 2007, 3(1):e165. doi:110.1371/journal.pcbi.0020165.
64. Maass W., Orponen P. On the effect of analog noise on discrete-time analog computations. Advances in Neural Information Processing Systems 1997, 9:218-224.
65. Maass W., Orponen P. On the effect of analog noise on discrete-time analog computations. Neural Computation 1998, 10:1071-1095.
66. Maass W., Sontag E. Analog neural nets with Gaussian or other common noise distribution cannot recognize arbitrary regular languages. Neural Computation 1999, 11:771-782.
67. Maess B., Koelsch S., Gunter T.C., Friederici A.D. Musical syntax is processed in Broca's area: A MEG study. Nature Neuroscience 2001, 4:540-545.
68. Makuuchi M., Bahlmann J., Anwander A., Friederici A.D. Segregating the core computational faculty of human language from working memory. Proceedings of the National Acadamic Science USA 2009, 106:8362-8367.
69. Marcus G.F., Vouloumanos A., Sag I.A. Does Broca's play by the rules?. Nature Neuroscience 2003, 6:651-652.
70. Marr D. Vision: A computational investigation into the human representation and processing of visual information 1982, W. H. Freeman and Company, New York.
71. Menenti L., Petersson K.M., Scheeringa R., Hagoort P. When elephants fly: Differential sensitivity of right and left inferior frontal gyri to discourse and world knowledge. Journal of Cognitive Neuroscience. 2008, doi: 10.1162/jocn.2008.21163.
72. Mesulam M.-M. Large-scale neurocognitive networks and distributed processing for attention, language, and memory. Annals of Neurology 1990, 28:597-613.
73. Mesulam M.-M. Form sensation to cognition. Brain 1998, 121:1013-1052.
74. Meulemans T., Van der Linden M. Associative chunk strength in artificial grammar learning. Journal of Experimental Psychology Learning Memory Cognition 1997, 23:1007-1028.
75. Minsky M.L. Computation: Finite and infinite machines 1967, Prentice-Hall, Englewood Cliffs, NJ.
76. Misyak J.B., Christiansen M.H., Tomblin J.B. Statistical learning of nonadjacencies predicts on-line processing of long-distance dependencies in natural language. Proceedings of the Cognitive Science Society 2009, 2009:177-182.
77. Misyak J.B., Christiansen M.H., Tomblin J.B. Sequential expectations: The role of prediction-based learning in language. Topics in Cognitive Science 2010, 2:138-153.
78. Moore C. Unpredictability and undecidability in dynamical systems. Physical Review Letters 1990, 64:2354-2357.
79. Nieuwenhuys R., Voogd J., van Huijzen C. The human central nervous system: A synopsis and atlas 1988, Springer-Verlag, Berlin. 3rd revised ed.
80. O'Donnell T.J., Hauser M.D., Fitch W.T. Using mathematical models of language experimentally. Trends in Cognitive Sciences 2005, 9:284-289.
81. Patel A.D. Language, music, syntax and the brain. Nature Neuroscience 2003, 6:674-681.
82. Patel A.D., Iversen J., Wassenaar M., Hagoort P. Musical syntactic processing in agrammatic Broca's aphasia. Aphasiology 2008, 22:776-789.
83. Perruchet P., Rey A. Does the mastery of center-embedded linguistic structures distinguish humans from nonhuman primates?. Psychonomic Bulletin & Review 2005, 12:307-313.
84. Petersson K.M. Learning and memory in the human brain 2005, Karolinska University Press, Stockholm, Sweden.
85. Petersson K.M. On the relevance of the neurobiological analogue of the finite-state architecture. Neurocomputing 2005, 65-66:825-832.
86. Petersson K.M. On cognition, structured sequence processing and adaptive dynamical systems. Proceedings of the American Institute of Physics: Mathematical and Statistical Physics Subseries 2008, 1060:195-200.
87. Petersson K.M., Forkstam C., Ingvar M. Artificial syntactic violations activate Broca's region. Cognitive Science 2004, 28:383-407.
88. Petersson K.M., Grenholm P., Forkstam C. Artificial grammar learning and neural networks. Proceeding of the Cognitive Science Society 2005, 2005:1726-1731.
89. Petersson K.M., Ingvar M., Reis A. Language and literacy from a cognitive neuroscience perspective, Cambridge Handbook of Literacy 2009, Cambridge University Press, Cambridge, UK, (pp. 152-182).
90. Petersson K.M., Nichols T.E., Poline J.-B., Holmes A.P. Statistical limitations in functional neuroimaging II: Signal detection and statistical inference. Philosophical Transactions of the Royal Society B 1999, 354:1261-1282.
91. Pinker S., Jackendoff R. The faculty of language: what's special about it?. Cognition 2005, 95:201-236.
92. Poletiek F.H. Implicit learning of a recursive rule in an artificial grammar. Acta Psychologica 2002, 111:323-335.
93. Post E. Recursively enumerable sets of positive integers and their decision problems. Bulletin of the American Mathematical Society 1944, 50:284-316.
94. Pothos E.M., Wood R.L. Separate influences in learning: Evidence from artificial grammar learning with traumatic brain injury patients. Brain Research 2009, 1275:67-72.
95. Pullum G.K., Scholz B.C. For universals (but not finite-state learning) visit the zoo. Behavioral and Brain Sciences 2009, 32:466-467.
96. Pullum G.K., Scholz B.C. Recursion and the infinitude claim. Recursion in human language 2010, Mouton de Gruyter, Berlin, pp. 1-9. H. van der Hulst (Ed.).
97. Rabinovich M.I., Varona P., Selverston A.I., Abarbanels H.D.I. Dynamical principles in neuroscience. Reviews of Modern Physics 2006, 78:1214-1265.
98. Reali F., Christiansen M.H. Sequential learning and the interaction between biological and linguistic adaptation in language evolution. Interaction Studies 2009, 10:5-30.
99. Reber A.S. Implicit learning of artificial grammars. Journal of Verbal Learning and Verbal Behavior 1967, 5:855-863.
100. Richardson J., Harris L., Plante E., Gerken L. Subcategory learning in normal and language learning-disabled adults: How much information do they need?. Journal of Speech Language and Hearing Research 2006, 49:1257-1266.
101. Rodriguez P. Simple recurrent networks learn context-free and context-sensitive languages by counting. Neural Computation 2001, 13:2093-2118.
102. Rodriguez P., Wiles J., Elman J.L. A recurrent neural network that learns to count. Connection Science 1999, 11:5-40.
103. Saffran J.R., Hauser M., Seibel R., Kapfhamer J., Tsao F., Cushman F. Grammatical pattern learning by human infants and cotton-top tamarin monkeys. Cognition 2008, 107:479-500.
104. Santi A., Grodzinsky Y. Taxing working memory with syntax: Bihemispheric modulation. Human Brain Mapping 2007, 28:1089-1097.
105. Santi A., Grodzinsky Y. Working memory and syntax interact in Broca's area. NeuroImage 2007, 37:8-17.
106. Savage J.E. Models of Computation 1998, Addison-Wesley, Reading, MA.
107. Seger C.A. Implicit learning. Psychonomic Bulletin 1994, 115:163-196.
108. Siegelmann H.T. Computation beyond the turing limit. Science 1995, 268:545-548.
109. Siegelmann H.T. Neural networks and analog computation: Beyond the turing limit 1999, Birkhäuser, Basel.
110. Siegelmann H.T., Fishman S. Analog computation with dynamical systems. Physica D 1998, 120:214-235.
111. Snijders T.M., Vosse T., Kempen G., Van Berkum J.A., Petersson K.M., Hagoort P. Retrieval and unification in sentence comprehension: An fMRI study using word-category ambiguity. Cerebral Cortex 2009, 19:1493-1503.
112. Soare R.I. Computability and recursion. Bulletin of Symbolic Logic 1996, 2:284-321.
113. Handbook of implicit learning 1998, SAGE, London. M.A. Stadler, P.A. Frensch (Eds.).
114. Talairach J., Tournoux P. Co-planar stereotaxic atlas of the human brain 1988, Thieme Verlag, New York.
115. Tanenbaum A.S. Structured computer organization 1990, Prentice-Hall, Englewood Cliffs, NJ.
116. Tesink C.M.J.Y., Petersson K.M., Van Berkum J.A., van den Brink D., Buitelaar J.K., Hagoort P. Unification of speaker and meaning in language comprehension: An fMRI study. Journal of Cognitive Neuroscience 2008, doi: 10.1162/jocn.2008.21161.
117. Tillmann B., Koelsch S., Escoffier N., Bigand E., Lalitte P., Friederici A.D., et al. Cognitive priming in sung and instrumental music: Activation of inferior frontal cortex. NeuroImage 2006, 31:1771-1782.
118. Tong M.H., Bickett A.D., Christiansen E.M., Cottrell G.W. Learning grammatical structure with Echo State Networks. Neural Networks 2007, 20:424-432.
119. Turing A. On computable numbers with an application to the Entscheidungs problem (part 1). Proceedings of the London Mathematical Society 1936, 42(3):230-240.
120. Turing A. On computable numbers with an application to the Entscheidungs problem (part 2). Proceedings of the London Mathematical Society 1936, 42(4):241-265.
121. Uddén J., Araujo S., Forkstam C., Ingvar M., Hagoort P., Petersson K.M. A matter of time: Implicit acquisition of recursive sequence structures. Proceedings of the Cognitive Science Society 2009, 2009:2444-2449.
122. Uddén J., Folia V., Forkstam C., Ingvar M., Fernandez G., Overeem S., et al. The inferior frontal cortex in artificial syntax processing: An rTMS study. Brain Research 2008, 1224:69-78.
123. Uddén, J., Ingvar, M., Hagoort, P., & Petersson, K. M. (submitted for publication). Implicit acquisition of grammars with crossed and nested non-adjacent dependencies: Investigating the push-down stack model.
124. Vosse T., Kempen G. Syntactic structure assembly in human parsing: A computational model based on competitive inhibition and a lexicalist grammar. Cognition 2000, 75:105-143.
125. Wells A. Rethinking cognitive computation: Turing and the science of the mind 2005, Palgrave Macmillan, Hampshire, UK.
126. Worsley K.J. Developments in random field theory. Human Brain Function 2003, 881-886. Academic Press, San Diego, CA. R.S.J. Frackowiak, K.J. Friston, C. Frith, R. Dolan, C. Price, S. Zeki, J. Ashburner, W.D. Penny (Eds.).
127. Worsley K.J., Marrett S., Neelin P., Vandal A.C., Friston K.J., Evans A.C. A unified statistical approach for determining significant signals in images of cerebral activation. Human Brain Mapping 1996, 4:58-73.