Reinforcement learning in young adults with developmental language impairment

Brain and Language

Volumn 123, Issue 3, 2012, Pages 154-163

  Lee, Joanna C ^a   Tomblin, J Bruce ^a  

^a UNIVERSITY OF IOWA   (United States)

Author keywords

Corticostriatal loops; Developmental language impairment; Language; Procedural Deficit Hypothesis; Reinforcement learning

Indexed keywords

ADULT; ARTICLE; BASAL GANGLION; CLINICAL ARTICLE; CONTROLLED STUDY; CORPUS STRIATUM; DOPAMINERGIC SYSTEM; HUMAN; LANGUAGE DISABILITY; LEARNING DISORDER; MATHEMATICAL MODEL; NEGATIVE FEEDBACK; NEUROCOMPUTATIONAL MODEL; POSITIVE FEEDBACK; PREFRONTAL CORTEX; REINFORCEMENT; SENSORY GATING; TASK PERFORMANCE;

ADULT; HUMANS; LANGUAGE DEVELOPMENT DISORDERS; LEARNING; PREFRONTAL CORTEX; REINFORCEMENT (PSYCHOLOGY); YOUNG ADULT;

EID: 84869493742     PISSN: 0093934X     EISSN: 10902155     Source Type: Journal    
DOI: 10.1016/j.bandl.2012.07.009     Document Type: Article

References (106)

1. Alexander G.E., Crutcher M.D. Functional architecture of basal ganglia circuits: Neural substrates of parallel processing. Trends in Neurosciences 1990, 13:266-271.
2. Alexander G.E., DeLong M.R., Strick P.L. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annual Review of Neuroscience 1986, 9:357-381.
3. Archibald L.M.D., Gathercole S.E. Short-term and working memory in specific language impairment. International Journal of Language and Communication Disorders 2006, 41(6):675-693.
4. Badcock N.A., Bishop D.V.M., Hardiman M.J., Barry J.G., Watkins K.E. Co-localisation of abnormal brain structure and function in specific language impairment. Brain & Language 2012, 120(3):310-320.
5. Baldo J.V., Dronkers N.F., Wilkins D., Ludy C., Raskin P., Kim J. Is problem solving dependent on language?. Brain and Language 2005, 92:240-250.
6. Baron R.M., Kenny D.A. The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology 1986, 51:1173-1182.
7. Bishop D.V.M. Uncommon understanding: Development and disorders of language comprehension in children 1997, Psychology Press, United Kingdom.
8. Bishop D.V.M. Motor immaturity and specific speech and language impairment: Evidence for a common genetic basis. American Journal of Medical Genetics 2002, 114:56-63.
9. Bishop D.V.M. Overlaps between autism and language impairment: Phenomimicry or shared etiology?. Behavior Genetics 2010, 40:618-629.
10. Botting N. Nonverbal cognitive development and language impairment. Journal of Child Psychology and Psychiatry 2005, 46(3):317-326.
11. Bradshaw J.L. Developmental disorders of the frontostriatal system: Neuropsychological, neuropsychiatric, and evolutionary perspectives 2001, Taylor & Francis Inc., Philadelphia, USA.
12. Butz M.V., Sigaud O., Gérard P. Anticipatory behavior: Exploiting knowledge about the future to improve current behavior. Anticipatory behavior in adaptive learning systems: Foundations, theories, and systems 2003, 1-10. Springer-Verlag, Heidelberg, Berlin. M.V. Butz, O. Sigaud, P. Gérard (Eds.).
13. Chase H.W., Frank M.J., Michael A., Bullmore E.T., Sahakian B.J., Robbins T.W. Approach and avoidance learning in patients with major depression and healthy controls: Relation to anhedonia. Psychological Medicine 2009, 40(3):433-440.
14. Cheung C., Yu K., Fung G., Leung M., Wong C., Li Q., et al. Autistic disorders and schizophrenia: Related or remote? An anatomical likelihood estimation. PLoS ONE 2010, 5(8):1-8.
15. Chomsky N. A review of B. F. Skinner's Verbal Behavior. Language 1959, 35(1):26-58.
16. Clahsen H. The grammatical characterization of developmental dysphasia. Linguistics 1989, 27:897-920.
17. Cohen M.X., Frank M.J. Neurocomputational models of basal ganglia function in learning, memory, and choice. Behavioural Brain Research 2009, 1999:141-156.
18. Conway C.M., Pisoni D.B. Neurocognitive basis of implicit learning of sequential structure and its relation to language processing. Annals of the New York Academy of Sciences 2008, 1145:113-131.
19. Crosson B.A. Subcortical functions in language and memory 1992, The Guilford Press, New York, NY.
20. Dayan P., Niv Y. Reinforcement learning and the brain: The good, the bad and the ugly. Current Opinion in Neurobiology 2008, 18(2):185-196.
21. De Renzi E., Faglioni P. Normative data and screening power of a shortened version of the Token Test. Cortex 1978, 14:41-49.
22. Dennis M., Francis D.J., Cirino P.T., Schachar R., Barnes M.A., Fletcher J.M. Why IQ is not a covariate in cognitive studies of neurodevelopmental disorders. Journal of International Neuropsychological Society 2009, 15:331-343.
23. Dethorne L.S., Watkins R.V. Language abilities and nonverbal IQ in children with language impairment: Inconsistency across measures. Clinical Linguistics & Phonetics 2006, 20(9):641-658.
24. Doya K. What are the computations of the cerebellum, the basal ganglia, and the cerebral cortex?. Neural Networks 1999, 12:961-974.
25. Dunn L.M., Dunn D.M. Peabody picture vocabulary test-fourth edition (PPVT-4) 2007, Pearson, MN.
26. Durston S., van Belle J., de Zeeuw P. Differentiating frontostriatal and fronto-cerebellar circuits in attention-deficit/hyperactivity disorder. Biological Psychiatry 2011, 69(12):1178-1184.
27. Eichenbaum H., Cohen N.J. From conditioning to conscious recollection: Memory systems of the brain 2001, Oxford University Press, Oxford.
28. Endrass T., Kloft L., Kaufmann C., Kathmann N. Approach and avoidance learning in obsessive-compulsive disorder. Depression and Anxiety 2011, 28:166-172.
29. Evans J.L., Saffran J.R., Robe-Torres K. Statistical learning in children with Specific Language Impairment. Journal of Speech, Language, and Hearing Research 2009, 52:321-335.
30. Fisher S.E., Scharff C. FOXP2 as a molecular window into speech and language. Trends in Genetics 2009, 25(4):166-177.
31. Frank M.J. Dynamic dopamine modulation in the basal ganglia: A neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. Journal of Cognitive Neuroscience 2005, 17:51-72.
32. Frank M.J. Computational models of motivated action selection in corticostriatal circuits. Current Opinion in Neurobiology 2011, 21:381-386.
33. Frank M.J., Claus E.D. Anatomy of a decision: Striatal-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychological Review 2006, 113(2):300-326.
34. Frank M.J., Loughry B., O'Reilly R.C. Interactions between the frontal cortex and basal ganglia in working memory: A computational model. Cognitive, Affective, and Behavioral Neuroscience 2001, 1:137-160.
35. Frank M.J., Moustafa A.A., Haughey H.M., Curran T., Hutchison K.E. Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning. Proceedings of National Academy of Sciences 2007, 104(41):16311-16316.
36. Frank M.J., O'Reilly R.C., Curran T. When memory fails, intuition reigns: Midazolam enhances implicit inference in humans. Psychological Science 2006, 17(8):700-707.
37. Frank M.J., Santamaria A., O'Reilly R.C., Willcutt E. Testing computational models of dopamine and noradrenaline dysfunction in attention deficit/hyperactivity disorder. Neuropsychopharmacology 2007, 32:1583-1599.
38. Frank M.J., Seeberger L.C., O'Reilly R.C. By carrot and by stick: Cognitive reinforcement learning in Parkinsonism. Science 2004, 306:1940-1943.
39. Friederici A. The neural basis of language development and its impairment. Neuron 2006, 52:941-952.
40. Gabriel A., Maillart C., Guillaume M., Stefaniak N., Meulemans T. Exploration of serial structure procedural learning in children with language impairment. Journal of the International Neuropsychological Society 2011, 17:1-8.
41. Gabrieli J.D.E. Cognitive neuroscience of human memory. Annual Review of Psychology 1998, 49:87-115.
42. Grossman M., Kalmanson J., Bernhardt N., Morris J., Stern M.B., Hurtig H.I. Cognitive resource limitations during sentence comprehension in Parkinson's disease. Brain and Language 2000, 73:1-16.
43. Gupta P., Cohen N.J. Theoretical and computational analysis of skill learning, repetition priming, and procedural memory. Psychological Review 2002, 109(2):401-448.
44. Gupta P., Dell G.S. The emergence of language from serial order and procedural memory. The emergence of language, 28th Carnegie Mellon symposium on cognition 1999, Lawrence Erlbaum, Hillsdale, NJ. B. MacWhinney (Ed.).
45. Hall H., Sedvall G., Magnusson O., Kopp J., Halldin C., Farde L. Distribution of D1- and D2-dopamine receptors, and dopamine and its metabolites in the human brain. Neuropsychopharmacology 1994, 11(4):245-256.
46. Hammill, D. D., Brown, V. L., Larsen, S. C., & Wiederholt, J. L. (2007). Test of adolescent and adult language. Austin, TX: Pro-Ed.
47. Hedenius, M., Persson, J., Tremblay, A., Adi-Japha, E., Verissimo, J., Dye, C. D., et al. (in press). Grammar predicts procedural learning and consolidation deficits in children with specific language impairment. Research in Developmental Disabilities.
48. Hill E.L. Non-specific nature of specific language impairment: A review of the literature with regard to concomitant motor impairments. International Journal of Language Communication and Disorders 2001, 36(2):149-171.
49. Hill E.L. Motor difficulties in specific language impairment: Evidence for the Iverson account? - A commentary on Iverson's 'developing language in a developing body: The relationship between motor development and language development'. Journal of Child Language 2010, 37:287-292.
50. Hugdahl K., Gundersen H., Thomsen T., Rimol L.M., Ersland L., Niemi J. FMRI brain activation in a Finnish family with specific language impairment compared with a normal control group. Journal of Speech, Language, and Hearing Research 2004, 47:162-172.
51. Hwang J.W., Lee J., Kim B., Lee H., Lee D., Shin M., et al. Regional cerebral perfusion abnormalities in developmental language disorder: Statistical parametric mapping analysis. European Archives of Psychiatry and Clinical Neuroscience 2006, 256:131-137.
52. Im S., Park E.S., Kim D.Y., Song D.H., Lee J.D. The neuroradiological findings of children with developmental language disorder. Yonsei Medical Journal 2007, 48(3):405-411.
53. Jentschke S., Koelsch S., Sallat S., Friederici A.D. Children with specific language impairment also show impairment of music-syntactic processing. Journal of Cognitive Neuroscience 2008, 20(11):1940-1951.
54. Kemeny, F., & Lukacs, A. (2009). Impaired procedural learning in language impairment: Results from probabilistic categorization. Journal of Clinical and Experimental Neuropsychology, iFirst, 1-12.
55. Kirk R.E. Experimental design: Procedures for the behavioral sciences 1968, Wadsworth Publishing Company, Inc., Belmont, CA.
56. Lee, J. C., & Tomblin, J. B. (submitted). Examination of different aspects of procedural memory in young adults with developmental language impairment.
57. Leonard L.B. Children with specific language impairment 1997, MIT Press, MA.
58. Lieberman P. On the nature and evolution of the neural bases of human language. Yearbook of Physical Anthropology 2002, 45:36-62.
59. Longworth C.E., Keenan S.E., Barker R.A., Marslen-Wilson W.D., Tyler L.K. The basal ganglia and rule-governed language use: Evidence from vascular and degenerative conditions. Brain 2005, 128:584-596.
60. Lum, J. A. G., Conti-Ramsden, G., Page, D., & Ullman, M. (in press). Working, declarative, and procedural memory in specific language impairment. Cortex.
61. Lum J.A.G., Gelgec C., Conti-Ramsden G. Procedural and declarative memory in children with and without specific language impairment. International Journal of Language and Communication Disorders 2010, 45(1):96-107.
62. MacKinnon D.P., Lockwood C.M., Hoffman J.M., West S.G., Sheets V. A comparison of methods to test mediation and other intervening variable effects. Psychological Methods 2002, 7:83-104.
63. Marcus G.F. Negative evidence in language acquisition. Cognition 1993, 46:53-85.
64. Meador-Woodruff J.H. Update on dopamine receptors. Annals of Clinical Psychiatry 1994, 6(2):79-90.
65. Miller C.K., Kail R., Leonard L.B., Tomblin J.B. Speed of processing in children with specific language impairment. Journal of Speech, Language, and Hearing Research 2001, 44:416-433.
66. Misyak J.B., Christiansen M.H., Tomblin J.B. Sequential expectations: The role of prediction-based learning in language. Topics in Cognitive Science 2010, 2:138-153.
67. Morice R., McNicol D. The comprehension and production of complex syntax in schizophrenia. Cortex 1985, 21:567-580.
68. Nicolson R.I., Fawcett A.J. Procedural learning difficulties: Reuniting the developmental disorders?. Trends in Neurosciences 2007, 30(4):135-141.
69. Niv Y. Reinforcement learning in the brain. The Journal of mathematical psychology 2009, 53(3):139-154.
70. O'Doherty J., Dayan P., Friston K., Critchley H., Dolan R. Temporal difference learning model accounts for responses in human ventral striatum and orbitofrontal cortex during Pavlovian appetitive learning. Neuron 2003, 38:329-337.
71. Ors M., Ryding E., Lindgren M., Gustafsson P., Blennow G., Rosen I. SPECT findings in children with specific language impairment. Cortex 2005, 41:316-326.
72. Otten M., van Berkum J.J.A. Discourse-based word anticipation during language processing: Prediction or priming?. Discourse Processes 2008, 45(6):464-496.
73. Pizzagalli D.A., Evins A.E., Schetter E.C., Frank M.J., Pajtas P.E., Santesso D.L., et al. Single dose of a dopamine agonist impairs reinforcement learning in humans: Behavioral evidence from a laboratory-based measure of reward responsiveness. Psychopharmacology 2008, 196:221-232.
74. Poldrack R.A., Sabb F.W., Foerde K., Tom S.M., Asarnow R.F., Bookheimer S.Y., et al. The neural correlates of motor skill automaticity. Journal of Neuroscience 2005, 25:5356-5364.
75. Ramscar M., Yarlett D. Linguistic self-correction in the absence of feedback: New approach to the logical problem of language acquisition. Cognitive Science 2007, 31:927-960.
76. Redgrave P., Prescott T.J., Gurney K. The basal ganglia: A vertebrate solution to the selection problem?. Neuroscience 1999, 89:1009-1023.
77. Reimers-Kipping S., Hevers W., Paabo S., Enard W. Humanized FOXP2 specifically affects cortico-basal ganglia circuits. Neuroscience 2011, 175:75-84.
78. Rice M.L., Tomblin J.B., Hoffman L., Richman W.A., Marquis J. Grammatical tense deficits in children with DLI and nonspecific language impairment: Relationships with nonverbal IQ over time. Journal of Speech, Language, and Hearing Research 2004, 47:816-834.
79. Rice M.L., Wexler K., Cleave P.L. Specific language impairment as a period of extended optional infinitive. Journal of Speech and Hearing Research 1995, 38:850-863.
80. Saffran J.R. Statistical language learning: Mechanisms and constraints. Current Directions in Psychological Science 2003, 12(4):110-114.
81. Seger C.A. The basal ganglia in human learning. The Neuroscientist 2006, 12(4):285-290.
82. Seger C.A. The involvement of corticostriatal loops in learning across tasks, species, and methodologies. The basal ganglia IX: Advances in behavioral biology 58 2009, Springer, NY. H.J. Groenewegen (Ed.).
83. Shohamy D., Myers C.E., Grossman S., Sage J., Gluck M.A. The role of dopamine in cognitive sequence learning: Evidence from Parkinson's disease. Behavioural Brain Research 2005, 156:191-199.
84. Shohamy D., Myers C.E., Kalanithi J., Gluck M.A. Basal ganglia and dopamine contributions to probabilistic category learning. Neuroscience and Biobehavioral Reviews 2007, 10.1016/j.neubiorev.2007.07.008.
85. Simon J.R., Howard J.H., Howard D.V. Adult age differences in learning from positive and negative probabilistic feedback. Neuropsychology 2010, 24(4):534-541.
86. Solomon M., Smith A.C., Frank M.J., Ly S., Carter C.S. Probabilistic reinforcement learning in adults with autism spectrum disorders. Autism Research 2011, 4(2):109-120.
87. Sutton R., Barto A.G. Reinforcement learning: An introduction 1998, MIT Press, Cambridge.
88. Swarup S., Gasser L. The role of anticipation in the emergence of language. LNAI 4520: Anticipatory behavior in adaptive learning systems 2006, 35-56. Springer, NY. M.V. Butz (Ed.).
89. Swisher L., Plante E., Lowell S. Nonlinguistic deficits of children with language disorders complicate the interpretation of their nonverbal IQ scores. Language, Speech, and Hearing Services in Schools 1994, 25:235-240.
90. Teichmann M., Dupoux E., Kouider S., Brugieres P., Boisse M., Baudic S., et al. The role of the striatum in rule application: The model of Huntington's disease at early stage. Brain 2005, 128:1155-1167.
91. Teichmann M., Gaura V., Demonet J., Supiot F., Delliaux M., Verny C., et al. Language processing within the striatum: Evidence from a PET correlation study in Huntington's disease. Brain 2008, 131:1046-1056.
92. Tomblin J.B. Co-morbidity of autism and SLI: Kinds, kin and complexity. International Journal of Language and Communication Disorders 2011, 46(2):127-137.
93. Tomblin J.B., Mainela-Arnold E., Zhang X. Procedural learning in adolescents with and without specific language impairment. Language Learning and Development 2007, 3:269-293.
94. Tomblin J.B., Records N.L., Zhang X. A system for the diagnosis of specific language impairment in kindergarten children. Journal of Speech & Hearing Research 1996, 39:1284-1294.
95. Tomblin J.B., Zhang X. Are children with DLI a unique group of language learners?. Neurodevelopmental disorders: Contributions to a new framework from the cognitive neurosciences 1999, 361-382. MIT Press, Cambridge, MA. H. Tager-Flusberg (Ed.).
96. Tripp G., Wickens J.R. Research Review: Dopamine transfer deficit: a neurobiological theory of altered reinforcement mechanisms in ADHD. The Journal of Child Psychology and Psychiatry 2008, 49(7):691-704.
97. Ullman M.T. A neurocognitive perspective on language: The declarative/procedural model. National Review of Neuroscience 2001, 2:717-726.
98. Ullman M.T. Contributions of memory circuits to language: The declarative/procedural model. Cognition 2004, 92:231-270.
99. Ullman M.T., Pierpont E.I. Specific language impairment is not specific to language: The procedural deficit hypothesis. Cortex 2005, 41:399-433.
100. van der Lely H.K.J. Domain-specific cognitive systems: Insight from grammatical-SLI. Trends in Cognitive Sciences 2005, 9:53-59.
101. Vargha-Khadem F., Watkins K.E., Price C.J., Ashburner J., Alcock K.J., Connelly A., et al. Neural basis of an inherited speech and language disorder. Proceedings of the National Academy of Sciences of the United States of America 1998, 95:12695-12700.
102. Waltz J.A., Frank M.J., Robinson B.M., Gold J.M. Selective reinforcement learning deficits in schizophrenia support predictions from computational models of striatal-cortical dysfunction. Biological Psychiatry 2007, 62:756-764.
103. Wechsler D. Wechsler abbreviated scale of intelligence (WASI) 1999, The Psychological Corporation, San Antonio, TX.
104. Wells J.B., Christiansen M.H., Race D.S., Acheson D.J., MacDonald M.C. Experience and sentence processing: Statistical learning and relative clause comprehension. Cognitive Psychology 2009, 58(2):250-271.
105. Wickens J.R., Arbuthnott G.W. Gating of cortical input to the striatum. Handbook of basal ganglia structure and function: A decade of progress 2010, 341-352. Elsevier, Amsterdam. H. Steiner, K.Y. Tseng (Eds.).
106. Williams D., Stott C.M., Goodyer I.M., Sahakian B.J. Specific language impairment with or without hyperactivity: Neuropsychological evidence for frontostriatal dysfunction. Developmental Medicine and Child Neurology 2000, 42:368-375.