Distinct linear and non-linear trajectories of reward and punishment reversal learning during development: Relevance for dopamine's role in adolescent decision making

Developmental Cognitive Neuroscience

Volumn 1, Issue 4, 2011, Pages 578-590

  Van Der Schaaf, Marieke E ^a,b   Warmerdam, Eveline ^c   Crone, Eveline A ^c   Cools, Roshan ^a,b  

^a RADBOUD UNIVERSITY   (Netherlands)

^b RADBOUD UNIVERSITY MEDICAL CENTER   (Netherlands)

^c LEIDEN UNIVERSITY   (Netherlands)

Author keywords

Adolescence; Decision making; Dopamine; Punishment; Reversal learning; Reward

Indexed keywords

DOPAMINE;

ADOLESCENT; ADULT; AGE DISTRIBUTION; ARTICLE; BEHAVIOR; BRAIN FUNCTION; CHILD; CONTROLLED STUDY; DECISION MAKING; DEVELOPMENT; DOPAMINE BRAIN LEVEL; DOPAMINERGIC ACTIVITY; FEMALE; HIGH RISK BEHAVIOR; HUMAN; LEARNING; LINEAR SYSTEM; MALE; NEGATIVE FEEDBACK; NEUROBIOLOGY; NONLINEAR SYSTEM; OUTCOME ASSESSMENT; PRIORITY JOURNAL; PUNISHMENT; REWARD; SCHOOL CHILD; STIMULUS RESPONSE; TASK PERFORMANCE;

ADOLESCENT; ADOLESCENT BEHAVIOR; CHILD; DECISION MAKING; DOPAMINE; FEMALE; HUMANS; LINEAR MODELS; MALE; NONLINEAR DYNAMICS; PHOTIC STIMULATION; REVERSAL LEARNING; REWARD; YOUNG ADULT;

EID: 80052770337     PISSN: 18789293     EISSN: 18789307     Source Type: Journal    
DOI: 10.1016/j.dcn.2011.06.007     Document Type: Article

References (54)

1. J.J. Arnett Adolescent storm and stress, reconsidered Am. Psychol. 54 5 1999 317 326
2. B.W. Balleine, and J.P. O'Doherty Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action Neuropsychopharmacology 35 1 2010 48 69
3. A. Bauma, J. Mulder, and J. Lindeboom Neuropsychologische Diagnostiek: Handboek 1998 Swets & Zeitlinger Lisse, the Netherlands
4. J.M. Bjork, B. Knutson, G.W. Fong, D.M. Caggiano, S.M. Bennett, and D.W. Hommer Incentive-elicited brain activation in adolescents: similarities and differences from young adults J. Neurosci. 24 8 2004 1793 1802 (Pubitemid 38292790)
5. J.M. Bjork, A.R. Smith, G. Chen, and D.W. Hommer Adolescents, adults and rewards: comparing motivational neurocircuitry recruitment using fMRI PLoS One 5 7 2010 e11440
6. B.J. Casey, S. Getz, and A. Galvan The adolescent brain Dev. Rev. 28 1 2008 62 77
7. B.J. Casey, S. Duhoux, and M. Malter Cohen Adolescence: what do transmission, transition, and translation have to do with it? Neuron 67 5 2010 749 760
8. B.J. Casey, and R.M. Jones Neurobiology of the adolescent brain and behavior: implications for substance use disorders J. Am. Acad. Child Adolesc. Psychiatry 49 12 2010 1189 1201 quiz 1285
9. E. Cauffman, E.P. Shulman, L. Steinberg, E. Claus, M.T. Banich, S. Graham, and J. Woolard Age differences in affective decision making as indexed by performance on the Iowa Gambling Task Dev. Psychol. 46 1 2010 193 207
10. J.R. Cohen, R.F. Asarnow, F.W. Sabb, R.M. Bilder, S.Y. Bookheimer, B.J. Knowlton, and R.A. Poldrack A unique adolescent response to reward prediction errors Nat. Neurosci. 13 6 2010 669 671
11. R. Cools, L. Altamirano, and M. D'Esposito Reversal learning in Parkinson's disease depends on medication status and outcome valence Neuropsychologia 44 10 2006 1663 1673 (Pubitemid 43928015)
12. R. Cools, O.J. Robinson, and B. Sahakian Acute tryptophan depletion in healthy volunteers enhances punishment prediction but does not affect reward prediction Neuropsychopharmacology 33 9 2008 2291 2299 (Pubitemid 351992074)
13. R. Cools, M.J. Frank, S.E. Gibbs, A. Miyakawa, W. Jagust, and M. D'Esposito Striatal dopamine predicts outcome-specific reversal learning and its sensitivity to dopaminergic drug administration J. Neurosci. 29 5 2009 1538 1543
14. E.A. Crone, and M.W. van der Molen Developmental changes in real life decision making: performance on a gambling task previously shown to depend on the ventromedial prefrontal cortex Dev. Neuropsychol. 25 3 2004 251 279 (Pubitemid 38725191)
15. E.A. Crone, K. Zanolie, L. Van Leijenhorst, P.M. Westenberg, and S.A. Rombouts Neural mechanisms supporting flexible performance adjustment during development Cogn. Affect. Behav. Neurosci. 8 2 2008 165 177
16. P. Dayan, Y. Niv, B. Seymour, and N.D. Daw The misbehavior of value and the discipline of the will Neural Netw. 19 8 2006 1153 1160 (Pubitemid 44466331)
17. T.L. Doremus-Fitzwater, E.I. Varlinskaya, and L.P. Spear Motivational systems in adolescence: possible implications for age differences in substance abuse and other risk-taking behaviors Brain Cogn. 72 1 2010 114 123
18. M. Ernst, E.E. Nelson, S. Jazbec, E.B. McClure, C.S. Monk, E. Leibenluft, J. Blair, and D.S. Pine Amygdala and nucleus accumbens in responses to receipt and omission of gains in adults and adolescents Neuroimage 25 4 2005 1279 1291 (Pubitemid 40591669)
19. M. Ernst, and J.L. Fudge A developmental neurobiological model of motivated behavior: anatomy, connectivity and ontogeny of the triadic nodes Neurosci. Biobehav. Rev. 33 3 2009 367 382
20. B. Figner, R.J. Mackinlay, F. Wilkening, and E.U. Weber Affective and deliberative processes in risky choice: age differences in risk taking in the Columbia Card Task J. Exp. Psychol. Learn. Mem. Cogn. 35 3 2009 709 730
21. S.B. Flagel, S.J. Watson, H. Akil, and T.E. Robinson Individual differences in the attribution of incentive salience to a reward-related cue: influence on cocaine sensitization Behav. Brain Res. 186 1 2008 48 56 (Pubitemid 350100888)
22. M.J. Frank, A.A. Moustafa, H.M. Haughey, T. Curran, and K.E. Hutchison Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning Proc. Natl. Acad. Sci. U. S. A. 104 41 2007 16311 16316 (Pubitemid 350099356)
23. M.J. Frank, and K. Hutchison Genetic contributions to avoidance-based decisions: striatal D2 receptor polymorphisms Neuroscience 164 1 2009 131 140
24. A. Galvan, T.A. Hare, C.E. Parra, J. Penn, H. Voss, G. Glover, and B.J. Casey Earlier development of the accumbens relative to orbitofrontal cortex might underlie risk-taking behavior in adolescents J. Neurosci. 26 25 2006 6885 6892 (Pubitemid 44315249)
25. C.F. Geier, R. Terwilliger, T. Teslovich, K. Velanova, and B. Luna Immaturities in reward processing and its influence on inhibitory control in adolescence Cereb. Cortex 20 7 2010 1613 1629
26. A.E. Guyer, C.S. Monk, E.B. McClure-Tone, E.E. Nelson, R. Roberson-Nay, A.D. Adler, S.J. Fromm, E. Leibenluft, D.S. Pine, and M. Ernst A developmental examination of amygdala response to facial expressions J. Cogn. Neurosci. 20 9 2008 1565 1582
27. T.A. Hare, N. Tottenham, A. Galvan, H.U. Voss, G.H. Glover, and B.J. Casey Biological substrates of emotional reactivity and regulation in adolescence during an emotional go-nogo task Biol. Psychiatry 63 10 2008 927 934 (Pubitemid 351602274)
28. D.C. Howell Statistical Methods for Psychology 1997 Wadsworth Publishing Company
29. P.C. Koolschijn, M.A. Schel, M. de Rooij, S.A. Rombouts, and E.A. Crone A three-year longitudinal functional magnetic resonance imaging study of performance monitoring and test-retest reliability from childhood to early adulthood J. Neurosci. 31 11 2011 4204 4212
30. C. Kuhn, M. Johnson, A. Thomae, B. Luo, S.A. Simon, G. Zhou, and Q.D. Walker The emergence of gonadal hormone influences on dopaminergic function during puberty Horm. Behav. 58 1 2010 122 137
31. T.V. Maia Reinforcement learning, conditioning, and the brain: successes and challenges Cogn. Affect. Behav. Neurosci. 9 4 2009 343 364
32. T.V. Maia, and M.J. Frank From reinforcement learning models to psychiatric and neurological disorders Nat. Neurosci. 14 2 2011 154 162
33. P.R. Montague, P. Dayan, and T.J. Sejnowski A framework for mesencephalic dopamine systems based on predictive Hebbian learning J. Neurosci. 16 5 1996 1936 1947 (Pubitemid 26145969)
34. E.E. Nelson, E. Leibenluft, E.B. McClure, and D.S. Pine The social re-orientation of adolescence: a neuroscience perspective on the process and its relation to psychopathology Psychol. Med. 35 2 2005 163 174 (Pubitemid 40259909)
35. J. O'Doherty, P. Dayan, J. Schultz, R. Deichmann, K. Friston, and R.J. Dolan Dissociable roles of ventral and dorsal striatum in instrumental conditioning Science 304 5669 2004 452 454 (Pubitemid 38495943)
36. A. Qiu, D. Crocetti, M. Adler, E.M. Mahone, M.B. Denckla, M.I. Miller, and S.H. Mostofsky Basal ganglia volume and shape in children with attention deficit hyperactivity disorder Am. J. Psychiatry 166 1 2009 74 82
37. J. Raven, J.C. Raven, and J.H. Court Manual for Raven's Progressive Matrices and Vocabulary Scales. Section 1: General Overview, San Antonia TX, Hardcourt Assessment 1998
38. O.J. Robinson, M.J. Frank, B.J. Sahakian, and R. Cools Dissociable responses to punishment in distinct striatal regions during reversal learning Neuroimage 51 4 2010 1459 1467
39. O.J. Robinson, H.R. Standing, E.E. DeVito, R. Cools, and B.J. Sahakian Dopamine precursor depletion improves punishment prediction during reversal learning in healthy females but not males Psychopharmacology (Berl) 211 2 2010 187 195
40. A. Scheres, M.P. Milham, B. Knutson, and F.X. Castellanos Ventral striatal hyporesponsiveness during reward anticipation in attention-deficit/ hyperactivity disorder Biol. Psychiatry 61 5 2007 720 724 (Pubitemid 46328856)
41. P. Shaw, N.J. Kabani, J.P. Lerch, K. Eckstrand, R. Lenroot, N. Gogtay, D. Greenstein, L. Clasen, A. Evans, J.L. Rapoport, J.N. Giedd, and S.P. Wise Neurodevelopmental trajectories of the human cerebral cortex J. Neurosci. 28 14 2008 3586 3594
42. L.J. Sobel, R. Bansal, T.V. Maia, J. Sanchez, L. Mazzone, K. Durkin, J. Liu, X. Hao, I. Ivanov, A. Miller, L.L. Greenhill, and B.S. Peterson Basal ganglia surface morphology and the effects of stimulant medications in youth with attention deficit hyperactivity disorder Am. J. Psychiatry 167 8 2010 977 986
43. L.H. Somerville, T. Hare, and B.J. Casey Frontostriatal maturation predicts cognitive control failure to appetitive cues in adolescents J. Cogn. Neurosci. 2010
44. L.H. Somerville, R.M. Jones, and B.J. Casey A time of change: behavioral and neural correlates of adolescent sensitivity to appetitive and aversive environmental cues Brain Cogn. 72 1 2010 124 133
45. L. Steinberg A dual systems model of adolescent risk-taking Dev. Psychobiol. 52 3 2010 216 224
46. R.S. Sutton, and A.G. Barto Reinforcement Learning: An Introduction 1998 MIT Press Cambridge, MA
47. M.H. Teicher, S.L. Andersen, and J.C. Hostetter Jr. Evidence for dopamine receptor pruning between adolescence and adulthood in striatum but not nucleus accumbens Brain Res. Dev. Brain Res. 89 2 1995 167 172
48. E. Tricomi, B.W. Balleine, and J.P. O'Doherty A specific role for posterior dorsolateral striatum in human habit learning Eur. J. Neurosci. 29 11 2009 2225 2232
49. V.V. Valentin, and J.P. O'Doherty Overlapping prediction errors in dorsal striatum during instrumental learning with juice and money reward in the human brain J Neurophysiol. 102 6 2009 3384 3391
50. W. van den Bos, B. Guroglu, B.G. van den Bulk, S.A. Rombouts, and E.A. Crone Better than expected or as bad as you thought? The neurocognitive development of probabilistic feedback processing Front. Hum. Neurosci. 3 2009 52
51. A.C. van Duijvenvoorde, K. Zanolie, S.A. Rombouts, M.E. Raijmakers, and E.A. Crone Evaluating the negative or valuing the positive? Neural mechanisms supporting feedback-based learning across development J. Neurosci. 28 38 2008 9495 9503
52. L. Van Leijenhorst, B.G. Moor, Z.A. Op de Macks, S.A. Rombouts, P.M. Westenberg, and E.A. Crone Adolescent risky decision-making: neurocognitive development of reward and control regions Neuroimage 51 1 2010 345 355
53. L. Van Leijenhorst, K. Zanolie, C.S. Van Meel, P.M. Westenberg, S.A. Rombouts, and E.A. Crone What motivates the adolescent? Brain regions mediating reward sensitivity across adolescence Cereb. Cortex 20 1 2010 61 69
54. D. Wahlstrom, T. White, and M. Luciana Neurobehavioral evidence for changes in dopamine system activity during adolescence Neurosci. Biobehav. Rev. 34 5 2010 631 648