Two sides of the same coin: Learning via positive and negative reinforcers in the human striatum

Developmental Cognitive Neuroscience

Volumn 1, Issue 4, 2011, Pages 494-505

  Niznikiewicz, Michael A ^a   Delgado, Mauricio R ^a  

^a RUTGERS UNIVERSITY   (United States)

Author keywords

Approach; Avoidance; Caudate; Cingulate gyrus; Dopamine; Nucleus accumbens; Reinforcement learning; Ventral striatum

Indexed keywords

ADULT; ANALYSIS OF VARIANCE; ARTICLE; AVOIDANCE BEHAVIOR; BOLD SIGNAL; BRAIN FUNCTION; CINGULATE GYRUS; CONTROLLED STUDY; CORPUS STRIATUM; ELECTRODERMAL RESPONSE; FEMALE; FRONTAL GYRUS; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HANDEDNESS; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; LEARNING; MALE; MOLECULAR DYNAMICS; MOTIVATION; NEUROIMAGING; NORMAL HUMAN; NUCLEUS ACCUMBENS; PRIORITY JOURNAL; REACTION TIME; REINFORCEMENT; REWARD; SIGNAL TRANSDUCTION;

ADOLESCENT; ADULT; AVOIDANCE LEARNING; CORPUS STRIATUM; FEMALE; GAMBLING; HUMANS; LEARNING; MALE; PHOTIC STIMULATION; REACTION TIME; REINFORCEMENT (PSYCHOLOGY); YOUNG ADULT;

EID: 80052746455     PISSN: 18789293     EISSN: 18789307     Source Type: Journal    
DOI: 10.1016/j.dcn.2011.07.006     Document Type: Article

References (59)

1. G.E. Alexander, M.R. DeLong, and P.L. Strick Parallel organization of functionally segregated circuits linking basal ganglia and cortex Annu. Rev. Neurosci. 9 1986 357 381 (Pubitemid 16055790)
2. A. Bechara, D. Tranel, H. Damasio, R. Adolphs, C. Rockland, and A.R. Damasio Double dissociation of conditioning and declarative knowledge relative to the amygdala and hippocampus in humans Science 269 1995 1115 1118
3. L.A. Beck, and M.S. Clark Choosing to enter or avoid diagnostic social situations Psychol. Sci. 20 2009 1175 1181
4. G.S. Berns, S.M. McClure, G. Pagnoni, and P.R. Montague Predictability modulates human brain response to reward J. Neurosci. 21 2001 2793 2798 (Pubitemid 32298220)
5. J.M. Bjork, B. Knutson, G.W. Fong, D.M. Caggiano, S.M. Bennett, and D.W. Hommer Incentive-elicited brain activation in adolescents: similarities and differences from young adults J. Neurosci. 24 2004 1793 1802 (Pubitemid 38292790)
6. H.C. Breiter, I. Aharon, D. Kahneman, A. Dale, and P. Shizgal Functional imaging of neural responses to expectancy and experience of monetary gains and losses Neuron 30 2001 619 639 (Pubitemid 32530601)
7. C. Cain, and J.E. Ledoux Emotional processing and motivation: in search of brain mechanisms A. Elliot, Handbook of Approach and Avoidance Motivation 2008 Taylor & Francis Group, LLC
8. B.J. Casey, R.M. Jones, and T.A. Hare The adolescent brain Ann. N.Y. Acad. Sci. 1124 2008 111 126 (Pubitemid 351506787)
9. H.C. Cromwell, and W. Schultz Effects of expectations for different reward magnitudes on neuronal activity in primate striatum J. Neurophysiol. 89 2003 2823 2838 (Pubitemid 36570241)
10. B. De Martino, D. Kumaran, B. Holt, and R.J. Dolan The neurobiology of reference-dependent value computation J. Neurosci. 29 2009 3833 3842
11. M.R. Delgado Reward-related responses in the human striatum Ann. N.Y. Acad. Sci. 1104 2007 70 88 (Pubitemid 47092728)
12. M.R. Delgado, R.L. Jou, J.E. Ledoux, and E.A. Phelps Avoiding negative outcomes: tracking the mechanisms of avoidance learning in humans during fear conditioning Front. Behav. Neurosci. 3 2009 33
13. M.R. Delgado, C.D. Labouliere, and E.A. Phelps Fear of losing money? Aversive conditioning with secondary reinforcers Soc. Cogn. Affect. Neurosci. 1 2006 250 259
14. M.R. Delgado, J. Li, D. Schiller, and E.A. Phelps The role of the striatum in aversive learning and aversive prediction errors Philos. Trans. R. Soc. Lond. B: Biol. Sci. 363 2008 3787 3800
15. M.R. Delgado, M.M. Miller, S. Inati, and E.A. Phelps An fMRI study of reward-related probability learning Neuroimage 24 2005 862 873 (Pubitemid 40094568)
16. M.R. Delgado, L.E. Nystrom, C. Fissell, D.C. Noll, and J.A. Fiez Tracking the hemodynamic responses to reward and punishment in the striatum J. Neurophysiol. 84 2000 3072 3077
17. M. Ernst, and J.L. Fudge A developmental neurobiological model of motivated behavior: anatomy, connectivity and ontogeny of the triadic nodes Neurosci. Biobehav. Rev. 33 2009 367 382
18. M. Ernst, E.E. Nelson, S. Jazbec, E.B. McClure, C.S. Monk, E. Leibenluft, J. Blair, and D.S. Pine Amygdala and nucleus accumbens in responses to receipt and omission of gains in adults and adolescents Neuroimage 25 2005 1279 1291 (Pubitemid 40591669)
19. M. Ernst, D.S. Pine, and M. Hardin Triadic model of the neurobiology of motivated behavior in adolescence Psychol. Med. 36 2006 299 312
20. S.D. Forman, J.D. Cohen, M. Fitzgerald, W.F. Eddy, M.A. Mintun, and D.C. Noll Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold Magn. Reson. Med. 33 1995 636 647
21. A. Galvan, T.A. Hare, M. Davidson, J. Spicer, G. Glover, and B.J. Casey The role of ventral frontostriatal circuitry in reward-based learning in humans J. Neurosci. 25 2005 8650 8656 (Pubitemid 41362041)
22. R. Goebel, F. Esposito, and E. Formisano Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: from single-subject to cortically aligned group general linear model analysis and self-organizing group independent component analysis Hum Brain Mapp. 27 2006 392 401 (Pubitemid 43787637)
23. J.A. Gottfried, J. O'Doherty, and R.J. Dolan Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging J. Neurosci. 22 2002 10829 10837 (Pubitemid 36005157)
24. A.E. Guyer, E.E. Nelson, K. Perez-Edgar, M.G. Hardin, R. Roberson-Nay, C.S. Monk, J.M. Bjork, H.A. Henderson, D.S. Pine, N.A. Fox, and M. Ernst Striatal functional alteration in adolescents characterized by early childhood behavioral inhibition J. Neurosci. 26 2006 6399 6405 (Pubitemid 44318320)
25. S.N. Haber, and B. Knutson The reward circuit: linking primate anatomy and human imaging Neuropsychopharmacology 35 2010 4 26
26. M. Haruno, T. Kuroda, K. Doya, K. Toyama, M. Kimura, K. Samejima, H. Imamizu, and M. Kawato A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task J. Neurosci. 24 2004 1660 1665 (Pubitemid 38240962)
27. O.K. Hassani, H.C. Cromwell, and W. Schultz Influence of expectation of different rewards on behavior-related neuronal activity in the striatum J. Neurophysiol. 85 2001 2477 2489 (Pubitemid 32525526)
28. J. Jensen, A.R. McIntosh, A.P. Crawley, D.J. Mikulis, G. Remington, and S. Kapur Direct activation of the ventral striatum in anticipation of aversive stimuli Neuron 40 2003 1251 1257 (Pubitemid 38032799)
29. J. Jensen, A.J. Smith, M. Willeit, A.P. Crawley, D.J. Mikulis, I. Vitcu, and S. Kapur Separate brain regions code for salience vs. valence during reward prediction in humans Hum Brain Mapp. 28 2007 294 302 (Pubitemid 46542911)
30. D. Kahneman, and A. Tversky Prospect theory: an analysis of decision under risk Econometrica 47 1979 263 292
31. B. Knutson, C.M. Adams, G.W. Fong, and D. Hommer Anticipation of increasing monetary reward selectively recruits nucleus accumbens J. Neurosci. 21 2001 RC159
32. K.S. LaBar, J.C. Gatenby, J.C. Gore, J.E. LeDoux, and E.A. Phelps Human amygdala activation during conditioned fear acquisition and extinction: a mixed-trial fMRI study Neuron 20 1998 937 945 (Pubitemid 28247399)
33. K.S. LaBar, J.E. LeDoux, D.D. Spencer, and E.A. Phelps Impaired fear conditioning following unilateral temporal lobectomy in humans J. Neurosci. 15 1995 6846 6855
34. J.E. LeDoux, and J.M. Gorman A call to action: overcoming anxiety through active coping Am. J. Psychiatry 158 2001 1953 1955 (Pubitemid 33104098)
35. J.C. May, M.R. Delgado, R.E. Dahl, V.A. Stenger, N.D. Ryan, J.A. Fiez, and C.S. Carter Event-related functional magnetic resonance imaging of reward-related brain circuitry in children and adolescents Biol. Psychiatry 55 2004 359 366 (Pubitemid 38199985)
36. F.A. Middleton, and P.L. Strick Basal ganglia output and cognition: evidence from anatomical, behavioral, and clinical studies Brain Cogn. 42 2000 183 200 (Pubitemid 30187451)
37. P.R. Montague, and G.S. Berns Neural economics and the biological substrates of valuation Neuron 36 2002 265 284 (Pubitemid 35217891)
38. J.P. O'Doherty Reward representations and reward-related learning in the human brain: insights from neuroimaging Curr. Opin. Neurobiol. 14 2004 769 776 (Pubitemid 39576211)
39. J.P. O'Doherty, P. Dayan, K. Friston, H. Critchley, and R.J. Dolan Temporal difference models and reward-related learning in the human brain Neuron 38 2003 329 337 (Pubitemid 36555657)
40. K.N. Ochsner, and J.J. Gross The cognitive control of emotion Trends Cogn. Sci. 9 2005 242 249 (Pubitemid 40615112)
41. A. Pasupathy, and E.K. Miller Different time courses of learning-related activity in the prefrontal cortex and striatum Nature 433 2005 873 876 (Pubitemid 40314896)
42. E.A. Phelps, and J.E. LeDoux Contributions of the amygdala to emotion processing: from animal models to human behavior Neuron 48 2005 175 187 (Pubitemid 41476352)
43. A. Rangel, C. Camerer, and P.R. Montague A framework for studying the neurobiology of value-based decision making Nat. Rev. Neurosci. 9 2008 545 556 (Pubitemid 351873461)
44. V.F. Reyna, S.M. Estrada, J.A. Demarinis, R.M. Myers, J.M. Stanisz, and B.A. Mills Neurobiological and memory models of risky decision making in adolescents versus young adults J. Exp. Psychol. Learn. Mem. Cogn. 2011
45. T.W. Robbins, and B.J. Everitt Neurobehavioural mechanisms of reward and motivation Curr. Opin. Neurobiol. 6 1996 228 236 (Pubitemid 26168482)
46. M.W. Schlund, and M.F. Cataldo Amygdala involvement in human avoidance, escape and approach behavior Neuroimage 53 2010 769 776
47. M.W. Schlund, G.J. Siegle, C.D. Ladouceur, J.S. Silk, M.F. Cataldo, E.E. Forbes, R.E. Dahl, and N.D. Ryan Nothing to fear? Neural systems supporting avoidance behavior in healthy youths Neuroimage 52 2010 710 719
48. T. Schonberg, N.D. Daw, D. Joel, and J.P. O'Doherty Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making J. Neurosci. 27 2007 12860 12867 (Pubitemid 350159584)
49. B. Seymour, N. Daw, P. Dayan, T. Singer, and R. Dolan Differential encoding of losses and gains in the human striatum J. Neurosci. 27 2007 4826 4831 (Pubitemid 46699059)
50. B. Seymour, J.P. O'Doherty, P. Dayan, M. Koltzenburg, A.K. Jones, R.J. Dolan, K.J. Friston, and R.S. Frackowiak Temporal difference models describe higher-order learning in humans Nature 429 2004 664 667 (Pubitemid 38812318)
51. B.F. Skinner The Behavior of Organisms: An Experimental Analysis 1938 Copley Publishing Group Cambridge
52. J. Talairach, and P. Tournoux Co-Planar Stereotaxic Atlas of the Human Brain 1988 Thieme Medical Publishers, Inc. New York
53. P.N. Tobler, P.C. Fletcher, E.T. Bullmore, and W. Schultz Learning-related human brain activations reflecting individual finances Neuron 54 2007 167 175 (Pubitemid 46498687)
54. S.M. Tom, C.R. Fox, C. Trepel, and R.A. Poldrack The neural basis of loss aversion in decision-making under risk Science 315 2007 515 518 (Pubitemid 46175755)
55. E.M. Tricomi, M.R. Delgado, and J.A. Fiez Modulation of caudate activity by action contingency Neuron 41 2004 281 292 (Pubitemid 38125188)
56. W. van den Bos, B. Guroglu, B.G. van den Bulk, S.A. Rombouts, and E.A. Crone Better than expected or as bad as you thought? The neurocognitive development of probabilistic feedback processing Front. Hum. Neurosci. 3 2009 52
57. L. Van Leijenhorst, B. Gunther Moor, Z.A. Op de Macks, S.A. Rombouts, P.M. Westenberg, and E.A. Crone Adolescent risky decision-making: neurocognitive development of reward and control regions Neuroimage 51 2010 345 355
58. J. Yacubian, J. Glascher, K. Schroeder, T. Sommer, D.F. Braus, and C. Buchel Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain J. Neurosci. 26 2006 9530 9537 (Pubitemid 44396866)
59. C.F. Zink, G. Pagnoni, M.E. Martin-Skurski, J.C. Chappelow, and G.S. Berns Human striatal responses to monetary reward depend on saliency Neuron 42 2004 509 517 (Pubitemid 38610148)