Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain

Journal of Neuroscience

Volumn 26, Issue 37, 2006, Pages 9530-9537

  Yacubian, Juliana ^a   Gläscher, Jan ^a,b   Schroeder, Katrin ^a   Sommer, Tobias ^a   Braus, Dieter F ^a   Büchel, Christian ^a  

^a UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

^b CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Amygdala; Dopaminergic; fMRI; Prediction error; Punishment; Ventral striatum

Indexed keywords

ADULT; AMYGDALOID NUCLEUS; ARTICLE; BRAIN FUNCTION; CORPUS STRIATUM; DISSOCIATION; ERROR; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; IMAGE PROCESSING; MAJOR DEPRESSION; MALE; NORMAL HUMAN; PATHOPHYSIOLOGY; PREDICTION; PREVALENCE; PRIORITY JOURNAL; REWARD; SIGNAL TRANSDUCTION;

ADULT; AMYGDALA; BASAL GANGLIA; BRAIN MAPPING; COGNITION; COHORT STUDIES; DOPAMINE; GAMBLING; HUMANS; JUDGMENT; MAGNETIC RESONANCE IMAGING; MALE; MOOD DISORDERS; NEURAL PATHWAYS; NEUROPSYCHOLOGICAL TESTS; REWARD; THINKING; VENTRAL TEGMENTAL AREA;

EID: 33748709841     PISSN: 02706474     EISSN: 02706474     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2915-06.2006     Document Type: Article

References (51)

1. Abler B, Walter H, Erk S, Kammerer H, Spitzer M (2006) Prediction error as a linear function of reward probability is coded in human nucleus accumbens. NeuroImage 31:790-795.
2. Aggleton JP (2000) The amygdala. A functional analysis. Oxford: Oxford UP.
3. Bayer HM, Glimcher PW (2005) Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47:129-141.
4. Berns GS, McClure SM, Pagnoni G, Montague PR (2001) Predictability modulates human brain response to reward. J Neurosci 21:2793-2798.
5. Bless EP, McGinnis KA, Mitchell AL, Hartwell A, Mitchell JB (1994) The effects of gonadal steroids on brain stimulation reward in female rats. Behav Brain Res 82:235-244.
6. Breiter HC, Aharon I, Kahneman D, Dale A, Shizgal P (2001) Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 30:619-639.
7. Büchel C, Morris J, Dolan RJ, Friston KJ (1998) Brain systems mediating aversive conditioning: an event-related fMRI study. Neuron 20:947-957.
8. Coricelli G, Critchley HD, Joffily M, O'Doherty JP, Sirigu A, Dolan RJ (2005) Regret and its avoidance: a neuroimaging study of choice behavior. Nat Neurosci 8:1255-1262.
9. Daw ND, Kakade S, Dayan P (2002) Opponent interactions between serotonin and dopamine. Neural Netw 15:603-616.
10. Delgado MR, Locke HM, Stenger VA, Fiez JA (2003) Dorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations. Cogn Affect Behav Neurosci 3:27-38.
11. Dreher JC, Kohn P, Berman KF (2006) Neural coding of distinct statistical properties of reward information in humans. Cereb Cortex 16:561-573.
12. Edwards W (1955) The prediction of decisions among bets. J Exp Psychol 50:201-214.
13. Elliott R, Friston KJ, Dolan RJ (2000) Dissociable neural responses in human reward systems. J Neurosci 20:6159-6165.
14. Elliott R, Newman J, Longe O, Deakin J (2004) Instrumental responding for rewards is associated with enhanced neuronal response in subcortical reward systems. NeuroImage 21:984-990.
15. Ernst M, Nelson EE, McClure EB, Monk CS, Munson S, Eshel N, Zarahn E, Leibenluft E, Zametkin A, Towbin K, Blair J, Charney D, Pine DS (2004) Choice selection and reward anticipation: an fMRI study. Neuropsychologia 42:1585-1597.
16. Evans AC, Kamber M, Collins DL, Macdonald D (1994) An MRI-based probabilistic atlas of neuroanatomy. In: Magnetic resonance scanning and epilepsy (Shorvon S, Fish D, Andermann F, Bydder GM, Stefan H, eds), pp 263-274. New York: Plenum.
17. Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-1902.
18. Frank MJ, Seeberger LC, O'Reilly RC (2004) By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306:1940-1943.
19. Friston KJ, Ashburner J, Poline J-B, Frith CD, Heather JD, Frackowiak RSJ (1995) Spatial registration and normalization of images. Hum Brain Mapp 2:1-25.
20. Glascher J, Buchel C (2005) Formal learning theory dissociates brain regions with different temporal integration. Neuron 47:295-306.
21. Haber SN, Kunishio K, Mizobuchi M, Lynd-Balta E (1995) The orbital and medial prefrontal circuit through the primate basal ganglia. J Neurosci 15:4851-4867.
22. Kahn I, Yeshurun Y, Rotshtein P, Fried I, Ben-Bashat D, Hendler T (2002) The role of the amygdala in signaling prospective outcome of choice. Neuron 33:983-994.
23. Kahneman D, Tversky A (1991) Loss aversion in riskless choice: a reference dependent model. Q J Econ 106:1039-1061.
24. Kahneman D, Tversky A (2000) Choices, values, and frames. Cambridge: Cambridge UP.
25. Knutson B, Westdorp A, Kaiser E, Hommer D (2000) FMRI visualization of brain activity during a monetary incentive delay task. NeuroImage 12:20-27.
26. Knutson B, Adams CM, Fong GW, Hommer D (2001a) Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21:RC159(1-5).
27. Knutson B, Fong GW, Adams CM, Varner JL, Hommer D (2001b) Dissociation of reward anticipation and outcome with event-related fMRI. NeuroReport 12:3683-3687.
28. Knutson B, Fong GW, Bennett SM, Adams CM, Hommer D (2003) A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI. NeuroImage 18:263-272.
29. Knutson B, Taylor J, Kaufman M, Peterson R, Glover G (2005) Distributed neural representation of expected value. J Neurosci 25:4806-4812.
30. LaBar KS, Gatenby JC, Gore JC, LeDoux JE, Phelps EA (1998) Human amygdala activation during conditioned fear acquisition and extinction: a mixed-trial fMRI study. Neuron 20:937-945.
31. Logothetis NK, Pauls J, Augath M, Trinath T, Oeltermann A (2001) Neurophysiological investigation of the basis of the fMRI signal. Nature 412:150-157.
32. Machina MJ (1987) Choice under uncertainty: problems solved and unsolved. J Econ Perspect 1:121-154.
33. Matthews SC, Simmons AN, Lane SD, Paulus MP (2004) Selective activation of the nucleus accumbens during risk-taking decision making. NeuroReport 15:2123-2127.
34. McClure SM, Berns GS, Montague PR (2003) Temporal prediction errors in a passive learning task activate human striatum. Neuron 38:339-346.
35. Nichols T, Brett M, Andersson J, Wager T, Poline JB (2005) Valid conjunction inference with the minimum statistic. NeuroImage 25:653-660.
36. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304:452-454.
37. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38:329-337.
38. Pagnoni G, Zink CF, Montague PR, Berns GS (2002) Activity in human ventral striatum locked to errors of reward prediction. Nat Neurosci 5:97-98.
39. Pasqualini C, Olivier V, Guibert B, Frain O, Leviel V (1996) Rapid stimulation of striatal dopamine synthesis by estradiol. Cell Mol Neurobiol 16:411-415.
40. Petry J (1996) Psychotherapie der Glücksspielsucht. Weinheim: Beltz/Psychologie Verlags Union.
41. Ramnani N, Elliott R, Athwal BS, Passinghama RE (2004) Prediction error for free monetary reward in the human prefrontal cortex. NeuroImage 23:777-786.
42. Rogers RD, Owen AM, Middleton HC, Williams EJ, Pickard JD, Sahakian BJ, Robbins TW (1999) Choosing between small, likely rewards and large, unlikely rewards activates inferior and orbital prefrontal cortex. J Neurosci 19:9029-9038.
43. Schultz W, Dickinson A (2000) Neuronal coding of prediction errors. Annu Rev Neurosci 23:473-500.
44. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599.
45. Seymour B, O'Doherty JP, Koltzenburg M, Wiech K, Frackowiak R, Friston K, Dolan R (2005) Opponent appetitive-aversive neural processes underlie predictive learning of pain relief. Nat Neurosci 8:1234-1240.
46. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, Hergueta T, Baker R, Dunbar GC (1998) The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 59 [Suppl 20]:22-33;quiz 34-57.
47. Shmuel A, Augath M, Oeltermann A, Logothetis NK (2006) Negative functional MRI response correlates with decreases in neuronal activity in monkey visual area V1. Nat Neurosci 9:569-577.
48. Tobler PN, Fiorillo CD, Schultz W (2005) Adaptive coding of reward value by dopamine neurons. Science 307:1642-1645.
49. Trepel C, Fox CR, Poldrack RA (2005) Prospect theory on the brain? Toward a cognitive neuroscience of decision under risk. Cogn Brain Res 23:34-50.
50. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, Mazoyer B, Joliot M (2002) Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. NeuroImage 15:273-289.
51. Zink CF, Pagnoni C, Martin-Skurski ME, Chappelow JC, Berns GS (2004) Human striatal responses to monetary reward depend on saliency. Neuron 42:509-517.