Dopamine-mediated reinforcement learning signals in the striatum and ventromedial prefrontal cortex underlie value-based choices

Journal of Neuroscience

Volumn 31, Issue 5, 2011, Pages 1606-1613

  Jocham, Gerhard ^a,b   Klein, Tilmann A ^a,d   Ullsperger, Markus ^a,c  

^a MAX PLANCK INSTITUTE FOR NEUROLOGICAL RESEARCH   (Germany)

^b UNIVERSITY OF OXFORD   (United Kingdom)

^c RADBOUD UNIVERSITY   (Netherlands)

^d MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

AMISULPRIDE; DOPAMINE; PRAMIPEXOLE;

ADULT; ANALYTICAL ERROR; ARTICLE; BEHAVIOR; CINGULATE GYRUS; CORPUS STRIATUM; DECISION MAKING; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PREDICTION; PREFRONTAL CORTEX; PRIORITY JOURNAL; REINFORCEMENT; RESPONSE TIME; REWARD; SCORING SYSTEM; STIMULUS RESPONSE; TASK PERFORMANCE; VENTROMEDIAL PREFRONTAL CORTEX;

ADULT; CHOICE BEHAVIOR; CORPUS STRIATUM; DOPAMINE; DOPAMINE ANTAGONISTS; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MODELS, NEUROLOGICAL; NEUROPSYCHOLOGICAL TESTS; PREFRONTAL CORTEX; PSYCHOMOTOR PERFORMANCE; RECEPTORS, DOPAMINE D2; REINFORCEMENT (PSYCHOLOGY); REINFORCEMENT SCHEDULE; REWARD; SIGNAL TRANSDUCTION; SULPIRIDE; TIME FACTORS;

EID: 79551527315     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.3904-10.2011     Document Type: Article

References (39)

1. Bechara A, Damasio AR, Damasio H, Anderson SW (1994) Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50:7-15.
2. Bechara A, Tranel D, Damasio H (2000) Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions. Brain 123:2189-2202.
3. Becker JB, Cha JH (1989) Estrous cycle-dependent variation in amphetamine-induced behaviors and striatal dopamine release assessed with microdialysis. Behav Brain Res 35:117-125.
4. Becker JB, Robinson TE, Lorenz KA (1982) Sex differences and estrous cycle variations in amphetamine-elicited rotational behavior. Eur J Pharmacol 80:65-72.
5. Blair K, Marsh AA, Morton J, Vythilingam M, Jones M, Mondillo K, Pine DC, Drevets WC, Blair JR (2006) Choosing the lesser of two evils, the better of two goods: specifying the roles of ventromedial prefrontal cortex and dorsal anterior cingulate in object choice. J Neurosci 26:11379-11386.
6. Bond AJ, Lader MH (1974) The use of analogue scales in rating subjective feelings. Br J Med Psychol 47:211-218.
7. 123I] epidepride SPET study of amisulpride-treated patients. Am J Psychiatry 160:1413-1420.
8. Chib VS, Rangel A, Shimojo S, O'Doherty JP (2009) Evidence for a common representation of decision values for dissimilar goods in human ventromedial prefrontal cortex. J Neurosci 29:12315-12320.
9. Creutz LM, Kritzer MF (2004) Mesostriatal and mesolimbic projections of midbrain neurons immunoreactive for estrogen receptor beta or androgen receptors in rats. J Comp Neurol 476:348-362.
10. 3 receptor antagonist, on the electrical activity of midbrain dopaminergic neurons. J Pharmacol Exp Ther 287:51-57.
11. Dreher JC, Schmidt PJ, Kohn P, Furman D, Rubinow D, Berman KF (2007) Menstrual cycle phase modulates reward-related neural function in women. Proc Natl Acad Sci U S A 104:2465-2470.
12. Frank MJ (2005) Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and non-medicated Parkinsonism. J Cogn Neurosci 17:51-72.
13. Frank MJ, Seeberger LC, O'Reilly RC (2004) By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306:1940-1943.
14. Gläscher J, Hampton AN, O'Doherty JP (2009) Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cereb Cortex 19:483-495.
15. 125I]epidepride. Synapse 23:115-123.
16. Hare TA, O'Doherty J, Camerer CF, Schultz W, Rangel A (2008) Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J Neurosci 28:5623-5630.
17. Jenkinson M (2003) Fast, automated, N-dimensional phase-unwrapping algorithm. Magn Reson Med 49:193-197.
18. Jenkinson M, Smith S (2001) A global optimisation method for robust affine registration of brain images. Med Image Anal 5:143-156.
19. Jenkinson M, Bannister P, Brady M, Smith S (2002) Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage 17:825-841.
20. Jocham G, Neumann J, Klein TA, Danielmeier C, Ullsperger M (2009) Adaptive coding of action values in the human rostral cingulate zone. J Neurosci 29:7489-7496.
21. Kilts CD, Anderson CM, Ely TD, Nishita JK (1987) Absence of synthesis-modulating nerve terminal autoreceptors on mesoamygdaloid and other mesolimbic dopamine neuronal populations. J Neurosci 7:3961-3975.
22. Klein TA, Neumann J, Reuter M, Hennig J, von Cramon DY, Ullsperger M (2007) Genetically determined differences in learning from errors. Science 318:1642-1645.
23. 3H]SCH23390. Neuroscience 40:657-671.
24. Mink JW (1996) The basal ganglia: focused selection and inhibition of competing motor programs. Prog Neurobiol 50:381-425.
25. O'Doherty JP (2004) Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr Opin Neurobiol 14:769-776.
26. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304:452-454.
27. Padoa-Schioppa C, Assad JA (2006) Neurons in the orbitofrontal cortex encode economic value. Nature 441:223-226.
28. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD (2006) Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442:1042-1045.
29. Plassmann H, O'Doherty J, Rangel A (2007) Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J Neurosci 27:9984-9988.
30. Redgrave P, Prescott TJ, Gurney K (1999) The basal ganglia: a vertebrate solution to the selection problem? Neuroscience 89:1009-1023.
31. Salamone JD (1994) The involvement of nucleus accumbens dopamine in appetitive and aversive motivation. Behav Brain Res 61:117-133.
32. Salamone JD (2002) Functional significance of nucleus accumbens dopamine: behavior, pharmacology and neurochemistry. Behav Brain Res 137:1.
33. Salamone JD, Correa M (2002) Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav Brain Res 137:3-25.
34. Seamans JK, Yang CR (2004) The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog Neurobiol 74:1-58.
35. Smith SM, Jenkinson M, Woolrich MW, Beckmann CF, Behrens TE, Johansen-Berg H, Bannister PR, De Luca M, Drobnjak I, Flitney DE, Niazy RK, Saunders J, Vickers J, Zhang Y, De Stefano N, Brady JM, Matthews PM (2004) Advances in functional and structural MR image analysis and implementation as FSL. Neuroimage 23 [Suppl 1]:S208-S219.
36. Sutton RS, Barto AG (1998) Reinforcement Learning: An Introduction. Cambridge, MA: MIT.
37. Wise RA (2004) Dopamine, learning and motivation. Nat Rev Neurosci 5:483-494.
38. Woolrich MW, Ripley BD, Brady M, Smith SM (2001) Temporal autocorrelation in univariate linear modeling of FMRI data. Neuroimage 14:1370-1386. (Pubitemid 33124185)
39. 2 dopamine receptor blockade by amisulpride in schizophrenia. J Clin Psychopharmacol 21:207-214.