Genetic variation in dopaminergic neuromodulation influences the ability to rapidly and flexibly adapt decisions

Proceedings of the National Academy of Sciences of the United States of America

Volumn 106, Issue 42, 2009, Pages 17951-17956

  Krugel, Lea K ^a,b,c   Biele, Guido ^a,b,c   Mohr, Peter N C ^a,b,c   Li, Shu Chen ^a,c   Heekeren, Hauke R ^a,b,c  

^a MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

^b MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

^c CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

Author keywords

COMT; Dopamine; Functional MRI; Learning rate; Reinforcement learning

Indexed keywords

CATECHOL METHYLTRANSFERASE; DOPAMINE; VALINE;

ADULT; ARTICLE; BEHAVIOR; CORPUS STRIATUM; DOPAMINE METABOLISM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GENETIC POLYMORPHISM; GENETIC VARIABILITY; GENOTYPE; HUMAN; LEARNING; MALE; MEDICAL DECISION MAKING; NEUROBIOLOGY; NEUROMODULATION; NORMAL HUMAN; PHYLOGENY; PREDICTION; PREFRONTAL CORTEX; PRIORITY JOURNAL; REINFORCEMENT; REWARD; SURVIVAL;

ADULT; AMINO ACID SUBSTITUTION; BRAIN; CATECHOL O-METHYLTRANSFERASE; DOPAMINE; FEMALE; GENETIC VARIATION; GENOTYPE; HOMOZYGOTE; HUMANS; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; MODELS, NEUROLOGICAL; POLYMORPHISM, SINGLE NUCLEOTIDE; REINFORCEMENT (PSYCHOLOGY); REWARD; YOUNG ADULT;

EID: 70449568271     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.0905191106     Document Type: Article

References (47)

1. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599.
2. Hollerman JR, Schultz W (1998) Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1:304-309. (Pubitemid 128652677)
3. Seamans JK, Yang CR (2004) The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog Neurobiol 74:1-57. (Pubitemid 39286053)
4. Williams GV, Goldman-Rakic PS (1995) Modulation of memory fields by dopamine D1 receptors in prefrontal cortex. Nature 376:572-575.
5. Wise RA (2004) Dopamine, learning and motivation. Nat Rev Neurosci 5:483-494.
6. Frank MJ, Moustafa AA, Haughey HM, Curran T, Hutchison KE (2007) Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning. Proc Natl Acad Sci USA 104:16311-16316. (Pubitemid 350099356)
7. Klein TA, et al. (2007) Genetically determined differences in learning from errors. Science 318:1642-1645.
8. Malhotra AK, et al. (2002) A functional polymorphism in the COMT gene and performance on a test of prefrontal cognition. Am J Psychiatry 159:652-654.
9. Egan MF, et al. (2001) Effect of COMT Val(108/158) Met genotype on frontal lobe function and risk for schizophrenia. Proc Natl Acad Sci USA 98:6917-6922.
10. Barnett JH, Jones PB, Robbins TW, Muller U (2007) Effects of the catechol-O-methyltransferase Val(158)Met polymorphism on executive function: A meta-analysis of the Wisconsin Card Sorting Test in schizophrenia and healthy controls. Mol Psychiatry 12:502-509.
11. Matsumoto M, et al. (2003) Catechol O-methyltransferase mRNA expression in human and rat brain: Evidence for a role in cortical neuronal function. Neuroscience 116:127-137. (Pubitemid 36110440)
12. Barnett JH, Scoriels L, Munafo MR (2008) Meta-analysis of the cognitive effects of the catechol-O-methyltransferase gene val158/108Met polymorphism. Biol Psychiatry 64:137-144.
13. Yacubian J, et al. (2007) Gene-gene interaction associated with neural reward sensitivity. Proc Natl Acad Sci USA 104:8125-8130. (Pubitemid 47185886)
14. Dreher JC, Kohn P, Kolachana B, Weinberger DR, Berman KF (2009) Variation in dopamine genes influences responsivity of the human reward system. Proc Natl Acad Sci USA 106:617-622.
15. Carr DB, Sesack SR (2000) Projections from the rat prefrontal cortex to the ventral tegmental area: Target specificity in the synaptic associations with mesoaccumbens and mesocortical neurons. J Neurosci 20:3864-3873.
16. Takahata R, Moghaddam B (2000) Target-specific glutamatergic regulation of dopamine neurons in the ventral tegmental area. J Neurochem 75:1775-1778. (Pubitemid 30694698)
17. Jaber M, Jones S, Giros B, Caron MG (1997) The dopamine transporter: A crucial component regulating dopamine transmission. Mov Disord 12:629-633. (Pubitemid 27406255)
18. Floresco SB, West AR, Ash B, Moore H, Grace AA (2003) Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nat Neurosci 6:968-973. (Pubitemid 37064759)
19. Roberts AC, et al. (1994) 6-Hydroxydopamine lesions of the prefrontal cortex in monkeys enhance performance on an analog of the Wisconsin Card Sort Test - Possible interactions with subcortical dopamine. J Neurosci 14:2531-2544.
20. Kolachana BS, Saunders RC, Weinberger DR (1995) Augmentation of prefrontal cortical monoaminergic activity inhibits dopamine release in the caudate-nucleus - An in-vivo neurochemical assessment in the rhesus monkey. Neuroscience 69:859-868.
21. King D, Zigmond MJ, Finlay JM (1997) Effects of dopamine depletion in the medial prefrontal cortex on the stress-induced increase in extracellular dopamine in the nucleus accumbens core and shell. Neuroscience 77:141-153. (Pubitemid 27060314)
22. Gogos JA, et al. (1998) Catechol-O-methyltransferase-deficient mice exhibit sexually dimorphic changes in catecholamine levels and behavior. Proc Natl Acad Sci USA 95:9991-9996.
23. Akil M, et al. (2003) Catechol-O-methyltransferase genotype and dopamine regulation in the human brain. J Neurosci 23:2008-2013. (Pubitemid 36368887)
24. Meyer-Lindenberg A, et al. (2005) Midbrain dopamine and prefrontal function in humans: Interaction and modulation by COMT genotype. Nat Neurosci 8:594-596. (Pubitemid 40594200)
25. Bilder RM, Volavka J, Lachman HM, Grace AA (2004) The catechol-O-methyltransferase polymorphism: Relations to the tonic-phasic dopamine hypothesis and neuropsychiatric phenotypes. Neuropsychopharmacology 29:1943-1961. (Pubitemid 39486546)
26. Durstewitz D, Seamans JK, Sejnowski TJ (2000) Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex. J Neurophysiol 83:1733-1750. (Pubitemid 30159594)
27. Palmatier MA, Kang AM, Kidd KK (1999) Global variation in the frequencies of functionally different catechol-O-methyltransferase alleles. Biol Psychiatry 46:557-567.
28. O'Doherty J, et al. (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304:452-454. (Pubitemid 38495943)
29. Schonberg T, Daw ND, Joel D, O'Doherty JP (2007) Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J Neurosci 27:12860-12867. (Pubitemid 350159584)
30. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD (2006) Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442:1042-1045. (Pubitemid 44330261)
31. Behrens TE, Woolrich MW, Walton ME, Rushworth MF (2007) Learning the value of information in an uncertain world. Nat Neurosci 10:1214-1221.
32. Friston KJ, et al. (1997) Psychophysiological and modulatory interactions in neuroimaging. Neuroimage 6:218-229.
33. Hampton AN, Bossaerts P, O'Doherty JP (2006) The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. J Neurosci 26:8360-8367. (Pubitemid 44309850)
34. Knutson B, Gibbs SEB (2007) Linking nucleus accumbens dopamine and blood oxygenation. Psychopharmacology 191:813-822. (Pubitemid 46355904)
35. Dayana P, Niv Y (2008) Reinforcement learning: The Good, The Bad and The Ugly. Curr Opin Neurobiol 18:185-196.
36. Cools R, Clark L, Owen AM, Robbins TW (2002) Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging. J Neurosci 22:4563-4567. (Pubitemid 37465672)
37. Rodriguez PF, Aron AR, Poldrack RA (2006) Ventral-striatal/nucleus- accumbens sensitivity to prediction errors during classification learning. Hum Brain Mapp 27:306-313.
38. Frank MJ (2005) Dynamic dopamine modulation in the basal ganglia: A neurocomputational account of cognitive deficits in medicated and nonmedicated parkinsonism. J Cogn Neurosci 17:51-72.
39. Grace AA (1991) Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: A hypothesis for the etiology of schizophrenia. Neuroscience 41:1-24.
40. Moore H, West AR, Grace AA (1999) The regulation of forebrain dopamine transmission: Relevance to the pathophysiology and psychopathology of schizophrenia. Biol Psychiatry 46:40-55. (Pubitemid 29296817)
41. Meyer-Lindenberg A, et al. (2007) Genetic evidence implicating DARPP-32 in human frontostriatal structure, function, and cognition. J Clin Invest 117:672-682. (Pubitemid 46348525)
42. Nagel IE, et al. (2008) Human aging magnifies genetic effects on executive functioning and working memory. Front Hum Neurosci 2:1.
43. Mell T, et al. (2005) Effect of aging on stimulus-reward association learning. Neuropsychologia 43:554-563. (Pubitemid 40248912)
44. Heekeren HR, et al. (2007) Role of ventral striatum in reward-based decision-making. NeuroReport 18:951-955. (Pubitemid 46905164)
45. Rescorla RA, Wagner AR (1972) in Classical Conditioning II: Current Research and Theory, eds Black AH, Prokasy WF (Appleton-Century Crofts, New York), pp 64-99.
46. Sutton RS, Barto AG (1998) Reinforcement Learning: An Introduction (MIT Press, Cambridge, MA).
47. Luce RD (1959) Individual Choice Behavior: A Theoretical Analysis (Wiley, New York).