Neurogenetics and pharmacology of learning, motivation, and cognition

Neuropsychopharmacology

Volumn 36, Issue 1, 2011, Pages 133-152

  Frank, Michael J ^a   Fossella, John A ^b  

^a BROWN UNIVERSITY   (United States)

^b MOUNT SINAI SCHOOL OF MEDICINE   (United States)

Author keywords

basal ganglia; cognition; dopamine; genetics; learning; prefrontal cortex

Indexed keywords

ADENOSINE A2 RECEPTOR; ADENOSINE A2A RECEPTOR; CATECHOL METHYLTRANSFERASE; CENTRAL STIMULANT AGENT; CHRM4 PROTEIN; DLGAP3 PROTEIN; DOPAMINE 1 RECEPTOR; DOPAMINE 2 RECEPTOR; DOPAMINE 4 RECEPTOR; DOPAMINE TRANSPORTER; EBF1 PROTEIN; EYA1 PROTEIN; G PROTEIN COUPLED RECEPTOR; G PROTEIN COUPLED RECEPTOR 6; GNB4 PROTEIN; GNG2 PROTEIN; ISL1 PROTEIN; LIM HOMEOBOX 8 PROTEIN; NRXN1 PROTEIN; PDYN PROTEIN; PENK PROTEIN; PHOSPHOPROTEIN DARPP 32; PLEXIN DOMAIN CONTAINING 1 PROTEIN; POSTSYNAPTIC DENSITY SCAFFOLDING PROTEIN 3; PROTEIN; SCAFFOLD PROTEIN; STMN2 PROTEIN; TAC1 PROTEIN; TROPOMYOSIN 2; UNCLASSIFIED DRUG; ZNF521 PROTEIN;

ATTENTION DEFICIT DISORDER; BRAIN ELECTROPHYSIOLOGY; CELL DIFFERENTIATION; CELL MIGRATION; COGNITION; CONCEPTUAL FRAMEWORK; DECISION MAKING; DOPAMINERGIC ACTIVITY; DOPAMINERGIC SYSTEM; DRUG EFFICACY; ELECTROENCEPHALOGRAM; ENVIRONMENT; GENE DELETION; GENE DOSAGE; GENE DUPLICATION; GENE IDENTIFICATION; GENE INTERACTION; GENE REGULATORY NETWORK; GENETIC ASSOCIATION; GENETIC VARIABILITY; GENOTYPE; GLOBUS PALLIDUS; HEREDITY; HUMAN; LEARNING; LONG TERM POTENTIATION; MOTIVATION; NEUROIMAGING; NEUROSCIENCE; NIGRONEOSTRIATAL SYSTEM; PREDICTION; PREFRONTAL CORTEX; PRIORITY JOURNAL; REINFORCEMENT; REVIEW; SCHIZOPHRENIA; SINGLE NUCLEOTIDE POLYMORPHISM; TREATMENT RESPONSE; WORKING MEMORY;

ANIMALS; COGNITION; CORPUS STRIATUM; DOPAMINE; DOPAMINE AND CAMP-REGULATED PHOSPHOPROTEIN 32; DOPAMINE PLASMA MEMBRANE TRANSPORT PROTEINS; GENETIC VARIATION; HUMANS; LEARNING; MOTIVATION; POLYMORPHISM, GENETIC; PREFRONTAL CORTEX; RECEPTORS, DOPAMINE D2; RECEPTORS, DOPAMINE D4;

EID: 78649683404     PISSN: 0893133X     EISSN: None     Source Type: Journal    
DOI: 10.1038/npp.2010.96     Document Type: Review

References (197)

1. Alessandro B, Valeria R, Fabio S, Giuseppe B, Valeria L, Leonardo F et al (2006). Prefrontal-hippocampal coupling during memory processing is modulated by COMT val158met genotype. Biol Psychiatry 60: 1250-1258.
2. Aron AR, Behrens TE, Smith S, Frank MJ, Poldrack RA (2007). Triangulating a cognitive control network using diffusion-weighted magnetic resonance imaging (MRI) and functional MRI. J Neurosci 27: 3743-3752.
3. Bach M-E, Simpson EH, Kahn L, Marshall JJ, Kandel ER, Kellendonk C (2008). Transient and selective overexpression of d2 receptors in the striatum causes persistent deficits in conditional associative learning. Proc Natl Acad Sci USA 105: 16027-16032.
4. Barnett JH, Scoriels L, Munafo MR (2008). Meta-analysis of the cognitive effects of the catechol-o-methyltransferase gene val158/108met polymorphism. Biol Psychiatry 64: 137-144.
5. Barto AG, Houk JC, Adams JL (1995). A model of how the basal ganglia generate and use neural signals that predict reinforcement. In: Houk JC, Davis JL (eds). Models of Information Processing in the Basal Ganglia. MIT Press: Cambridge, MA. (pp. 249-270 ).
6. Bayer HM, Glimcher PW (2005). Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47: 129-141.
7. Belin D, Mar AC, Dalley JW, Robbins TW, Everitt BJ (2008). High impulsivity predicts the switch to compulsive cocaine-taking. Science (New York, NY) 320: 1352-1355.
8. Berridge KC (2007). The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology 191: 391-431.
9. Bertolino A, Breier A, Callicott JH, Adler C, Mattay VS, Shapiro M et al (2000). The relationship between dorsolateral prefrontal neuronal n-acetylaspartate and evoked release of striatal dopamine in schizophrenia. Neuropsychopharmacol-ogy 22: 125-132.
10. Bertolino A, Di Giorgio A, Blasi G, Sambataro F, Caforio G, Sinibaldi L et al (2008). Epistasis between dopamine regulating genes identifies a nonlinear response of the human hippocampus during memory tasks. Biol Psychiatry 64: 226-234.
11. Bertran-Gonzalez J, Bosch C, Maroteaux M, Matamales M, Herv D, Valjent E et al (2008). Opposing patterns of signaling activation in dopamine d1 and d2 receptor- expressing striatal neurons in response to cocaine and haloperidol. J Neurosci 28: 5671.
12. Bienvenu O, Wang Y, Shugart Y, Welch J, Grados M, Fyer A et al (2008). Sapap3 and pathological grooming in humans: results from the ocd collaborative genetics study. Am J Med Genet B Neuropsychiatr Genet 150B: 710-720.
13. Bilder RM, Volavka J, Lachman HM, Grace AA (2004). The catechol-O-methyltransferase polymorphism: relations to the tonic-phasic dopamine hypothesis and neuropsychiatric phenotypes. Neuropsychopharmacology 29: 1943-1961.
14. Blasi G, Mattay VS, Bertolino A, Elvevg B, Callicott JH, Das S et al (2005). Effect of catechol-o-methyltransferase val158met genotype on attentional control. J Neurosci 25: 5038-5045.
15. Bodi N, Keri S, Nagy H, Moustafa A, Myers CE, Daw N et al (2009). Reward-learning and the novelty-seeking personality: a between-and within-subjects study of the effects of dopamine agonists on young parkinson's patients. Brain 132(Part 9): 2385-2395.
16. Boorman ED, Behrens TEJ, Woolrich MW, Rushworth MFS (2009). How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 62: 733-743.
17. Braver TS, Cohen JD (2000). On the control of control: the role of dopamine in regulating prefrontal function and working memory. In: Monsell S, Driver J (eds), Control of Cognitive Processes: Attention and Performance. MIT Press: Cambridge, MA. xviii (pp. 713-737 ).
18. Brown J, Bullock D, Grossberg S (1999). How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues. J Neurosci 19: 10502-10511.
19. Brownstein MJ (1977). Studies of the distribution of biologically active peptides in the brain. Adv Exp Med Biol 87: 41.
20. Calabresi P, Gubellini P, Centonze D, Picconi B, Bernardi G, Chergui K et al (2000). Dopamine and camp-regulated phosphoprotein 32 kda controls both striatal long-term depression and long-term potentiation, opposing forms of synaptic plasticity. J Neurosci 20: 8443-8451.
21. Camps M, Cortes R, Gueye B, Probst A, Palacios JM (1989). Dopamine receptors in the human brain: autoradiographic distribution of d2 sites. Neuroscience 28: 275-290.
22. Casta A, Soria G, Ledent C, Maldonado R, Valverde O (2006). Attenuation of nicotine-induced rewarding effects in a2a knockout mice. Neuropharmacology 51: 631-640.
23. CaVanagh JF, Frank MJ, Klein TJ, Allen JJB (2010). Frontal theta links prediction errors to behavioral adaptation in reinforcement learning. NeuroImage 49: 3198-3209.
24. Centonze D, Grande C, Saulle E, Martin AB, Gubellini P, Pavn N et al (2003). Distinct roles of d1 and d5 dopamine receptors in motor activity and striatal synaptic plasticity. J Neurosci 23: 8506-8512.
25. Chase HW, Clark L, Myers CE, Gluck MA, Sahakian BJ, Bullmore ET et al (2008). The role of the orbitofrontal cortex in human discrimination learning. Neuropsy-chologia 46: 1326-1337.
26. Chen J, Moratalla R, Impagnatiello F, Grandy D, Cuellar B, Rubinstein M et al (2001). The role of the D2 dopamine receptor (D2R) in A2A adenosine receptor (A2AR)-mediated behavioral and cellular responses as revealed by A2A and D2 receptor knockout mice. Proc Natl Acad Sci USA 98: 1970.
27. Clatworthy PL, Lewis SJG, Brichard L, Hong YT, Izquierdo D, Clark L et al (2009). Dopamine release in dissociable striatal subregions predicts the different effects of oral methylphenidate on reversal learning and spatial working memory. J Neurosci 29: 4690-4696.
28. Cohen JD, Braver TS, Brown JW (2002). Computational perspectives on dopamine function in prefrontal cortex. Curr Opin Neurobiol 12: 223-229.
29. Cohen MX, Frank MJ (2009). Neurocomputational models of basal ganglia function in learning, memory and choice. Behav Brain Res 199: 141-156.
30. Cohen MX, Krohn-Grimberghe A, Elger CE, Weber B (2007). Dopamine gene predicts the brain's response to dopaminergic drug. Eur J Neurosci 26: 3652-3660.
31. Cools R (2008). Role of dopamine in the motivational and cognitive control of behavior. Neuroscientist 14: 381.
32. Cools R, Altamirano L, D'Esposito M (2006). Reversal learning in parkinson's disease depends on medication status and outcome valence. Neuropsychologia 44: 1663-1673.
33. Cools R, Barker RA, Sahakian BJ, Robbins TW (2001). Mechanisms of cognitive set flexibility in Parkinson's disease. Brain J Neurol 124: 2503-2512.
34. Cools R, Frank MJ, Gibbs SE, Miyakawa A, Jagust W, D'Esposito M (2009). Striatal dopamine predicts outcome-specific reversal learning and its sensitivity to dopaminergic drug administration. J Neurosci Off J Soc Neuro-Sci 29: 1538.
35. Cools R, Gibbs SE, Miyakawa A, Jagust W, D'Esposito M (2008). Working memory capacity predicts dopamine synthesis capacity in the human striatum. J Neurosci 28: 1208-1212.
36. Cools R, Sheridan M, Jacobs E, D'Esposito M (2007). Impulsive personality predicts dopamine-dependent changes in frontostriatal activity during component processes of working memory. J Neurosci 27: 5506-5514.
37. Corvol JC, Studler JM, Schonn JS, Girault JA, Herv D (2001). Galpha(olf) is necessary for coupling d1 and a2a receptors to adenylyl cyclase in the striatum. J Neurochem 76: 1585-1588.
38. Costa RM, Gutierrez R, de Araujo IE, Coelho MRP, Kloth AD, Gainetdinov RR et al (2007). Dopamine levels modulate the updating of tastant values. Genes Brain Behav 6: 314-320.
39. Dahlin E, Neely AS, Larsson A, Bä ckman L, Nyberg L (2008a). Transfer of learning after updating training mediated by the striatum. Science (New York, NY) 320: 1510-1512.
40. Dahlin E, Nyberg L, Bä ckman L, Neely AS (2008b). Plasticity of executive functioning in young and older adults: immediate training gains, transfer, and long-term maintenance. Psychol Aging 23: 720-730.
41. Dalley JW, Fryer TD, Brichard L, Robinson ESJ, Theobald DEH, Lne K et al (2007). Nucleus accumbens D2/3 receptors predict trait impulsivity and cocaine reinforcement. Science (New York, NY) 315: 1267-1270.
42. Dalley JW, Lääne K, Theobald DEH, Armstrong HC, Corlett PR, Chudasama Y et al (2005). Time-limited modulation of appetitive pavlovian memory by D1 and NMDA receptors in the nucleus accumbens. Proc Natl Acad Sci USA 102: 6189-6194.
43. Daw ND, O'Doherty JP, Dayan P, Seymour B, Dolan RJ (2006). Cortical substrates for exploratory decisions in humans. Nature 441: 876-879.
44. Day M, Wokosin D, Plotkin JL, Tian X, Surmeier DJ (2008). Differential excitability and modulation of striatal medium spiny neuron dendrites. J Neurosci 28: 11603.
45. Deco G, Rolls ET (2004). Synaptic and spiking dynamics underlying reward reversal in the orbitofrontal cortex. Cerebral Cortex 15: 15-30.
46. Diaz-Asper CM, Goldberg TE, Kolachana BS, Straub RE, Egan MF, Weinberger DR (2008). Genetic variation in catechol-o-methyltransferase: effects on working memory in schizophrenic patients, their siblings, and healthy controls. Biol Psychiatry 63: 72-79.
47. Dickson SP, Wang K, Krantz I, Hakonarson H, Goldstein DB (2010). Rare variants create synthetic genome-wide associations. PLoS Biol 8: e1000294.
48. Doll BB, Frank MJ (2009). The basal ganglia in reward and decision making: computational models and empirical studies. Handbook of Reward and Decision Making 399: 399-425.
49. Doll BB, Jacobs WJ, Sanfey AG, Frank MJ (2009). Instructional control of reinforcement learning: a behavioral and neurocomputational investigation. Brain Res 1299: 74-94.
50. Dreher J-C, Kohn P, Kolachana B, Weinberger DR, Berman KF (2009). Variation in dopamine genes influences responsivity of the human reward system. Proc Natl Acad Sci USA 106: 617-622.
51. Durstewitz D, Seamans JK (2008). The dual-state theory of prefrontal cortex dopamine function with releVance to catechol-o-methyltransferase genotypes and schizophrenia. Biol Psychiatry 64: 739-749.
52. Durstewitz D, Seamans JK, Sejnowski TJ (2000). Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex. J Neurophysiol 83: 1733-1750.
53. Durston S, Fossella JA, Mulder MJ, Casey BJ, Ziermans TB, Vessaz MN et al (2008). Dopamine transporter genotype conveys familial risk of attention-deficit/hyperactivity disorder through striatal activation. J Am Acad Child Adolesc Psychiatry 47: 61.
54. Egan MF, Goldberg TE, Kolachana BS, Callicott JH, Mazzanti CM, Straub RE et al (2001). Effect of COMT val108/158 met genotype on frontal lobe function and risk for schizophrenia. Proc Natl Acad Sci USA 98: 6917-6922.
55. Ehrlich S, Morrow EM, Roffman JL, Wallace SR, Naylor M, Bockholt HJ et al (2009). The COMT val108/158met polymorphism and medial temporal lobe volumetry in patients with schizophrenia and healthy adults. NeuroImage (in press).
56. Elliott R, Sahakian BJ, Matthews K, Bannerjea A, Rimmer J, Robbins TW (1997). Effects of methylphenidate on spatial working memory and planning in healthy young adults. Psychopharmacology 131: 196-206.
57. Everitt BJ, Robbins TW (2005). Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nature Neurosci 8: 1481-1489.
58. Fagundes NJR, Ray N, Beaumont M, Neuenschwander S, Salzano FM, Bonatto SL et al (2007). Statistical evaluation of alternative models of human evolution. Proc Natl Acad Sci USA 104: 17614-17619.
59. Fan J, Fossella J, Sommer T, Wu Y, Posner MI (2003). Mapping the genetic variation of executive attention onto brain activity. Proc Natl Acad Sci USA 100: 7406-7411.
60. Farrar AM, Segovia KN, Randall PA, Nunes EJ, Collins LE, Stopper CM et al (2010). Nucleus accumbens and effort-related functions: behavioral and neural markers of the interactions between adenosine A2A and dopamine D2 receptors. Neuroscience 166: 1056-1067.
61. Fienberg AA, Hiroi N, Mermelstein PG, Song W, Snyder GL, Nishi A et al (1998). Darpp-32: regulator of the efficacy of dopaminergic neurotransmission. Science (New York, NY) 281: 838-842.
62. Fleming SM, Thomas CL, Dolan RJ (2010). Overcoming status quo bias in the human brain. Proc Natl Acad Sci USA 107: 6005-6009.
63. Flores G, Liang JJ, Sierra A, Martnez-Fong D, Quirion R, Aceves J et al (1999). Expression of dopamine receptors in the subthalamic nucleus of the rat: characterization using reverse transcriptase-polymerase chain reaction and autoradiography. Neuroscience 91: 549-556.
64. Forbes EE, Brown SM, Kimak M, Ferrell RE, Manuck SB, Hariri AR (2009). Genetic variation in components of dopamine neurotransmission impacts ventral striatal reactivity associated with impulsivity. Mol Psychiatry 14: 60-70.
65. Fossella J, Sommer T, Fan J, Wu Y, Swanson JM, Pfaff DW et al (2002). Assessing the molecular genetics of attention networks. BMC Neurosci 3: 14.
66. Frank MJ (2005). Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and non-medicated parkinsonism. J Cogni-tive Neurosci 17: 51-72.
67. Frank MJ (2006). Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making. Neural Networks Off J Int Neural Network Soc 19: 1120-1136.
68. Frank MJ, Claus ED (2006). Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychol Rev 113: 300-326.
69. Frank MJ, D'Lauro C, Curran T (2007). Cross-task individual differences in error processing: neural, electrophysiological, and genetic components. Cognitive Affect Behav Neurosci 7: 297-308.
70. Frank MJ, Doll B, Oas-Terpstra J, Moreno F (2009). Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nat Neurosci 12: 1062-1068.
71. Frank MJ, Hutchison K (2009). Genetic contributions to avoidance-based decisions: striatal D2 receptor polymorphisms. Neuroscience 164: 131-140.
72. Frank MJ, Loughry B, O'Reilly RC (2001). Interactions between the frontal cortex and basal ganglia in working memory: a computational model. Cognitive Affect Behav Neurosci 1: 137-160.
73. Frank MJ, Moustafa AA, Haughey HM, Curran T, Hutchison KE (2007a). Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning. Proc Natl Acad Sci USA 104: 16311-16316.
74. Frank MJ, O'Reilly RC (2006). A mechanistic account of striatal dopamine function in human cognition: psychopharmacological studies with cabergoline and haloperidol. Behav Neurosci 120: 497-517.
75. Frank MJ, Samanta J, Moustafa AA, Sherman SJ (2007b). Hold your horses: impul-sivity, deep brain stimulation, and medication in parkinsonism. Science (New York, NY) 318: 1309-1312.
76. Frank MJ, Seeberger LC, O'Reilly RC (2004). By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306: 1940-1943.
77. Friedman NP, Miyake A, Young SE, Defries JC, Corley RP, Hewitt JK (2008). Individual differences in executive functions are almost entirely genetic in origin. J Exp Psychol 137: 201-225.
78. Garcia-Garcia M, Barcelo F, Clemente IC, Escera C (2010). The role of the dopamine transporter DAT1 genotype on the neural correlates of cognitive flexibility. Eur J Neurosci 31: 754-760.
79. Gerfen CR (1984). The neostriatal mosaic: compartmentalization of corticostriatal input and striatonigral output systems. Nature 311: 461-464.
80. Gizer IR, Ficks C, Waldman ID (2009). Candidate gene studies of adhd: a meta-analytic review. Human Genet 126: 51-90.
81. Gogos JA, Morgan M, Luine V, Santha M, Ogawa S, Pfaff D et al (1998). Catechol-o-methyltransferase-deficient mice exhibit sexually dimorphic changes in catecholamine levels and behavior. Proc Natl Acad Sci USA 95: 9991-9996.
82. Goldberg T, Egan M, Gscheidle T, Coppola R, Weickert T, Kolachana B et al (2003). Executive subprocesses in working memory: relationship to catechol-O-methyltransferase val158met genotype and schizophrenia. Arch Gen Psychiatry 60: 889-896.
83. Goldman D, Weinberger DR, Malhotra AK, Goldberg TE (2009). The role of COMT val158met in cognition. Biol Psychiatry 65: e1-e2; author reply e3-4.
84. Goto S, Taniguchi M, Muraoka M, Toyoda H, Sado Y, Kawakita M et al (2001). Udp-sugar transporter implicated in glycosylation and processing of notch. Nat Cell Biol 3: 816-822.
85. Green AE, Munafo MR, Deyoung CG, Fossella JA, Fan J, Gray JR (2008). Using genetic data in cognitive neuroscience: from growing pains to genuine insights. Nat Rev Neurosci 9: 710-720.
86. Hakansson K, Galdi S, Hendrick J, Snyder G, Greengard P, Fisone G (2006). Regulation of phosphorylation of the glur1 ampa receptor by dopamine d2 receptors. J Neurochem 96: 482-488.
87. Hallett PJ, Spoelgen R, Hyman BT, Standaert DG, Dunah AW (2006). Dopamine D1 activation potentiates striatal NMDA receptors by tyrosine phosphorylation-dependent subunit trafficking. J Neurosci 26: 4690-4700.
88. Harden DG, Grace AA (1995). Activation of dopamine cell firing by repeated l-dopa ad-ministration to dopamine-depleted rats: its potential role in mediating the therapeutic response to l-dopa treatment. J Neurosci 15: 6157-6166.
89. Haworth CMA, Wright MJ, Luciano M, Martin NG, de Geus EJC, Van Beijsterveldt CEM et al (2009). The heritability of general cognitive ability increases linearly from childhood to young adulthood. Mol Psychiatry.
90. Hazy TE, Frank MJ, O'Reilly RC (2010). Neural mechanisms of acquired phasic dopamine responses in learning. Neurosci Biobehav Rev 34: 701-720.
91. Heiman M, Schaefer A, Gong S, Peterson JD, Day M, Ramsey KE et al (2008). A translational profiling approach for the molecular characterization of CNS cell types. Cell 135: 738-748.
92. Hernndez A, Ibez-Sandoval O, Sierra A, Valdiosera R, Tapia D, Anaya V et al (2006). Control of the subthalamic innervation of the rat globus pallidus by d2/3 and d4 dopamine receptors. J Neurophysiol 96: 2877-2888.
93. Hikida T, Kimura K, Wada N, Funabiki K, Nakanishi S (2010). Distinct roles of synaptic transmission in direct and indirect striatal pathways to reward and Aversive behavior. Neuron 66: 896-907.
94. Hirvonen M, Laakso A, Nagren K, Rinne J, Pohjalainen T, Hietala J (2005). C957t polymorphism of the dopamine d2 receptor (drd2) gene affects striatal drd2 availability in vivo (corrigendum). Mol Psychiatry 10: 889.
95. Ho B-C, Wassink TH, O'Leary DS, Sheffield VC, Andreasen NC (2005). Catechol-O-methyl transferase val158met gene polymorphism in schizophrenia: working memory, frontal lobe mri morphology and frontal cerebral blood flow space. Mol Psychiatry 10: 287-298.
96. Holmes A, Lachowicz J, Sibley D (2004). Phenotypic analysis of dopamine receptor knock-out mice; recent insights into the functional specificity of dopamine receptor subtypes. Neuropharmacology 47: 1117-1134.
97. Hong JS, Yang HY, Costa E (1977). On the location of methionine enkephalin neurons in rat striatum. Neuropharmacology 16: 451.
98. Houk JC, Adams JL, Barto AG (1995). A model of how the basal ganglia generate and use neural signals that predict reinforcement. In: Houk JC, Davis JL, Beiser DG (eds). Models of Information Processing in the Basal Ganglia. MIT Press: Cambridge, MA, (pp. 233-248).
99. Hsu C, Chen C, Wang C, Chiu T (2009). Caffeine and a selective adenosine a 2a receptor antagonist induce reward and sensitization behavior associated with increased phospho-thr75-darpp-32 in mice. Psychopharmacology 204: 313-325.
100. Jackson ME, Frost AS, Moghaddam B (2001). Stimulation of prefrontal cortex at physiologically releVant frequencies inhibits dopamine release in the nucleus accumbens. J Neurochem 78: 920-923.
101. Jocham G, Klein TA, Neumann J, von Cramon DY, Reuter M, Ullsperger M (2009). Dopamine DRD2 polymorphism alters reversal learning and associated neural activity. J Neurosci 29: 3695-3704.
102. Joshua M, Adler A, Mitelman R, Vaadia E, Bergman H (2006). Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials. J Neurosci 28: 11673-11684.
103. Keller RW, Kuhr WG, Wightman RM, Zigmond MJ (1988). The effect of l-dopa on in vivo dopamine release from nigrostriatal bundle neurons. Brain Res 447: 191-194.
104. Keri S, Nagy H, Myers CE, Benedek G, Shohamy D, Gluck MA (2008). Risk and protective haplotypes of the alpha-synuclein gene associated with parkinsons disease differentially affect cognitive sequence learning. Genes Brain Behav 7: 31-36.
105. Kerr JN, Wickens JR (2001). Dopamine d-1/d-5 receptor activation is required for long-term potentiation in the rat neostriatum in vitro. J Neurophysiol 85: 117-124.
106. Kheirbek MA, Britt JP, Beeler JA, Ishikawa Y, McGehee DS, Zhuang X (2009). Adenylyl cyclase type 5 contributes to corticostriatal plasticity and striatum-dependent learning. J Neurosci 29: 12115-12124.
107. Kimberg DY, D'Esposito M, Farah MJ (1998). Effects of bromocriptine on human subjects depend on working memory capacity. Neuro Report 8: 3581-3585.
108. Klein A, Schmidt WJ (2003). Catalepsy intensifies context-dependently irrespective of whether it is induced by intermittent or chronic dopamine deficiency. Behav Pharmacol 14: 49-53.
109. Klein TA, Neumann J, Reuter M, Hennig J, von Cramon DY, Ullsperger M (2007). Genetically determined differences in learning from errors. Science (New York, NY) 318: 1642-1645.
110. Klorman R, Bauer LO, Coons HW, Lewis JL, Peloquin J, Perlmutter RA et al (1984). Enhancing effects of methylphenidate on normal young adults' cognitive processes. Psychopharmacol Bull 20: 3-9.
111. Kosten TA, Kehoe P (2010). Immediate and enduring effects of neonatal isolation on maternal behavior in rats. Int J Develop Neurosci 28: 53-61.
112. Krä mer UM, Cunillera T, Camara E, Marco-Pallares J, Cucurell D, Nager W et al (2007). The impact of catechol-O-methyltransferase and dopamine d4 receptor genotypes on neurophysiological markers of performance monitoring. J Neurosci 27: 14190-14198.
113. Krugel LK, Biele G, Mohr PN, Li SC, Heekeren HR (2009). Genetic variation in dopaminergic neuromodulation influences the ability to rapidly and flexibly adapt decisions. Proc Natl Acad Sci USA 106: 17951-17956.
114. Lenroot RK, Schmitt JE, Ordaz SJ, Wallace GL, Neale MC, Lerch JP et al (2009). Differences in genetic and environmental influences on the human cerebral cortex associated with development during childhood and adolescence. Hum Brain Mapping 30: 163-174.
115. Lindskog M, Kim M, Wikstrm MA, Blackwell KT, Kotaleski JH (2006). Transient calcium and dopamine increase pka activity and darpp-32 phosphorylation. PLoS Computational Biol 2: e119.
116. Linke J, Kirsch P, King AV, Gass A, Hennerici MG, Bongers A et al (2010). Motivational orientation modulates the neural response to reward. NeuroImage 49: 2618-2625.
117. Lobo M, Cui Y, Ostlund S, Balleine B, Yang X (2007). Genetic control of instrumental conditioning by striatopallidal neuronFspecific s1p receptor gpr6. Nat Neurosci 10: 1395-1397.
118. Creation and analysis of striatopallidal neuron-specific Gpr6-deficient mice reveal a role in instrumental conditioning. Lobo MK (2009). Molecular profiling of striatonigral and striatopallidal medium spiny neurons past, present, and future. Int Rev Neurobiol 89: 1-35.
119. Locke HS, Braver TS (2008). Motivational influences on cognitive control: behavior, brain activation, and individual differences. Cognitive Affect Behav Neurosci 8: 99-112.
120. Lu X, Shen Y, Dong H-W, Fan G, Yang XW (2008). Genetic analyses of a striatonigral neuron-enriched orphan nucleotide sugar-transporter Slc35D3. Soc Neurosci 578: 20.
121. Madras BK, Miller GM, Fischman AJ (2005). The dopamine transporter and attention-deficit/hyperactivity disorder. Biol Psychiatry 57: 1397-1409.
122. Matsumoto M, Hidaka K, Tada S, Tasaki Y, Yamaguchi T (1996). Low levels of mRNA for dopamine D4 receptor in human cerebral cortex and striatum. J Neurochem 66: 915-919.
123. Matsumoto M, Weickert CS, Akil M, Lipska BK, Hyde TM, Herman MM et al (2003). Catechol o-methyltransferase mrna expression in human and rat brain: evidence for a role in cortical neuronal function. Neuroscience 116: 127-137.
124. Mehta MA, Goodyer IM, Sahakian BJ (2004). Methylphenidate improves working memory and set-shifting in ad/hd: relationships to baseline memory capacity. J Child Psychol Psychiatry Allied Disciplines 45: 293-305.
125. Mehta MA, Sahakian BJ, McKenna PJ, Robbins TW (1999). Systemic sulpiride in young adults simulates the profile of cognitive deficits in parkinson's disease. Psychopharmacology 146: 162-174.
126. Meyer-Lindenberg A, Kohn PD, Kolachana B, Kippenhan S, McInerney-Leo A, Nussbaum R et al (2005). Midbrain dopamine and prefrontal function in humans: interaction and modulation by COMT genotype. Nat Neurosci 8: 594-596.
127. Meyer-Lindenberg A, Nichols T, Callicott JH, Ding J, Kolachana B, Buckholtz J et al (2006). Impact of complex genetic variation in COMT on human brain function. Mol Psychiatry 11: 867-877, 797.
128. Meyer-Lindenberg A, Straub RE, Lipska BK, Verchinski BA, Goldberg T, Callicott JH et al (2007). Genetic evidence implicating DARPP-32 in human frontostriatal structure, function, and cognition. JClin Invest 117: 672-682.
129. Mier D, Kirsch P, Meyer-Lindenberg A (2009). Neural substrates of pleiotropic action of genetic variation in COMT: a meta-analysis. Mol Psychiatry (in press). Meta-analysis showing COMT genotype reliably affects prefrontal activation with large effect size.
130. 0 utr vntr: evidence from brain and lymphocytes using quantitative rt-pcr. Am J Med Genetics 114: 975-979.
131. Miller R (2007). A Theory of the Basal Ganglia and their Disorders. CRC Press.
132. Mingote S, Font L, Farrar AM, Vontell R, Worden LT, Stopper CM et al (2008). Nucleus accumbens adenosine A2A receptors regulate exertion of effort by acting on the ventral striatopallidal pathway. J Neurosci 28: 9037-9046.
133. Miyake A, Friedman NP, Emerson MJ, Witzki AH, Howerter A, Wager TD (2000). The unity and diversity of executive functions and their contributions to complex 'frontal lobe' tasks: a latent variable analysis. Cognitive Psychol 41: 49-100.
134. Montague PR, Hyman SE, Cohen JD (2004). Computational roles for dopamine in behavioural control. Nature 431: 760-767.
135. Montana G, Pritchard JK (2004). Statistical tests for admixture mapping with case-control and cases-only data. Am J Human Genetics 75: 771-789.
136. Moustafa AA, Cohen MX, Sherman SJ, Frank MJ (2008a). A role for dopamine in temporal decision making and reward maximization in Parkinsonism. J Neurosci 28: 12294-12304.
137. Moustafa AA, Sherman SJ, Frank MJ (2008b). A dopaminergic basis for working memory, learning, and attentional shifting in parkinson's disease. Neuropsycho-logia 46: 3144-3156.
138. Munafo MR, Clark T, Flint J (2005). Does measurement instrument moderate the association between the serotonin transporter gene and anxiety-related personality traits? A meta-analysis. Mol Psychiatry 10: 415-419.
139. Nackley AG, Shabalina SA, Tchivileva IE, Satterfield K, Korchynskyi O, Makarov SS et al (2006). Human catechol-o-methyltransferase haplotypes modulate protein expression by altering mrna secondary structure. Science 314: 1930-1933.
140. Nakamura K, Hikosaka O (2006). Role of dopamine in the primate caudate nucleus in reward modulation of saccades. J Neurosci 26: 5360-5369.
141. Nambu A, Tokuno H, Hamada I, Kita H, Imanishi M, Akazawa T et al (2000). Excitatory cortical inputs to pallidal neurons via the subthalamic nucleus in the monkey. J Neurophysiol 84: 289-300.
142. Oak JN, Oldenhof J, Tol HHV (2000). The dopamine d(4) receptor: one decade of research. Eur J Pharmacol 405: 303-327.
143. 0-monophosphate- regulated phosphoprotein enriched indopamine-innervated brain regions. iii. Immunocytochemical localization. J Neurosci 4: 111-124.
144. Palminteri S, Lebreton M, Worbe Y, Grabli D, Hartmann A, Pessiglione M (2009). Pharmacological modulation of subliminal learning in parkinson's and tourette's syndromes. Proc Natl Acad Sci USA 106: 19179-19184.
145. Pan W-X, Schmidt R, Wickens JR, Hyland BI (2008). Tripartite mechanism of extinction suggested by dopamine neuron activity and temporal difference model. J Neurosci 28: 9619-9631.
146. Pietersen AN, Lancaster DM, Patel N, Hamilton JB, Vreugdenhil M (2009). Modulation of gamma oscillations by endogenous adenosine through a1 and a2a receptors in the mouse hippocampus. Neuropharmacology 56: 481-492.
147. Pohjalainen T, Rinne JO, Ngren K, Lehikoinen P, Anttila K, Syvlahti EK et al (1998). The a1 allele of the human d2 dopamine receptor gene predicts low d2 receptor availability in healthy volunteers. Mol Psychiatry 3: 256-260.
148. Purcell SM, Wray NR, Stone JL, Visscher PM, O'DonoVan MC, SulliVan PF et al (2009). Common polygenic variation contributes to risk of schizophrenia and bipolar disorder. Nature 460: 748-752.
149. Renthal W, Carle TL, Maze I, Covington HE, Truong H-T, Alibhai I et al (2008). Delta fosb mediates epigenetic desensitization of the c-fos gene after chronic amphetamine exposure. J Neurosci 28: 7344.
150. Reynolds JNJ, Hyland BI, Wickens JR (2001). A cellular mechanism of reward-related learning. Nature 412: 67-69.
151. Robbins TW, Everitt BJ (2007). A role for mesencephalic dopamine in activation: com-mentary on berridge (2006). Psychopharmacology 191 433-437.
152. Roberts AC, De Salvia MA, Wilkinson LS, Collins P, Muir JL, Everitt BJ et al (1994). 6-hydroxydopamine lesions of the pre-frontal cortex in monkeys enhance performance on an analog of the wisconsin card sort test: possible interactions with subcortical dopamine. J Neurosci 14: 2531-2544.
153. Roesch MR, Calu DJ, Schoenbaum G (2007). Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat Neurosci 10: 1615-1624.
154. Roesch-Ely D, Scheffel H, Weiland S, Schwaninger M, Hundemer H-P, Kolter T et al (2005). Differential dopaminergic modulation of executive control in healthy subjects. Psychopharmacology 178: 420-430.
155. Rolls ET, Loh M, Deco G, Winterer G (2008). Computational models of schizophrenia and dopamine modulation in the prefrontal cortex. Nat Rev 9: 696-709.
156. Salamone JD, Correa M (2002). Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav Brain Res 137: 3-25.
157. Salamone JD, Correa M, Farrar AM, Nunes EJ, Pardo M (2009). Dopamine, behavioral economics, and effort. Front Behav Neurosci 3: 13.
158. Satoh T, Nakai S, Sato T, Kimura M (2003). Correlated coding of motivation and outcome of decision by dopamine neurons. J Neurosci 23: 9913-9923.
159. Sawaguchi T, Goldman-Rakic PS (1991). D1 dopamine receptors in prefrontal cortex: involvement in working memory. Science 251: 947-950.
160. Scarr S (1992). Developmental theories for the 1990s: development and individual differences. Child Develop 63: 1-19.
161. Schultz W, Dayan P, Montague PR (1997). A neural substrate of prediction and reward. Science 275: 1593.
162. Seminal paper reviewing the computational reward prediction error hypothesis of midbrain dopamine neuronal responses, first proposed by Read Montague, Peter Dayan and Terry Sejnowksi. Seamans JK, Yang CR (2004). The principal features and mechanisms of dopamine mod-ulation in the prefrontal cortex. Prog Neurobiol 74: 1-57.
163. Selva EM, Hong K, Baeg GH, Beverley SM, Turco SJ, Perrimon N et al (2001). Dual role of the fringe connection gene in both heparan sulphate and fringe-dependent signalling events. Nat Cell Biol 3: 809-815.
164. Sesack SR, Hawrylak VA, Matus C, Guido MA, Levey AI (1998). Dopamine axon varicosities in the prelimbic division of the rat prefrontal cortex exhibit sparse immunoreactivity for the dopamine transporter. J Neurosci Off J Soc Neurosci 18: 2697-2708.
165. Shen W, Flajolet M, Greengard P, Surmeier DJ (2008). Dichotomous dopaminergic control of striatal synaptic plasticity. Science (New York, NY) 321: 848-851.
166. Shi J, Levinson DF, Duan J, Sanders AR, Zheng Y, Pe'er I et al (2009). Common variants on chromosome 6p22.1 are associated with schizophrenia. Nature 460: 753-757.
167. Slifstein M, Kolachana B, Simpson EH, Tabares P, Cheng B, Duvall M et al (2008). COMT genotype predicts cortical-limbic D1 receptor availability measured with [11c]nnc112 and pet. Mol Psychiatry 13: 821-827.
168. Song C, Kanthasamy A, Anantharam V, Sun F, Kanthasamy AG (2010). Environmental neurotoxic pesticide increases histone acetylation to promote apoptosis in dopaminergic neuronal cells: ReleVance to epigenetic mechanisms of neurodegeneration. Mol Pharmacol 77: 621-632.
169. Stefansson H, Ophoff RA, Steinberg S, Andreassen OA, Cichon S, Rujescu D et al (2009). Common variants conferring risk of schizophrenia. Nature 460: 744-747.
170. Stipanovich A, Valjent E, Matamales M, Nishi A, Ahn J-H, Maroteaux M et al (2008). A phosphatase cascade by which rewarding stimuli control nucleosomal response. Nature 453: 879-884.
171. Showed a necessary role for DARPP-32 in behavioral reward learning mediated by D1 but not D2 receptor stimulation. Stollstorff M, Foss-Feig J, Cook EH, Stein MA, Gaillard WD, Vaidya CJ (2010). Neural response to working memory load varies by dopamine transporter genotype in children. NeuroImage (in press).
172. Stoof J, Kebabian J (1981). Opposing roles for d-1 and d-2 dopamine receptors in efflux of cyclic amp from rat neostriatum.
173. Nature 294: 366-368. Surmeier DJ, Yan Z, Song WJ (1997). Coordinated expression of dopamine receptors in neostriatal medium spiny neurons. Adv Pharmacol (San Diego, CA) 42: 6579-6591.
174. Tan H-Y, Callicott JH, Weinberger DR (2007a). Dysfunctional and compensatory prefrontal cortical systems, genes and the pathogenesis of schizophrenia. Cerebral Cortex (New York, NY: 1991) 17(Suppl 1): i171-i181.
175. Tan H-Y, Chen Q, Goldberg TE, Mattay VS, Meyer-Lindenberg A, Weinberger DR et al (2007b). Catechol-o-methyltransferase val158met modulation of prefrontal-parietal-striatal brain systems during arithmetic and temporal transformations in working memory. J Neurosci 27: 13393-13401.
176. Tsai H-C, Zhang F, Adamantidis A, Stuber GD, Bonci A, de Lecea L et al (2009). Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science (New York, NY) 324: 1080-1084.
177. Tunbridge EM, Bannerman DM, Sharp T, Harrison PJ (2004). Catechol-O-methyl-transferase inhibition improves set-shifting performance and elevates stimulated dopamine release in the rat prefrontal cortex. J Neurosci 24: 5331-5335.
178. Ullsperger M (2009). Genetic association studies of performance monitoring and learning from feedback: the role of dopamine and serotonin. Neurosci Biobehav Rev 34: 649-659.
179. Valjent E, Pascoli V, Svenningsson P, Paul S, Enslen H, Corvol J-C et al (2005). Regulation of a protein phosphatase cascade allows convergent dopamine and glutamate signals to activate erk in the striatum. Proc Natl Acad Sci USA 102: 491.
180. VanNess S, Owens M, Kilts C (2005). The variable number of tandem repeats element in dat1 regulates in vitro dopamine transporter density. BMC Genetics 6: 55.
181. Veldic M, Kadriu B, Maloku E, Agis-Balboa RC, Guidotti A, Davis JM et al (2007). Epigenetic mechanisms expressed in basal ganglia gabaergic neurons differentiate schizophrenia from bipolar disorder. Schizophrenia Res 91: 51-61.
182. Voon V, Pessiglione M, Brezing C, Gallea C, Fernandez HH, Dolan RJ et al (2010). Mechanisms underlying dopamine-mediated reward bias in compulsive behaviors. Neuron 65: 135-142.
183. Waddington JL, O'Tuathaigh C, O'SulliVan G, Tomiyama K, Koshikawa N, Croke DT (2005). Phenotypic studies on dopamine receptor subtype and associated signal transduction mutants: insights and challenges from 10 years at the psychopharmacology-molecular biology interface. Psychopharmacology 181: 611-638.
184. Waltz JA, Frank MJ, Robinson BM, Gold JM (2007). Selective reinforcement learning deficits in schizophrenia support predictions from computational models of striatal-cortical dysfunction. Biol Psychiatry 62: 756-764.
185. Waltz JA, Schweitzer JB, Gold JM, Kurup PK, Ross TJ, Salmeron BJ et al (2009). Patients with schizophrenia have a reduced neural response to both unpredictable and predictable primary reinforcers. Neuropsychopharmacology 34: 1567-1577.
186. Watanabe M, Sakagami M (2007). Integration of cognitive and motivational context information in the primate prefrontal cortex. Cerebral Cortex 17(Suppl 1): i101-i109.
187. Welch J, Lu J, Rodriguiz R, Trotta N, Peca J, Ding J-D et al (2007). Corticostriatal synaptic defects and OCD-like behaviours in SAPAP3-mutant mice. Nature 448: 894-900.
188. Wickens JR, Reynolds JNJ, Hyland BI (2003). Neural mechanisms of reward-related motor learning. Curr Opin Neurobiol 13: 685-690.
189. Wiecki TV, Riedinger K, von Ameln-Mayerhofer A, Schmidt WJ, Frank MJ (2009). A neurocomputational account of catalepsy sensitization induced by d2 receptor blockade in rats: context dependency, extinction, and renewal. Psychopharma-cology 204: 1-13.
190. Wightman RM, Amatore C, Engstrom RC, Hale PD, Kristensen EW, Kuhr WG et al (1988). Real-time characterization of dopamine overflow and uptake in the rat striatum. Neuroscience 25: 513-523.
191. Xu M, Moratalla R, Gold LH, Hiroi N, Koob GF, Graybiel AM et al (1994). Dopamine d1 receptor mutant mice are deficient in striatal expression of dynorphin and in dopamine-mediated behavioral responses. Cell 79: 729.
192. Yacubian J, Sommer T, Schroeder K, Glscher J, Kalisch R, Leuenberger B et al (2007). Gene-gene interaction associated with neural reward sensitivity. Proc Natl Acad Sci USA 104: 8125-8130.
193. Yu C, Gupta J, Chen J-F, Yin HH (2009). Genetic deletion of a2a adenosine receptors in the striatum selectively impairs habit formation. J Neurosci 29: 15100-15103.
194. Zaghloul KA, Blanco JA, Weidemann CT, McGill K, Jaggi JL, Baltuch GH et al (2009). Human substantia nigra neurons encode unexpected financial rewards. Science 323: 1496-1499.
195. Zemel RS, Dayan P, Pouget A (1998). Probabilistic interpretation of population codes. Neural Computat 10: 403-430.
196. Zhang Y, Bertolino A, Fazio L, Blasi G, Rampino A, Romano R et al (2007). Polymorphisms in human dopamine d2 receptor gene affect gene expression, splicing, and neuronal activity during working memory. Proc Natl Acad Sci USA 104: 20552-20557.
197. Zweifel LS, Parker JG, Lobb CJ, Rainwater A, Wall VZ, Fadok JP et al (2009). Disruption of nmdar-dependent burst firing by dopamine neurons provides selective assessment of phasic dopamine-dependent behavior. Proc Natl Acad Sci USA 106: 7281-7288.