Dopaminergic control of the striatum for high-level cognition

Current Opinion in Neurobiology

Volumn 21, Issue 3, 2011, Pages 402-407

  Cools, Roshan ^a  

^a RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE; DOPAMINE RECEPTOR;

BEHAVIOR; COGNITION; CORPUS STRIATUM; DOPAMINERGIC NERVE CELL; DOPAMINERGIC TRANSMISSION; DORSOLATERAL STRIATUM; DORSOMEDIAL STRIATUM; HABIT; HIPPOCAMPUS; HUMAN; INSTRUMENTAL LEARNING; LEARNING; MESENCEPHALON; NONHUMAN; PARKINSON DISEASE; PAVLOVIAN LEARNING; PREFRONTAL CORTEX; PRIORITY JOURNAL; REVIEW; REWARD; WORKING MEMORY;

ANIMALS; COGNITION; CORPUS STRIATUM; DOPAMINE; HUMANS; MODELS, BIOLOGICAL;

EID: 79960280144     PISSN: 09594388     EISSN: 18736882     Source Type: Journal    
DOI: 10.1016/j.conb.2011.04.002     Document Type: Review

References (73)

1. Maia T.V., Frank M.J. From reinforcement learning models to psychiatric and neurological disorders. Nat Neurosci 2011, 14:154-162.
2. Flagel S.B., Clark J.J., Robinson T.E., Mayo L., Czuj A., Willuhn I., Akers C.A., Clinton S.M., Phillips P.E., Akil H. A selective role for dopamine in stimulus-reward learning. Nature 2011, 469:53-57.
3. Frank M: Computational models of motivated action selection in corticostriatal circuits. Curr Opin Neurobiol 2011, this volume.
4. Dagher A., Robbins T.W. Personality, addiction, dopamine: insights from Parkinson's disease. Neuron 2009, 61:502-510.
5. Daw N., Niv Y., Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 2005, 8:1704-1711.
6. Dickinson A. Actions and habits - the development of behavioral autonomy. Philos Trans R Soc Lond B - Biol Sci 1985, 308:67-78.
7. Bornstein A, Daw N: Multiplicity of control in the basal ganglia: computational roles of striatal subregions. Curr Opin Neurobiol 2011, this volume.
8. Yin H., Ostlund S., Balleine B. Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks. Eur J Neurosci 2008, 28:1437-1448.
9. Valentin V.V., Dickinson A., O'Doherty J.P. Determining the neural substrates of goal-directed learning in the human brain. J Neurosci 2007, 27:4019-4026.
10. Gläscher J., Daw N., Dayan P., O'Doherty J.P. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 2011, 66:585-595.
11. Hampton A.N., Bossaerts P., O'Doherty J.P. The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. J Neurosci 2006, 26:8360-8367.
12. Daw N., Gershman S., Seymour B., Dayan P., Dolan R. Model-based influences on human choices and striatal prediction errors. Neuron 2011, 69:1204-1215.
13. Gupta A.S., van der Meer M.A., Touretzky D.S., Redish A.D. Hippocampal replay is not a simple function of experience. Neuron 2010, 65:695-705.
14. van der Meer M.A., Redish A.D. Expectancies in decision making, reinforcement learning, and ventral striatum. Front Neurosci 2010, 4:6.
15. Dayan P. Dopamine, reinforcement learning, and addiction. Pharmacopsychiatry 2009, 42:S56-S65.
16. Dayan P., Balleine B.W. Reward, motivation, and reinforcement learning. Neuron 2002, 36:285-298.
17. Cools R, D'Esposito M: Inverted-U Shaped dopamine actions on human working memory and cognitive control. Biol Psychiatr 2011, in press.
18. Clatworthy P.L., Lewis S.J., Brichard L., Hong Y.T., Izquierdo D., Clark L., Cools R., Aigbirhio F.I., Baron J.C., Fryer T.D., et al. Dopamine release in dissociable striatal subregions predicts the different effects of oral methylphenidate on reversal learning and spatial working memory. J Neurosci 2009, 29:4690-4696.
19. Swainson R., SenGupta D., Shetty T., Watkins L.H., Summers B.A., Sahakian B.J., Polkey C.E., Barker R.A., Robbins T.W. Impaired dimensional selection but intact use of reward feedback during visual discrimination learning in Parkinson's disease. Neuropsychologia 2006, 44:1290-1304.
20. Lewis S., Slabosz A., Robbins T., Barker R., Owen A. Dopaminergic basis for deficits in working memory but not attentional set-shifting in Parkinson's disease. Neuropsychologia 2005, 43:823-832.
21. Dodds C.M., Clark L., Dove A., Regenthal R., Baumann F., Bullmore E., Robbins T.W., Muller U. The dopamine D2 receptor antagonist sulpiride modulates striatal BOLD signal during the manipulation of information in working memory. Psychopharmacology (Berl) 2009, 207:35-45.
22. Dalley J.W., Everitt B.J., Robbins T.W. Impulsivity, compulsivity, and top-down cognitive control. Neuron 2011, 69:680-694.
23. Cools R. Dopaminergic modulation of cognitive function-implications for L-DOPA treatment in Parkinson's disease. Neurosci Biobehav Rev 2006, 30:1-23.
24. Cools R., Stefanova E., Barker R.A., Robbins T.W., Owen A.M. Dopaminergic modulation of high-level cognition in Parkinson's disease: the role of the prefrontal cortex revealed by PET. Brain 2002, 125:584-594.
25. Mehta M.A., Gumaste D., Montgomery A.J., McTavish S.F., Grasby P.M. The effects of acute tyrosine and phenylalanine depletion on spatial working memory and planning in healthy volunteers are predicted by changes in striatal dopamine levels. Psychopharmacology (Berl) 2005, 180:654-663.
26. Collins P., Roberts A.C., Dias R., Everitt B.J., Robbins T.W. Perseveration and strategy in a novel spatial self-ordered sequencing task for nonhuman primates: effects of excitotoxic lesions and dopamine depletions of the prefrontal cortex. J Cogn Neurosci 1998, 10:332-354.
27. Cools R., Altamirano L., D'Esposito M. Reversal learning in Parkinson's disease depends on medication status and outcome valence. Neuropsychologia 2006, 44:1663-1673.
28. Cools R., Frank M., Gibbs S., Miyakawa A., Jagust W., D'Esposito M. Striatal dopamine synthesis capacity predicts dopaminergic drug effects on flexible outcome learning. J Neurosci 2009, 29:1538-1543.
29. Bromberg-Martin E.S., Hikosaka O. Midbrain dopamine neurons signal preference for advance information about upcoming rewards. Neuron 2009, 63:119-126.
30. Morris G., Nevet A., Arkadir D., Vaadia E., Bergman H. Midbrain dopamine neurons encode decisions for future action. Nat Neurosci 2006, 9:1057-1063.
31. Waelti P., Dickinson A., Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 2001, 412:43-48.
32. Alexander G., DeLong M., Stuck P. Parallel organisation of functionally segregated circuits linking basal ganglia and cortex. Ann Rev Neurosci 1986, 9:357-381.
33. Haber S.N., Knutson B. The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 2010, 35:4-26.
34. Draganski B., Kherif F., Kloppel S., Cook P.A., Alexander D.C., Parker G.J., Deichmann R., Ashburner J., Frackowiak R.S. Evidence for segregated and integrative connectivity patterns in the human Basal Ganglia. J Neurosci 2008, 28:7143-7152.
35. Vijayraghavan S., Wang M., Birnbaum S., Williams G., Arnsten A. Inverted-U dopamine D1 receptor actions on prefrontal neurons engaged in working memory. Nat Neurosci 2007, 10:176-184.
36. Durstewitz D., Seamans J.K. The dual-state theory of prefrontal cortex dopamine function with relevance to catechol-o-methyltransferase genotypes and schizophrenia. Biol Psychiatry 2008, 64:739-749.
37. Arnsten A.F. Stress signalling pathways that impair prefrontal cortex structure and function. Nat Rev Neurosci 2009, 10:410-422.
38. Seamans J.K., Yang C.R. The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog Neurobiol 2004, 74:1-58.
39. Frank M.J., Doll B.B., Oas-Terpstra J., Moreno F. Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nat Neurosci 2009, 12:1062-1068.
40. Shohamy D., Adcock R.A. Dopamine and adaptive memory. Trends Cogn Sci 2010, 14:464-472.
41. Wang S.H., Redondo R.L., Morris R.G. Relevance of synaptic tagging and capture to the persistence of long-term potentiation and everyday spatial memory. Proc Natl Acad Sci USA 2010, 107:19537-19542.
42. Goto Y., Grace A. Dopaminergic modulation of limbic and cortical drive of nucleus accumbens in goal-directed behavior. Nat Neurosci 2005, 8:805-812.
43. Lex B., Hauber W. The role of dopamine in the prelimbic cortex and the dorsomedial striatum in instrumental conditioning. Cereb Cortex 2010, 20:873-883.
44. Cools R., Sheridan M., Jacobs E., D'Esposito M. Impulsive personality predicts dopamine-dependent changes in frontostriatal activity during component processes of working memory. J Neurosci 2007, 27:5506-5514.
45. Marklund P., Larsson A., Elgh E., Linder J., Riklund K.A., Forsgren L., Nyberg L. Temporal dynamics of basal ganglia under-recruitment in Parkinson's disease: transient caudate abnormalities during updating of working memory. Brain 2009, 132:336-346.
46. Nyberg L., Andersson M., Forsgren L., Jakobsson-Mo S., Larsson A., Marklund P., Nilsson L.G., Riklund K., Backman L. Striatal dopamine D2 binding is related to frontal BOLD response during updating of long-term memory representations. Neuroimage 2009, 46:1194-1199.
47. Landau S.M., Lal R., O'Neil J.P., Baker S., Jagust W.J. Striatal dopamine and working memory. Cereb Cortex 2009, 19:445-454.
48. Stelzel C., Basten U., Montag C., Reuter M., Fiebach C.J. Frontostriatal involvement in task switching depends on genetic differences in d2 receptor density. J Neurosci 2010, 30:14205-14212.
49. Kellendonk C., Simpson E., Polan H., Malleret G., Vronskaya S., Winiger V., Moore H., Kandel E. Transient and selective overexpression of dopamine D2 receptors in the striatum causes persistent abnormalities in prefrontal cortex functioning. Neuron 2006, 49:603-615.
50. Hazy T.E., Frank M.J., O'Reilly R.C. Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system. Philos Trans R Soc Lond B Biol Sci 2007, 362:1601-1613.
51. den Ouden H., Daunizeau J., Roiser J., Friston K., Stephan K. Striatal prediction error modulates cortical coupling. J Neurosci 2010, 30:3210-3219.
52. van Schouwenburg M.R., den Ouden H.E., Cools R. The human basal ganglia modulate frontal-posterior connectivity during attention shifting. J Neurosci 2010, 30:9910-9918.
53. Doll B.B., Jacobs W.J., Sanfey A.G., Frank M.J. Instructional control of reinforcement learning: a behavioral and neurocomputational investigation. Brain Res 2009, 1299:74-94.
54. Delgado M.R., Gillis M.M., Phelps E.A. Regulating the expectation of reward via cognitive strategies. Nat Neurosci 2008, 11:880-881.
55. Delgado M.R., Frank R.H., Phelps E.A. Perceptions of moral character modulate the neural systems of reward during the trust game. Nat Neurosci 2005, 8:1611-1618.
56. Strafella A., Paus T., Barrett J., Dagher A. Repetitive transcranial magnetic stimulation of the human prefrontal cortex induces dopamine release in the caudate nucleus. J Neurosci 2001, 21:RC157.
57. Haber S.N., Fudge J.L., McFarland N.R. Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J Neurosci 2000, 20:2369-2382.
58. Aarts E., Roelofs A., Franke B., Rijpkema M., Fernandez G., Helmich R.C., Cools R. Striatal dopamine mediates the interface between motivational and cognitive control in humans: evidence from genetic imaging. Neuropsychopharmacology 2010, 35:1943-1951.
59. Montague P., Dayan P., Sejnowski T. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 1996, 16:1936-1947.
60. Balleine B.W., O'Doherty J.P. Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 2010, 35:48-69.
61. Haruno M., Kawato M. Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning. Neural Netw 2006, 19:1242-1254.
62. Wyvell C., Berridge K. Intra-accumbens amphetamine increases the conditioned incentive salience of sucrose reward: enhancement of reward "wanting" without enhanced "liking" or response reinforcement. J Neurosci 2000, 20:8122-8130.
63. Robbins T.W., Everitt B.J. A role for mesencephalic dopamine in activation: commentary on Berridge (2006). Psychopharmacology (Berl) 2007, 191:433-437.
64. Gan J.O., Walton M.E., Phillips P.E. Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat Neurosci 2010, 13:25-27.
65. Salamone J.D., Correa M., Farrar A., Mingote S.M. Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology (Berl) 2007, 191:461-482.
66. Ostlund S., Wassum K., Murphy N., Balleine B., Maidment N. Extracellular dopamine levels in striatal subregions track shifts in motivation and response cost during instrumental conditioning. J Neurosci 2011, 31:200-207.
67. Niv Y., Daw N.D., Joel D., Dayan P. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl) 2007, 191:507-520.
68. Koechlin E., Ody C., Kouneiher F. The architecture of cognitive control in the human prefrontal cortex. Science 2003, 302:1181-1185.
69. Badre D., D'Esposito M. Is the rostro-caudal axis of the frontal lobe hierarchical?. Nat Rev Neurosci 2009, 10:659-669.
70. Botvinick M.M., Niv Y., Barto A.C. Hierarchically organized behavior and its neural foundations: a reinforcement learning perspective. Cognition 2009, 113:262-280.
71. Thorn C.A., Atallah H., Howe M., Graybiel A.M. Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning. Neuron 2010, 66:781-795.
72. Yin H.H., Mulcare S.P., Hilario M.R., Clouse E., Holloway T., Davis M.I., Hansson A.C., Lovinger D.M., Costa R.M. Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill. Nat Neurosci 2009, 12:333-341.
73. Barnes T.D., Kubota Y., Hu D., Jin D.Z., Graybiel A.M. Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 2005, 437:1158-1161.