Dissociable effects of dopamine on learning and performance within sensorimotor striatum

Basal Ganglia

Volumn 4, Issue 2, 2014, Pages 43-54

  Leventhal, Daniel K ^a,b   Stoetzner, Colin R ^b   Abraham, Rohit ^b   Pettibone, Jeff ^b   DeMarco, Kayla ^b   Berke, Joshua D ^b  

^a UNIVERSITY OF MICHIGAN MEDICAL SCHOOL   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Basal ganglia; Dopamine; Parkinson disease; Striatum

Indexed keywords

AMPHETAMINE; DOPAMINE; DOPAMINE 2 RECEPTOR; FLUPENTIXOL; MUSCIMOL; OXIDOPAMINE;

ACCURACY; ADULT; ANIMAL EXPERIMENT; ANIMAL MODEL; ANIMAL TISSUE; ARTICLE; CONDITIONED REFLEX; CONTROLLED STUDY; CORPUS STRIATUM; DECISION MAKING; DOPAMINERGIC SYSTEM; FORCED CHOICE METHOD; LEARNING; MALE; MENTAL DISSOCIATION; MENTAL PERFORMANCE; MOTOR CONTROL; MOTOR PERFORMANCE; NONHUMAN; PARKINSON DISEASE; PRIORITY JOURNAL; RAT; RESPONSE TIME; SIGNAL TRANSDUCTION; TASK PERFORMANCE;

EID: 84901830272     PISSN: 22105336     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.baga.2013.11.001     Document Type: Article

References (107)

1. Nutt J.G., Carter J.H., Lea E.S., Sexton G.J. Evolution of the response to levodopa during the first 4 years of therapy. Ann Neurol 2002, 51:686-693.
2. Muenter M.D., Tyce G.M. l-Dopa therapy of Parkinson's disease: plasma l-dopa concentration, therapeutic response, and side effects. Mayo Clin Proc 1971, 46:231-239.
3. Nutt J.G., Carter J.H., Lea E.S., Woodward W.R. Motor fluctuations during continuous levodopa infusions in patients with Parkinson's disease. Mov Disord 1997, 12:285-292.
4. Albin R.L., Young A.B., Penney J.B. The functional anatomy of basal ganglia disorders. Trends Neurosci 1989, 12:366-375.
5. DeLong M.R. Primate models of movement disorders of basal ganglia origin. Trends Neurosci 1990, 13:281-285.
6. Brown P., Oliviero A., Mazzone P., Insola A., Tonali P., Di Lazzaro V. Dopamine dependency of oscillations between subthalamic nucleus and pallidum in Parkinson's disease. J Neurosci 2001, 21:1033-1038.
7. Heimer G., Bar-Gad I., Goldberg J.A., Bergman H. Dopamine replacement therapy reverses abnormal synchronization of pallidal neurons in the 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine primate model of parkinsonism. J Neurosci 2002, 22:7850-7855.
8. Levy R., Ashby P., Hutchison W.D., Lang A.E., Lozano A.M., Dostrovsky J.O. Dependence of subthalamic nucleus oscillations on movement and dopamine in Parkinson's disease. Brain 2002, 125:1196-1209.
9. Ellens D.J., Leventhal D.K. Review: electrophysiology of basal ganglia and cortex in models of parkinson disease. J Parkinsons Dis 2013, 3:241-254.
10. Bergman H., Wichmann T., Karmon B., DeLong M.R. The primate subthalamic nucleus. II. Neuronal activity in the MPTP model of parkinsonism. J Neurophysiol 1994, 72:507-520.
11. Nini A., Feingold A., Slovin H., Bergman H. Neurons in the globus pallidus do not show correlated activity in the normal monkey, but phase-locked oscillations appear in the MPTP model of parkinsonism. J Neurophysiol 1995, 74:1800-1805.
12. Mallet N., Pogosyan A., Sharott A., Csicsvari J., Bolam J.P., Brown P., et al. Disrupted dopamine transmission and the emergence of exaggerated beta oscillations in subthalamic nucleus and cerebral cortex. J Neurosci 2008, 28:4795-4806.
13. Redgrave P., Vautrelle N., Reynolds J.N. Functional properties of the basal ganglia's re-entrant loop architecture: selection and reinforcement. Neuroscience 2011, 198:138-151.
14. Shiner T., Seymour B., Wunderlich K., Hill C., Bhatia K.P., Dayan P., et al. Dopamine and performance in a reinforcement learning task: evidence from Parkinson's disease. Brain 2012, 135:1871-1883.
15. Kravitz A.V., Freeze B.S., Parker P.R., Kay K., Thwin M.T., Deisseroth K., et al. Regulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitry. Nature 2010, 466:622-626.
16. Watanabe M., Munoz D.P. Saccade suppression by electrical microstimulation in monkey caudate nucleus. J Neurosci 2010, 30:2700-2709.
17. Sakamoto M., Hikosaka O. Eye movements induced by microinjection of GABA agonist in the rat substantia nigra pars reticulata. Neurosci Res 1989, 6:216-233.
18. Burbaud P., Bonnet B., Guehl D., Lagueny A., Bioulac B. Movement disorders induced by gamma-aminobutyric agonist and antagonist injections into the internal globus pallidus and substantia nigra pars reticulata of the monkey. Brain Res 1998, 780:102-107.
19. McCairn K.W., Bronfeld M., Belelovsky K., Bar-Gad I. The neurophysiological correlates of motor tics following focal striatal disinhibition. Brain 2009, 132:2125-2138.
20. Anderson E., Nutt J. The long-duration response to levodopa: Phenomenology, potential mechanisms and clinical implications. Parkinsonism Relat Disord 2011, 17:587-592.
21. Berke J.D., Paletzki R.F., Aronson G.J., Hyman S.E., Gerfen C.R. A complex program of striatal gene expression induced by dopaminergic stimulation. J Neurosci 1998, 18:5301-5310.
22. Berke J.D., Hyman S.E. Addiction, dopamine, and the molecular mechanisms of memory. Neuron 2000, 25:515-532.
23. Beeler J.A. Preservation of function in Parkinson's disease: what's learning got to do with it?. Brain Res 2011, 1423:96-113.
24. Surmeier D.J., Carrillo-Reid L., Bargas J. Dopaminergic modulation of striatal neurons, circuits, and assemblies. Neuroscience 2011, 198:3-18.
25. Lerner T.N., Kreitzer A.C. Neuromodulatory control of striatal plasticity and behavior. Curr Opin Neurobiol 2011, 21:322-327.
26. Beeler J.A., Cao Z.F., Kheirbek M.A., Ding Y., Koranda J., Murakami M., et al. Dopamine-dependent motor learning: insight into levodopa's long-duration response. Ann Neurol 2010, 67:639-647.
27. Beeler J.A., Frank M.J., McDaid J., Alexander E., Turkson S., Sol Bernandez M., et al. A role for dopamine-mediated learning in the pathophysiology and treatment of Parkinson's disease. Cell Rep 2012, 2:1747-1761.
28. Wise R.A. Neuroleptics and operant behavior: the anhedonia hypothesis. Behav Brain Sci 1982, 5:39-53.
29. Dowd E., Dunnett S.B. Comparison of 6-hydroxydopamine-induced medial forebrain bundle and nigrostriatal terminal lesions in a lateralised nose-poking task in rats. Behav Brain Res 2005, 159:153-161.
30. Obeso J.A., Jahanshahi M., Alvarez L., Macias R., Pedroso I., Wilkinson L., et al. What can man do without basal ganglia motor output? The effect of combined unilateral subthalamotomy and pallidotomy in a patient with Parkinson's disease. Exp Neurol 2009, 220:283-292.
31. Andalman A.S., Fee M.S. A basal ganglia-forebrain circuit in the songbird biases motor output to avoid vocal errors. Proc Natl Acad Sci U S A 2009, 106:12518-12523.
32. Desmurget M., Turner R.S. Motor sequences and the basal ganglia: kinematics, not habits. J Neurosci 2010, 30:7685-7690.
33. Atallah H.E., Lopez-Paniagua D., Rudy J.W., O'Reilly R.C. Separate neural substrates for skill learning and performance in the ventral and dorsal striatum. Nat Neurosci 2007, 10:126-131.
34. Turner R.S., Desmurget M. Basal ganglia contributions to motor control: a vigorous tutor. Curr Opin Neurobiol 2010, 20:704-716.
35. Ölveczky B.P., Otchy T.M., Goldberg J.H., Aronov D., Fee M.S. Changes in the neural control of a complex motor sequence during learning. J Neurophysiol 2011, 106:386-397.
36. Yin H.H., Ostlund S.B., Knowlton B.J., Balleine B.W. The role of the dorsomedial striatum in instrumental conditioning. Eur J Neurosci 2005, 22:513-523.
37. Yin H.H., Knowlton B.J., Balleine B.W. Inactivation of dorsolateral striatum enhances sensitivity to changes in the action-outcome contingency in instrumental conditioning. Behav Brain Res 2006, 166:189-196.
38. Ellenbroek B., Schwarz M., Sontag K.H., Jaspers R., Cools A. Muscular rigidity and delineation of a dopamine-specific neostriatal subregion: tonic EMG activity in rats. Brain Res 1985, 345:132-140.
39. Hauber W., Neuscheler P., Nagel J., Müller C.E. Catalepsy induced by a blockade of dopamine D1 or D2 receptors was reversed by a concomitant blockade of adenosine A(2A) receptors in the caudate-putamen of rats. Eur J Neurosci 2001, 14:1287-1293.
40. Salamone J.D., Kurth P.A., McCullough L.D., Sokolowski J.D., Cousins M.S. The role of brain dopamine in response initiation: effects of haloperidol and regionally specific dopamine depletions on the local rate of instrumental responding. Brain Res 1993, 628:218-226.
41. Yoshida Y., Ono T., Kawano K., Miyagishi T. Distinct sites of dopaminergic and glutamatergic regulation of haloperidol-induced catalepsy within the rat caudate-putamen. Brain Res 1994, 639:139-148.
42. Packard M.G., Cahill L., McGaugh J.L. Amygdala modulation of hippocampal-dependent and caudate nucleus-dependent memory processes. Proc Natl Acad Sci U S A 1994, 91:8477-8481.
43. Franco V., Turner R.S. Testing the contributions of striatal dopamine loss to the genesis of parkinsonian signs. Neurobiol Dis 2012, 47:114-125.
44. Nakamura K., Hikosaka O. Role of dopamine in the primate caudate nucleus in reward modulation of saccades. J Neurosci 2006, 26:5360-5369.
45. Kish S.J., Shannak K., Hornykiewicz O. Uneven pattern of dopamine loss in the striatum of patients with idiopathic Parkinson's disease. Pathophysiologic and clinical implications. N Engl J Med 1988, 318:876-880.
46. Gage G.J., Stoetzner C.R., Wiltschko A.B., Berke J.D. Selective activation of striatal fast-spiking interneurons during choice execution. Neuron 2010, 67:466-479.
47. Leventhal D.K., Gage G.J., Schmidt R., Pettibone J.R., Case A.C., Berke J.D. Basal Ganglia Beta oscillations accompany cue utilization. Neuron 2012, 73:523-536.
48. Beninger R.J., Ranaldi R. Microinjections of flupenthixol into the caudate-putamen but not the nucleus accumbens, amygdala or frontal cortex of rats produce intra-session declines in food-rewarded operant responding. Behav Brain Res 1993, 55:203-212.
49. Bari A.A., Pierce R.C. D1-like and D2 dopamine receptor antagonists administered into the shell subregion of the rat nucleus accumbens decrease cocaine, but not food, reinforcement. Neuroscience 2005, 135:959-968.
50. Hauber W., Münkle M. Motor depressant effects mediated by dopamine D2 and adenosine A2A receptors in the nucleus accumbens and the caudate-putamen. Eur J Pharmacol 1997, 323:127-131.
51. Blandini F., Levandis G., Bazzini E., Nappi G., Armentero M.T. Time-course of nigrostriatal damage, basal ganglia metabolic changes and behavioural alterations following intrastriatal injection of 6-hydroxydopamine in the rat: new clues from an old model. Eur J Neurosci 2007, 25:397-405.
52. Noorani I., Carpenter R.H. Full reaction time distributions reveal the complexity of neural decision-making. Eur J Neurosci 2011, 33:1948-1951.
53. Ratcliff Group reaction time distributions and an analysis of distribution statistics. Psychol Bull 1979, 86:446-461.
54. Carpenter R.H., Williams M.L. Neural computation of log likelihood in control of saccadic eye movements. Nature 1995, 377:59-62.
55. Reddi B.A., Asrress K.N., Carpenter R.H. Accuracy, information, and response time in a saccadic decision task. J Neurophysiol 2003, 90:3538-3546.
56. Edgington E.S. Randomization tests 1995, Marcel Dekker, Inc.
57. Ratcliff R., McKoon G. The diffusion decision model: theory and data for two-choice decision tasks. Neural Comput 2008, 20:873-922.
58. Cisek P., Puskas G.A., El-Murr S. Decisions in changing conditions: the urgency-gating model. J Neurosci 2009, 29:11560-11571.
59. Lauwereyns J., Wisnewski R.G. A reaction-time paradigm to measure reward-oriented bias in rats. J Exp Psychol Anim Behav Process 2006, 32:467-473.
60. Redgrave P., Prescott T.J., Gurney K. The basal ganglia: a vertebrate solution to the selection problem?. Neuroscience 1999, 89:1009-1023.
61. Hikosaka O., Nakamura K., Nakahara H. Basal ganglia orient eyes to reward. J Neurophysiol 2006, 95:567-584.
62. Grillner S., Robertson B., Stephenson-Jones M. The evolutionary origin of the vertebrate basal ganglia and its role in action-selection. J Physiol 2013, 591:5425-5431.
63. Carli M., Evenden J.L., Robbins T.W. Depletion of unilateral striatal dopamine impairs initiation of contralateral actions and not sensory attention. Nature 1985, 313:679-682.
64. Brown V.J., Robbins T.W. Deficits in response space following unilateral striatal dopamine depletion in the rat. J Neurosci 1989, 9:983-989.
65. Boussaoud D., Joseph J.P. Role of the cat substantia nigra pars reticulata in eye and head movements. II. Effects of local pharmacological injections. Exp Brain Res 1985, 57:297-304.
66. Hikosaka O., Wurtz R.H. Modification of saccadic eye movements by GABA-related substances. II. Effects of muscimol in monkey substantia nigra pars reticulata. J Neurophysiol 1985, 53:292-308.
67. Dybdal D., Forcelli P.A., Dubach M., Oppedisano M., Holmes A., Malkova L., et al. Topography of dyskinesias and torticollis evoked by inhibition of substantia nigra pars reticulata. Mov Disord 2013, 28:460-468.
68. Felsen G., Mainen Z.F. Neural substrates of sensory-guided locomotor decisions in the rat superior colliculus. Neuron 2008, 60:137-148.
69. Gandhi N.J., Katnani H.A. Motor functions of the superior colliculus. Annu Rev Neurosci 2011, 34:205-231.
70. Gurney K., Prescott T.J., Redgrave P. A computational model of action selection in the basal ganglia. I. A new functional anatomy. Biol Cybern 2001, 84:401-410.
71. Leblois A., Boraud T., Meissner W., Bergman H., Hansel D. Competition between feedback loops underlies normal and pathological dynamics in the basal ganglia. J Neurosci 2006, 26:3567-3583.
72. Ponzi A., Wickens J. Sequentially switching cell assemblies in random inhibitory networks of spiking neurons in the striatum. J Neurosci 2010, 30:5894-5911.
73. Redgrave P., Marrow L., Dean P. Topographical organization of the nigrotectal projection in rat: evidence for segregated channels. Neuroscience 1992, 50:571-595.
74. Jiang H., Stein B.E., McHaffie J.G. Opposing basal ganglia processes shape midbrain visuomotor activity bilaterally. Nature 2003, 423:982-986.
75. Castle M., Aymerich M.S., Sanchez-Escobar C., Gonzalo N., Obeso J.A., Lanciego J.L. Thalamic innervation of the direct and indirect basal ganglia pathways in the rat: Ipsi- and contralateral projections. J Comp Neurol 2005, 483:143-153.
76. Novak P., Klemp J.A., Ridings L.W., Lyons K.E., Pahwa R., Nazzaro J.M. Effect of deep brain stimulation of the subthalamic nucleus upon the contralateral subthalamic nucleus in Parkinson disease. Neurosci Lett 2009, 463:12-16.
77. Brun Y., Karachi C., Fernandez-Vidal S., Jodoin N., Grabli D., Bardinet E., et al. Does unilateral basal ganglia activity functionally influence the contralateral side? What we can learn from STN stimulation in patients with Parkinson's disease. J Neurophysiol 2012, 108:1575-1583.
78. Brown V.J., Bowman E.M., Robbins T.W. Response-related deficits following unilateral lesions of the medial agranular cortex of the rat. Behav Neurosci 1991, 105:567-578.
79. Shepherd G.M. Corticostriatal connectivity and its role in disease. Nat Rev Neurosci 2013, 14:278-291.
80. Heuer A., Smith G.A., Dunnett S.B. Comparison of 6-hydroxydopamine lesions of the substantia nigra and the medial forebrain bundle on a lateralised choice reaction time task in mice. Eur J Neurosci 2013, 37:294-302.
81. Gallagher C.L., Johnson S.C., Bendlin B.B., Chung M.K., Holden J.E., Oakes T.R., et al. A longitudinal study of motor performance and striatal [18F]fluorodopa uptake in Parkinson's disease. Brain Imaging Behav 2011, 5:203-211.
82. Müller T., Benz S., Przuntek H. Choice reaction time after levodopa challenge in parkinsonian patients. J Neurol Sci 2000, 181:98-103.
83. Jankovic J., Ben-Arie L., Schwartz K., Chen K., Khan M., Lai E.C., et al. Movement and reaction times and fine coordination tasks following pallidotomy. Mov Disord 1999, 14:57-62.
84. Pessiglione M., Czernecki V., Pillon B., Dubois B., Schüpbach M., Agid Y., et al. An effect of dopamine depletion on decision-making: the temporal coupling of deliberation and execution. J Cogn Neurosci 2005, 17:1886-1896.
85. Bogacz R., Brown E., Moehlis J., Holmes P., Cohen J.D. The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychol Rev 2006, 113:700-765.
86. Schmidt R., Leventhal D.K., Mallet N., Chen F., Berke J.D. Canceling actions involves a race between basal ganglia pathways. Nat Neurosci 2013, 16:1118-1124.
87. Lo C.C., Wang X.J. Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks. Nat Neurosci 2006, 9:956-963.
88. Haggard P. Human volition: towards a neuroscience of will. Nat Rev Neurosci 2008, 9:934-946.
89. Watanabe M., Munoz D.P. Saccade reaction times are influenced by caudate microstimulation following and prior to visual stimulus appearance. J Cogn Neurosci 2011, 23:1794-1807.
90. Michell A.W., Xu Z., Fritz D., Lewis S.J., Foltynie T., Williams-Gray C.H., et al. Saccadic latency distributions in Parkinson's disease and the effects of l-dopa. Exp Brain Res 2006, 174:7-18.
91. Hanes D.P., Schall J.D. Neural control of voluntary movement initiation. Science 1996, 274:427-430.
92. Jantz J.J., Watanabe M., Everling S., Munoz D.P. Threshold mechanism for saccade initiation in frontal eye field and superior colliculus. J Neurophysiol 2013, 109:2767-2780.
93. Nakahara H., Nakamura K., Hikosaka O. Extended LATER model can account for trial-by-trial variability of both pre- and post-processes. Neural Netw 2006, 19:1027-1046.
94. Bogacz R., Larsen T. Integration of reinforcement learning and optimal decision-making theories of the basal ganglia. Neural Comput 2011, 23:817-851.
95. Wiecki T.V., Frank M.J. A computational model of inhibitory control in frontal cortex and basal ganglia. Psychol Rev 2013, 120:329-355.
96. Kreitzer A.C. Physiology and pharmacology of striatal neurons. Annu Rev Neurosci 2009, 32:127-147.
97. Ericsson J., Stephenson-Jones M., Pérez-Fernández J., Robertson B., Silberberg G., Grillner S. Dopamine differentially modulates the excitability of striatal neurons of the direct and indirect pathways in lamprey. J Neurosci 2013, 33:8045-8054.
98. Reynolds J.N., Hyland B.I., Wickens J.R. A cellular mechanism of reward-related learning. Nature 2001, 413:67-70.
99. Steinberg E.E., Keiflin R., Boivin J.R., Witten I.B., Deisseroth K., Janak P.H. A causal link between prediction errors, dopamine neurons and learning. Nat Neurosci 2013, 16:966-973.
100. Dreyer J.K., Herrik K.F., Berg R.W., Hounsgaard J.D. Influence of phasic and tonic dopamine release on receptor activation. J Neurosci 2010, 30:14273-14283.
101. Beaulieu J.M., Gainetdinov R.R. The physiology, signaling, and pharmacology of dopamine receptors. Pharmacol Rev 2011, 63:182-217.
102. Amalric M., Koob G.F. Depletion of dopamine in the caudate nucleus but not in nucleus accumbens impairs reaction-time performance in rats. J Neurosci 1987, 7:2129-2134.
103. Nishizawa K., Fukabori R., Okada K., Kai N., Uchigashima M., Watanabe M., et al. Striatal indirect pathway contributes to selection accuracy of learned motor actions. J Neurosci 2012, 32:13421-13432.
104. Fahn S., Oakes D., Shoulson I., Kieburtz K., Rudolph A., Lang A., et al. Levodopa and the progression of Parkinson's disease. N Engl J Med 2004, 351:2498-2508.
105. Iravani M.M., McCreary A.C., Jenner P. Striatal plasticity in Parkinson's disease and l-dopa induced dyskinesia. Parkinsonism Relat Disord 2012, 18(Suppl. 1):S123-S125.
106. Bódi N., Kéri S., Nagy H., Moustafa A., Myers C.E., Daw N., et al. Reward-learning and the novelty-seeking personality: a between- and within-subjects study of the effects of dopamine agonists on young Parkinson's patients. Brain 2009, 132:2385-2395.
107. Paxinos G., Watson C. The rat brain in stereotaxic coordinates 2005, Elsevier Academic Press, Amsterdam.