Dose dependent dopaminergic modulation of reward-based learning in Parkinson's disease

Neuropsychologia

Volumn 50, Issue 5, 2012, Pages 583-591

  van Wouwe, N C ^a,b,c   Ridderinkhof, K R ^d   Band, G P H ^b   van den Wildenberg, W P M ^d   Wylie, S A ^c  

^a TNO   (Netherlands)

^b LEIDEN UNIVERSITY   (Netherlands)

^c UNIVERSITY OF VIRGINIA HEALTH SYSTEM   (United States)

^d UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Caudate; Dopaminergic medication; Parkinson's disease; Probabilistic learning; Putamen

Indexed keywords

DOPAMINE; DOPAMINE 2 RECEPTOR STIMULATING AGENT; LEVODOPA;

AGED; ARTICLE; CAUDATE NUCLEUS; CLINICAL ARTICLE; CONTROLLED STUDY; CORPUS STRIATUM; DECISION MAKING; DISEASE DURATION; DISEASE SEVERITY; DOPAMINERGIC SYSTEM; DOSE RESPONSE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; LEARNING; MALE; MATHEMATICAL MODEL; MINI MENTAL STATE EXAMINATION; MOTOR PERFORMANCE; NEUROMODULATION; PARKINSON DISEASE; PUTAMEN; REINFORCEMENT; REWARD; SCORING SYSTEM; STIMULUS RESPONSE; TASK PERFORMANCE;

AGED; ANALYSIS OF VARIANCE; COMPUTER SIMULATION; CORPUS STRIATUM; DECISION MAKING; DOPAMINE; DOPAMINE AGENTS; DOSE-RESPONSE RELATIONSHIP, DRUG; FEMALE; HUMANS; LEVODOPA; MALE; MIDDLE AGED; MODELS, PSYCHOLOGICAL; PARKINSON DISEASE; PHOTIC STIMULATION; PROBABILITY LEARNING; PSYCHIATRIC STATUS RATING SCALES; PSYCHOMOTOR PERFORMANCE; QUESTIONNAIRES; REWARD;

EID: 84858452061     PISSN: 00283932     EISSN: 18733514     Source Type: Journal    
DOI: 10.1016/j.neuropsychologia.2011.12.012     Document Type: Article

References (62)

1. Alexander G.E., DeLong M.R., Strick P.L. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annual Review of Neuroscience 1986, 9:357-381.
2. Alexander G.E., Crutcher M.F., DeLong M.R. Basal ganglia-thalamocortical circuits: Parallel substrates for motor, oculomotor, 'prefrontal' and 'limbic' functions. Progress in Brain Research 1990, 85:119-147.
3. Arnsten A.F.T. Catecholamine modulation of prefrontal cortical cognitive function. Trends in Cognitive Sciences 1998, 2(11):436-447.
4. Balleine B.W., Delgado M.R., Hikosaka O. The role of the dorsal striatum in reward and decision-making. Journal of Neuroscience 2007, 27:8161-8165.
5. Bertsekas D.P., Tsitsiklis J.N. Neuro-dynamic programming 1996, Athena Scientific, Belmont, MA.
6. Bjorklund A., Dunnett S.B. Dopamine neuron systems in the brain: An update. Trends in Neurosciences 2007, 30(5):194-202.
7. Bódi N., Kéri S., Nagi H., Moustafa A., Myers C.E., Daw N., et al. Reward-learning and the novelty-seeking personality: A between- and within-subjects study of the effects of dopamine agonists on young Parkinson's patients. Brain 2009, 132(9):2385-2395.
8. Brown P., Marsden C.D. What do the basal ganglia do?. Lancet 1998, 351(9118):1801.
9. Cools R. Dopaminergic modulation of cognitive function-implications for L-DOPA treatment in Parkinson's disease. Neuroscience and Biobehavioral Reviews 2006, 30:1-23.
10. Cools R., Barker R.A., Sahakian B.J., Robbins T.W. Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. Cerebral Cortex 2001, 11(12):1136-1143.
11. Cools R., Frank M.J., Gibbs S.E., Miyakawa A., Jagust W., D'Esposito M. Striatal dopamine predicts outcome-specific reversal learning and its sensitivity to dopaminergic drug administration. Journal of Neuroscience 2009, 29(5):1538-1543.
12. Cooper J.A., Sagar H.J., Doherty S.M., Jordan N., Ridswell P., Sullivan E.V. Different effects of dopaminergic and anticholineric therapies on cognitive and motor function in Parkinson's disease. Brain 1992, 115(6):1701-1725.
13. Crevoisier C., Monreal A., Metzger B., Nilsen T. Comparative single- and multiple-dose pharmacokinetics of levodopa and 3-O-methyldopa following a new dual-release and a conventional slow-release formulation of levodopa and benserazide in healthy volunteers. European Neurology 2003, 49(1):39-44.
14. Czernecki V., Pillon B., Houeto J., Pochon J., Levy R., Dubois B. Motivation, reward, and Parkinson's disease: Influence of dopatherapy. Neuropsychologia 2002, 40(13):2257-2267.
15. Dayan P., Kakade S., Montague P. Learning and selective attention. Nature Neuroscience 2000, 3:S1218-S1223.
16. Daw N.D., Niv Y., Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience 2005, 8(12):1704-1711.
17. Eyny Y., Horvitz J. Opposing roles of D1 and D2 receptors in appetitive conditioning. Journal of Neuroscience 2003, 23(5):1584-1587.
18. Faure A., Haberland U., Condé F., El Massioui N. Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation. Journal of Neuroscience 2005, 25:2771-2780.
19. Folstein M., Folstein S., McHugh P. "Mini-mental state" A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research 1975, 12(3):189-198.
20. Frank M.J. Dynamic dopamine modulation in the basal ganglia: A neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. Journal of Cognitive Neuroscience 2005, 17(1):51-72.
21. Frank M.J., Seeberger L.C., O'Reilly R.C. By carrot or by stick: Cognitive reinforcement learning in Parkinsonism. Science 2004, 306:1940-1943.
22. Gasser U.E., Jorga K., Crevoisier C., Hovens S.E.L., van Giersbergen P.L.M. COMT inhibition by tolcapone further improves levodopa pharmacokinetics when combined with a dual-release formulation of levodopa benserazide - A novel principle in the treatment of Parkinson's disease. European Neurology 1999, 41(4):206-211.
23. Gerardin E., Lehericy S., Pochon J.B., Tezenas du Montcel S., Mangin J.F., Poupon F., et al. Foot, hand, face and eye representation in the human striatum. Cerebral Cortex 2003, 13:162-169.
24. Goldman-Rakic P.S., Muly E.C., Williams G.V. D1 receptors in prefrontal cells and circuits. Brain Research Review 2000, 31:295-301.
25. Gotham A., Brown R., Marsden C. 'Frontal' cognitive function in patients with Parkinson's disease 'on' and 'off' levodopa. Brain 1988, 111(2):299-321.
26. Graef S.G.S., Biele G., Krugel L.K., Marzinzik F., Wahl M., Wotka J., et al. Differential influence of levodopa on reward-based learning in Parkinson's disease. Frontiers in Human Neuroscience 2010, 4:169.
27. Haruno M., Kawato M. Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action reward association learning. Journal of Neurophysiology 2006, 95(2):948-959.
28. Haruno M., Kawato M. Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning. Neural Networks 2006, 19(8):1242-1254.
29. Hornykiewicz O. Mechanisms of action of L-DOPA in Parkinson's disease. Life Sciences 1974, 15(7):1249-1259.
30. Kaasinen V., Rinne J.O. Functional imaging studies of dopamine system and cognition in normal aging and Parkinson's disease. Neuroscience and Biobehavioral Reviews 2002, 26(7):785-793.
31. Kimura M. Role of basal ganglia in behavioral learning. Neuroscience Research 1995, 22:353-358.
32. Kish S.J., Shannak K., Hornykiewicz O. Uneven pattern of dopamine loss in the striatum of patients with idiopathic Parkinson's disease: Pathophysiologic and clinical implications. New England Journal of Medicine 1988, 318:876-880.
33. Knowlton B.J., Mangels J.A., Squire L.R. A neostriatal habit learning system in humans. Science 1996, 273:1399-1402.
34. Knutson B., Adams C., Fong G., Hommer D. Anticipation of increasing monetary reward selectively recruits nucleus accumbens. Journal of Neuroscience 2001, 21(16):1-5.
35. Koepp M.J., Gunn R.N., Lawrence A.D., Cunningham V.J., Dagher A., Jones T., et al. Evidence for striatal dopamine release during a video game. Nature 1998, 393:266-268.
36. Lezak M.D. Neuropsychological assessment 1995, Oxford University Press, New York. 3rd ed.
37. Maddox W., Ashby F. Dissociating explicit and procedural-learning based systems of perceptual category learning. Behavioral Processes 2004, 66(3):309-332.
38. McAuley J.H. The physiological basis of clinical deficits in Parkinson's disease. Progress in Neurobiology 2003, 69:27-48.
39. McClure S., Berns G., Montague P. Temporal prediction errors in a passive learning task activate human striatum. Neuron 2003, 38(2):339-346.
40. O'Doherty J., Dayan P., Schultz J., Deichmann R., Friston K., Dolan R.J. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 2004, 304(5669):452-454.
41. O'Reilly R., Frank M. Making working memory work: A computational model of learning in the prefrontal cortex and basal ganglia. Neural Computation 2006, 18(2):283-328.
42. Oyama K., Hernadi I., Iijima T., Tsutsui K-I. Reward prediction error coding in dorsal striatal neurons. Journal of Neuroscience 2010, 30:11447-11457.
43. Packard M., Knowlton B. Learning and memory functions of the Basal Ganglia. Annual Review of Neuroscience 2002, 25:563-593.
44. Pappata S., Dehaene S., Poline J.B., Gregoire M.C., Jobert A., Delforge J., et al. In vivo detection of striatal dopamine release during reward: A PET study with [11C] Raclopride and a single dynamic scan approach. NeuroImage 2002, 16:1015-1027.
45. Rowe J.B., Hughes L., Ghosh B.C.P., Eckstein D., Williams-Gray C.H., Fallon S., et al. Parkinson's disease and dopaminergic therapy and dopaminergic therapy - Differential effects on movement, reward, and cognition. Brain 2008, 131:2094-2105.
46. Rutledge R.B., Lazzaro S.C., et al. Dopaminergic drugs modulate learning rates and preservation in Parkinson's patients in a dynamic foraging task. Journal of Neurosci 2009, 29(48):15104-15114.
47. Schönberg T., Daw N.D., Joel D., O'Doherty J.P. Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. Journal of Neuroscience 2007, 27:12860-12867.
48. Schultz W. Getting formal with dopamine and reward. Neuron 2002, 36(2):241-263.
49. Schultz W., Tremblay L., Hollerman J.R. Changes in behavior-related neuronal activity in the striatum during learning. Trends in Neurosciences 2003, 26(6):321-328.
50. Seger C.A., Cincotta C.M. The roles of the caudate nucleus in human classification learning. Journal of Neuroscience 2005, 25(11):2941-2951.
51. Seymour B., Daw N., Dayan P., Singer T., Dolan R. Differential encoding of losses and gains in the human striatum. Journal of Neuroscience 2007, 27(18):4826-4831.
52. Shohamy D., Myers C.E., Grossman S., Sage J., Gluck M.A. The role of dopamine in cognitive sequence learning: Evidence from Parkinson's disease. Behavioural Brain Research 2005, 156(2):191-199.
53. Shohamy D., Myers C.E., Kalanithi J., Gluck M.A. Basal ganglia and dopamine contributions to probabilistic category learning. Neuroscience and Biobehavioral Reviews 2008, 32(2):219-236.
54. Sutton R.S., Barto A.G. Reinforcement learning: An introduction 1998, MIT Press, Cambridge, MA.
55. Swainson R., Rogers R.D., Sahakian B.J., Summers B.A., Polkey C.E., Robbins T.W. Probabilistic learning and reversal deficits in patients with Parkinson's disease or frontal or temporal lobe lesions: Possible adverse effects of dopaminergic medication. Neuropsychologia 2000, 38(5):596-612.
56. Tricomi E., Delgado M., Fiez J. Modulation of caudate activity by action contingency. Neuron 2004, 41(2):281-292.
57. Voon V., Pessiglione M., et al. Mechanisms underlying dopamine-mediated reward bias in compulsive behaviors. Neuron 2010, 65(1):135-142.
58. Weintraub D., Siderowf A.D., Potenza M.N., Goveas J., Morales K.H., Duda J.E., et al. Association of dopamine agonist use with impulse control disorders in Parkinson disease. Archives of Neurology 2006, 63(7):969-973.
59. Wylie S.A., van den Wildenberg W.P.M., Ridderinkhof K.R., Bashore T.R., Powell V.D., Manning C.A., et al. The effect of Parkinson's disease on interference control during action selection. Neuropsychologia 2009, 47(1):145-157.
60. Wylie S.A., van den Wildenberg W.P.M., Ridderinkhof K.R., Bashore T.R., Powell V.D., Manning C.A., et al. The effect of speed-accuracy strategy on response interference control in Parkinson's Disease. Neuropsychologia 2009, 47. pp. 1944-1853.
61. Yin H.H., Knowlton B.J., Balleine B.W. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. European Journal of Neuroscience 2004, 19:181-189.
62. Young P. Recursive estimation and time series 1984, Springer-Verlag, New York.