Effects of dopamine medication on sequence learning with stochastic feedback in Parkinson's disease

Frontiers in Systems Neuroscience

Volumn 4, Issue , 2010, Pages

  Seo, Moonsang ^a,b   Beigi, Mazda ^a   Jahanshahi, Marjan ^a   Averbeck, Bruno B ^a,b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

Author keywords

Dopamine; Parkinson's disease; Reinforcement learning; Sequence learning

Indexed keywords

DOPAMINE; LEVODOPA;

AGED; ARTICLE; BAYES THEOREM; CLINICAL ARTICLE; CONTROLLED STUDY; CORPUS STRIATUM; DOPAMINE BRAIN LEVEL; HUMAN; LEARNING; NEGATIVE FEEDBACK; PARKINSON DISEASE; POSITIVE FEEDBACK; REINFORCEMENT; SEQUENCE LEARNING; TASK PERFORMANCE;

EID: 79955061492     PISSN: 16625137     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnsys.2010.00036     Document Type: Article

References (67)

1. Alexander, G. E., and DeLong, M. R. (1985). Microstimulation of the primate neostriatum. I. Physiological properties of striatal microexcitable zones. J. Neurophysiol. 53, 1401-1416.
2. Alexander, G. E., DeLong, M. R., and Strick, P. L. (1986). Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu. Rev. Neurosci. 9, 357-381.
3. Arnsten, A. F., and Goldman-Rakic, P. S. (1998). Noise stress impairs prefrontal cortical cognitive function in monkeys: evidence for a hyperdopaminergic mechanism. Arch. Gen. Psychiatry 55, 362-368.
4. Averbeck, B. B., Kilner, J., and Frith, C. D. (2010). Neural correlates of sequence learning with stochastic feedback. J. Cogn. Neurosci. (Epub).
5. Badgaiyan, R. D., Fischman, A. J., and Alpert, N. M. (2008). Explicit motor memory activates the striatal dopamine system. Neuroreport 19, 409-412.
6. Badgaiyan, R. D., Fischman, A. J., and Alpert, N. M. (2007). Striatal dopamine release in sequential learning. Neuroimage 38, 549-556.
7. Beck, A. T., Erbaugh, J., Ward, C. H., Mock, J., and Mendelsohn, M. (1961). An inventory for measuring depression. Arch. Gen. Psychiatry 4, 561-571.
8. Bodi, N., Keri, S., Nagy, H., Moustafa, A., Myers, C. E., Daw, N., Dibo, G., Takats, A., Bereczki, D., and Gluck, M. A. (2009). Reward-learning and the novelty-seeking personality: a between- and within-subjects study of the effects of dopamine agonists on young Parkinsons patients. Brain 132, 2385-2395.
9. Boecker, H., Dagher, A., Ceballos- Baumann, A. O., Passingham, R. E., Samuel, M., Friston, K. J., Poline, J., Dettmers, C., Conrad, B., and Brooks, D. J. (1998). Role of the human rostral supplementary motor area and the basal ganglia in motor sequence control: investigations with H2 15O PET. J. Neurophysiol. 79, 1070-1080.
10. Brown, R. G., Jahanshahi, M., Limousin- Dowsey, P., Thomas, D., Quinn, N. P., and Rothwell, J. C. (2003). Pallidotomy and incidental sequence learning in Parkinson's disease. Neuroreport 14, 21-24.
11. Carbon, M., Ghilardi, M. F., Feigin, A., Fukuda, M., Silvestri, G., Mentis, M. J., Ghez, C., Moeller, J. R., and Eidelberg, D. (2003). Learning networks in health and Parkinson's disease: reproducibility and treatment effects. Hum. Brain Mapp. 19, 197-211.
12. Carbon, M., Ma, Y., Barnes, A., Dhawan, V., Chaly, T., Ghilardi, M. F., and Eidelberg, D. (2004). Caudate nucleus: influence of dopaminergic input on sequence learning and brain activation in Parkinsonism. Neuroimage 21, 1497-1507.
13. Cohen, N. J., and Squire, L. R. (1980). Preserved learning and retention of pattern-analyzing skill in amnesia: dissociation of knowing how and knowing that. Science 210, 207-210.
14. Cools, R. (2006). Dopaminergic modulation of cognitive function-implications for L-DOPA treatment in Parkinson's disease. Neurosci. Biobehav. Rev. 30, 1-23.
15. Cools, R., Altamirano, L., and D'Esposito, M. (2006). Reversal learning in Parkinson's disease depends on medication status and outcome valence. Neuropsychologia 44, 1663-1673.
16. Cools, R., Barker, R. A., Sahakian, B. J., and Robbins, T. W. (2001). Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. Cereb. Cortex 11, 1136-1143.
17. Cools, R., Lewis, S. J. G., Clark, L., Barker, R. A., and Robbins, T. W. (2007). L-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson's disease. Neuropsychopharmacology 32, 180-189.
18. DeLong, M. R., Georgopoulos, A. P., Crutcher, M. D., Mitchell, S. J., Richardson, R. T., and Alexander, G. E. (1984). Functional organization of the basal ganglia: contributions of single-cell recording studies. Ciba Found. Symp. 107, 64-82.
19. Deroost, N., Kerckhofs, E., Coene, M., Wijnants, G., and Soetens, E. (2006). Learning sequence movements in a homogenous sample of patients with Parkinson's disease. Neuropsychologia 44, 1653-1662.
20. Flaherty, A. W., and Graybiel, A. M. (1994). Input-output organization of the sensorimotor striatum in the squirrel monkey. J. Neurosci. 14, 599-610.
21. Folstein, M. F., Folstein, S. E., and McHugh, P. R. (1975). 'Mini-mental state'. A practical method for grading the cognitive state of patients for the clinician. J. Psychiatr. Res. 12, 189-198.
22. Frank, M. J., Seeberger, L. C., and O'reilly, R. C. (2004). By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306, 1940-1943.
23. Garris, P. A., Walker, Q. D., and Wightman, R. M. (1997). Dopamine release and uptake rates both decrease in the partially denervated striatum in proportion to the loss of dopamine terminals. Brain Res. 753, 225-234.
24. Ghilardi, M. F., Eidelberg, D., Silvestri, G., and Ghez, C. (2003). The differential effect of PD and normal aging on early explicit sequence learning. Neurology 60, 1313-1319.
25. Gotham, A. M., Brown, R. G., and Marsden, C. D. (1988). 'Frontal' cognitive function in patients with Parkinson's disease 'on' and 'off' levodopa. Brain 111(Pt 2), 299-321.
26. Graybiel, A. M., Aosaki, T., Flaherty, A. W., and Kimura, M. (1994). The basal ganglia and adaptive motor control. Science 265, 1826-1831.
27. Haber, S. N., Fudge, J. L., and McFarland, N. R. (2000). Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J. Neurosci. 20, 2369-2382.
28. Hoehn, M. M., and Yahr, M. D. (1967). Parkinsonism: onset, progression and mortality. Neurology 17, 427-442.
29. Hornykiewicz, O., and Kish, S. J. (1987). Biochemical pathophysiology of Parkinson's disease. Adv. Neurol. 45, 19-34.
30. Hughes, A. J., Daniel, S. E., Kilford, L., and Lees, A. J. (1992). Accuracy of clinicaldiagnosis of idiopathic parkinsonsdisease - a clinicopathological study of 100 cases. J. Neurol. Neurosurg. Psychiatr. 55, 181-184.
31. Jahanshahi, M., Wilkinson, L., Gahir, H., Dharminda, A., and Lagnado, D. A. (2009). Medication impairs probabilistic classification learning in Parkinson's disease. Neuropsychologia (Epub).
32. Jenkins, I. H., Brooks, D. J., Nixon, P. D., Frackowiak, R. S., and Passingham, R. E. (1994). Motor sequence learning: a study with positron emission tomography. J. Neurosci. 14, 3775-3790.
33. Jueptner, M., Frith, C. D., Brooks, D. J., Frackowiak, R. S., and Passingham, R. E. (1997). Anatomy of motor learning. II. Subcortical structures and learning by trial and error. J. Neurophysiol. 77, 1325-1337.
34. Kelly, S. W., Jahanshahi, M., and Dirnberger, G. (2004). Learning of ambiguous versus hybrid sequences by patients with Parkinson's disease. Neuropsychologia 42, 1350-1357.
35. Kish, S. J., Shannak, K., and Hornykiewicz, O. (1988). Uneven pattern of dopamine loss in the striatum of patients with idiopathic Parkinson's disease. Pathophysiologic and clinical implications. N. Engl. J. Med. 318, 876-880.
36. Kitano, H., Tanibuchi, I., and Jinnai, K. (1998). The distribution of neurons in the substantia nigra pars reticulata with input from the motor, premotor and prefrontal areas of the cerebral cortex in monkeys. Brain Res. 784, 228-238.
37. Kwak, Y., Muller, M. L., Bohnen, N. I., Dayalu, P., and Seidler, R. D. (2010). Effect of dopaminergic medications on the time course of explicit motor sequence learning in Parkinson's disease. J. Neurophysiol. 103, 942-949.
38. Lehericy, S., Benali, H., Van de Moortele, P. F., Pelegrini-Issac, M., Waechter, T., Ugurbil, K., and Doyon, J. (2005). Distinct basal ganglia territories are engaged in early and advanced motor sequence learning. Proc. Natl. Acad. Sci. U.S.A. 102, 12566-12571.
39. Marsden, C. D. (1982). The mysterious motor function of the basal ganglia - the Robert Wartenberg lecture. Neurology 32, 514-539.
40. Nagy, H., Keri, S., Myers, C. E., Benedek, G., Shohamy, D., and Gluck, M. A. (2007). Cognitive sequence learning in Parkinson's disease and amnestic mild cognitive impairment: Dissociation between sequential and non- sequential learning of associations. Neuropsychologia 45, 1386-1392.
41. Nakamura, T., Ghilardi, M. F., Mentis, M., Dhawan, V., Fukuda, M., Hacking, A., Moeller, J. R., Ghez, C., and Eidelberg, D. (2001). Functional networks in motor sequence learning: abnormal topographies in Parkinson's disease. Hum. Brain Mapp. 12, 42-60.
42. Nissen, M. J., and Bullemer, P. (1987). Attentional requirements of learning - evidence from performance-measures. Cogn. Psychol. 19, 1-32.
43. Pandya, D. N., Van Hoesen, G. W., and Mesulam, M. M. (1981). Efferent connections of the cingulate gyrus in the rhesus monkey. Exp. Brain Res. 42, 319-330.
44. Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., and Frith, C. D. (2006). Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442, 1042-1045.
45. Rutledge, R. B., Lazzaro, S. C., Lau, B., Myers, C. E., Gluck, M. A., and Glimcher, P. W. (2009). Dopaminergic drugs modulate learning rates and perseveration in parkinson's patients in a dynamic foraging task. J. Neurosci. 29, 15104-15114.
46. Saint-Cyr, J. A., Ungerleider, L. G., and Desimone, R. (1990). Organization of visual cortical inputs to the striatum and subsequent outputs to the pallido-nigral complex in the monkey. J. Comp. Neurol. 298, 129-156.
47. Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593-1599.
48. Schultz, W., and Dickinson, A. (2000). Neuronal coding of prediction errors. Annu. Rev. Neurosci. 23, 473-500.
49. Seidler, R. D., Purushotham, A., Kim, S. G., Ugurbil, K., Willingham, D., and Ashe, J. (2005). Neural correlates of encoding and expression in implicit sequence learning. Exp. Brain Res. 165, 114-124.
50. Seidler, R. D., Tuite, P., and Ashe, J. (2007). Selective impairments in implicit learning in Parkinson's disease. Brain Res. 1137, 104-110.
51. Shin, J. C., and Ivry, R. B. (2003). Spatial and temporal sequence learning in patients with Parkinson's disease or cerebellar lesions. J. Cogn. Neurosci. 15, 1232-1243.
52. Shohamy, D., Myers, C. E., Grossman, S., Sage, J., and Gluck, M. A. (2005). The role of dopamine in cognitive sequence learning: evidence from Parkinson's disease. Behav. Brain Res. 156, 191-199.
53. Smith, J., Siegert, R. J., McDowall, J., and Abernethy, D. (2001). Preserved implicit learning on both the serial reaction time task and artificial grammar in patients with Parkinson's disease. Brain Cogn. 45, 378-391.
54. Smith, J. G., and McDowall, J. (2004). Impaired higher order implicit sequence learning on the verbal version of the serial reaction time task in patients with Parkinson's disease. Neuropsychology 18, 679-691.
55. Squire, L. R. (2009). Memory and brain systems: 1969-2009.J. Neurosci. 29, 12711-12716.
56. Sutton, R. S., and Barto, A. G. (1998). Reinforcement learning an introduction (Cambridge, Mass: MIT Press).
57. Swainson, R., Rogers, R. D., Sahakian, B. J., Summers, B. A., Polkey, C. E., and Robbins, T. W. (2000). Probabilistic learning and reversal deficits in patients with Parkinson's disease or frontal or temporal lobe lesions: possible adverse effects of dopaminergic medication. Neuropsychologia 38, 596-612.
58. Van Hoesen, G. W., Yeterian, E. H., and Lavizzo-Mourey, R. (1981). Widespread corticostriate projections from temporal cortex of the rhesus monkey. J. Comp. Neurol. 199, 205-219.
59. Vijayraghavan, S., Wang, M., Birnbaum, S. G., Williams, G. V., and Arnsten, A. F. (2007). Inverted-U dopamine D1 receptor actions on prefrontal neurons engaged in working memory. Nat. Neurosci. 10, 376-384.
60. Voon, V., Pessiglione, M., Brezing, C., Gallea, C., Fernandez, H. H., Dolan, R. J., and Hallett, M. (2010). Mechanisms underlying dopamine-mediated reward bias in compulsive behaviors. Neuron 65, 135-142.
61. Wachter, T., Lungu, O. V., Liu, T., Willingham, D. T., and Ashe, J. (2009). Differential effect of reward and punishment on procedural learning. J. Neurosci. 29, 436-443.
62. ®) New York The Psychological Corporation.
63. Werheid, K., Ziessler, M., Nattkemper, D., and Yves von, C. D. (2003). Sequence learning in Parkinson's disease: the effect of spatial stimulus-response compatibility. Brain Cogn. 52, 239-249.
64. Wilkinson, L., and Jahanshahi, M. (2007). The striatum and probabilistic implicit sequence learning. Brain Res. 1137, 117-130.
65. Wilkinson, L., Khan, Z., and Jahanshahi, M. (2009). The role of the basal ganglia and its cortical connections in sequence learning: evidence from implicit and explicit sequence learning in Parkinson's disease. Neuropsychologia 47, 2564-2573.
66. Wilkinson, L., Lagnado, D. A., Quallo, M., and Jahanshahi, M. (2008). The effect of feedback on non-motor probabilistic classification learning in Parkinson's disease. Neuropsychologia 46, 2683-2695.
67. Wilkinson, L., Teo, J. T., Obeso, I., Rothwell, J. C., and Jahanshahi, M. (2010). Contributions of primary motor cortex and supplementary motor area are essential for probabilistic implicit sequence learning: evidence from theta burst magnetic stimulation. J. Cogn. Neurosci. 22, 427-436.