Probabilistic reversal learning is impaired in Parkinson's disease

Neuroscience

Volumn 163, Issue 4, 2009, Pages 1092-1101

  Peterson, D A ^a   Elliott, C ^a   Song, D D ^b   Makeig, S ^a   Sejnowski, T J ^a,c   Poizner, H ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

Author keywords

Basal ganglia; Computational modeling; Dopamine; Reinforcement learning

Indexed keywords

ADAPTATION; ADULT; AGED; ARTICLE; CLINICAL ARTICLE; CONTROLLED STUDY; DECISION MAKING; DOPAMINERGIC SYSTEM; FEMALE; HUMAN; LEARNING; MALE; PARKINSON DISEASE; PRIORITY JOURNAL; PROBABILISTIC REVERSAL LEARNING; REINFORCEMENT; REWARD; TASK PERFORMANCE; ADAPTIVE BEHAVIOR; ALGORITHM; COMPUTER SIMULATION; LEARNING DISORDER; MIDDLE AGED; NEUROPSYCHOLOGICAL TEST; PSYCHOLOGICAL MODEL;

ADAPTATION, PSYCHOLOGICAL; AGED; AGED, 80 AND OVER; ALGORITHMS; COMPUTER SIMULATION; FEEDBACK, PSYCHOLOGICAL; FEMALE; HUMANS; LEARNING DISORDERS; MALE; MIDDLE AGED; MODELS, PSYCHOLOGICAL; NEUROPSYCHOLOGICAL TESTS; PARKINSON DISEASE; PROBABILITY LEARNING; REVERSAL LEARNING; REWARD;

EID: 76249121817     PISSN: 03064522     EISSN: 18737544     Source Type: Journal    
DOI: 10.1016/j.neuroscience.2009.07.033     Document Type: Article

References (39)

1. Abler B, Walter H, Erk S, Kammerer H, Spitzer M (2006) Prediction error as a linear function of reward probability is coded in human nucleus accumbens. Neuroimage 31:790-795.
2. Assadi SM, Yucel M, Pantelis C (2009) Dopamine modulates neural networks involved in effort-based decision-making. Neurosci Biobehav Rev 33:383-393.
3. Behrens TE, Woolrich MW, Walton ME, Rushworth MF (2007) Learning the value of information in an uncertain world. Nat Neurosci 10:1214-1221.
4. Berns GS, Sejnowski TJ (1998) A computational model of how the basal ganglia produce sequences. J Cogn Neurosci 10:108-121.
5. Borek LL, Amick MM, Friedman JH (2006) Non-motor aspects of Parkinson's disease. CNS Spectr 11:541-554.
6. Brown JW, Braver TS (2008) A computational model of risk, conflict, and individual difference effects in the anterior cingulate cortex. Brain Res 1202:99-108.
7. Cohen MX (2007) Individual differences and the neural representations of reward expectation and reward prediction error. Soc Cogn Affect Neurosci 2:20-30.
8. Cohen MX, Ranganath C (2005) Behavioral and neural predictors of upcoming decisions. Cogn Affect Behav Neurosci 5:117-126.
9. Cools R, Altamirano L, D'Esposito M (2006) Reversal learning in Parkinson's disease depends on medication status and outcome valence. Neuropsychologia 44:1663-1673.
10. Cools R, Clark L, Owen AM, Robbins TW (2002) Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging. J Neurosci 22:4563-4567.
11. Cools R, Lewis SJ, Clark L, Barker RA, Robbins TW (2007) L-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson's disease. Neuropsychopharmacology 32:180-189.
12. Dauer W, Przedborski S (2003) Parkinson's disease: mechanisms and models. Neuron 39:889-909.
13. Daw ND, Doya K (2006) The computational neurobiology of learning and reward. Curr Opin Neurobiol 16:199-204.
14. Defer GL, Widner H, Marie RM, Remy P, Levivier M (1999) Core assessment program for surgical interventional therapies in Parkinson's disease (CAPSIT-PD). Mov Disord 14:572-584.
15. Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299: 1898-1902.
16. Folstein MF, Folstein SE, Mchugh PR (1975) Mini-Mental State-practical method for grading cognitive state of patients for clinician. J Psychiatr Res 12:189-198.
17. Frank MJ, Seeberger LC, O'Reilly RC (2004) By carrot or by stick: cognitive reinforcement learning in Parkinsonism. Science 306: 1940-1943.
18. Goetz CG, Stebbins GT, Chmura TA, Fahn S, Klawans HL, Marsden CD (1995) Teaching tape for the motor section of the Unified Parkinson's Disease Rating Scale. Mov Disord 10:263-266, tape.
19. Grace AA (1991) Phasic versus tonic dopamine release and the modulation of dopamine system responsivity-a hypothesis for the etiology of schizophrenia. Neuroscience 41:1-24.
20. Hoehn M, Yahr M (1967) Parkinsonism: onset, progression, and mortality. Neurology 17:427-442.
21. Horvitz JC, Choi WY, Morvan C, Eyny Y, Balsam PD (2007) A "good parent" function of dopamine: transient modulation of learning and performance during early stages of training. Ann N Y Acad Sci 1104:270-288.
22. Kish SJ, Shannak K, Hornykiewicz O (1988) Uneven pattern of dopamine loss in the striatum of patients with idiopathic Parkinson's disease-pathophysiologic and clinical implications. N Engl J Med 318:876-880.
23. Krebs HI, Hogan N, Hening W, Adamovich SV, Poizner H (2001) Procedural motor learning in Parkinson's disease. Exp Brain Res 141:425-437.
24. Kunig G, Leenders KL, Martin-Solch C, Missimer J, Magyar S, Schultz W (2000) Reduced reward processing in the brains of parkinsonian patients. Neuroreport 11:3681-3687.
25. Lilliefors HW (1967) On Kolmogorov-Smirnov test for normality with mean and variance unknown. J Am Stat Assoc 62:399-402.
26. Martin-Soelch C, Leenders KL, Chevalley AF, Missimer J, Kunig G, Magyar S, Mino A, Schultz W (2001) Reward mechanisms in the brain and their role in dependence: evidence from neurophysiological and neuroimaging studies. Brain Res Brain Res Rev 36:139-149.
27. Messier J, Adamovich S, Jack D, Hening W, Sage J, Poizner H (2007) Visuomotor learning in immersive 3D virtual reality in Parkinson's disease and in aging. Exp Brain Res 179:457-474.
28. Montague PR, Dayan P, Sejnowski TJ (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936-1947.
29. Morris G, Nevet A, Arkadir D, Vaadia E, Bergman H (2006) Midbrain dopamine neurons encode decisions for future action. Nat Neurosci 9:1057-1063.
30. Oldfield RC (1971) Assessment and analysis of handedness-Edinburgh Inventory. Neuropsychologia 9:97-113.
31. Rangel A, Camerer C, Montague PR (2008) A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9:545-556.
32. Robbins H (1952) Some aspects of the sequential design of experiments. Bull Amer Math. Soc 58:527-535.
33. Schultz W (2007) Multiple dopamine functions at different time courses. Annu Rev Neurosci 30:259-288.
34. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599.
35. Shohamy D, Myers CE, Kalanithi J, Gluck MA (2008) Basal ganglia and dopamine contributions to probabilistic category learning. Neurosci Biobehav Rev 32:219-236.
36. Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. Cambridge, MA: MIT Press.
37. Swainson R, Rogers RD, Sahakian BJ, Summers BA, Polkey CE, Robbins TW (2000) Probabilistic learning and reversal deficits in patients with Parkinson's disease or frontal or temporal lobe lesions: possible adverse effects of dopaminergic medication. Neuropsychologia 38:596-612.
38. Wilkinson L, Jahanshahi M (2007) The striatum and probabilistic implicit sequence learning. Brain Res 1137:117-130.
39. Wilkinson L, Lagnado DA, Quallo M, Jahanshahi M (2008) The effect of feedback on non-motor probabilistic classification learning in Parkinson's disease. Neuropsychologia 46:2683-2695.