A Trade-Off between feedback-based learning and episodic memory for feedback events: Evidence from Parkinson's disease

Neurodegenerative Diseases

Volumn 11, Issue 2, 2012, Pages 93-101

  Foerde, Karin ^a   Braun, Erin Kendall ^a   Shohamy, Daphna ^a  

^a Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

Delayed feedback; Dopaminergic medication; Episodic memory; Feedback based learning; Hippocampus; Incremental learning; Memory function; Striatum

Indexed keywords

ADULT; AGED; ARTICLE; CLINICAL ARTICLE; CONTROLLED STUDY; CORPUS STRIATUM; EPISODIC MEMORY; FEEDBACK SYSTEM; HIPPOCAMPUS; HUMAN; LEARNING; LEARNING DISORDER; NEOSTRIATUM; PARKINSON DISEASE; PRIORITY JOURNAL; TASK PERFORMANCE;

AGED; ANTIPARKINSON AGENTS; CORPUS STRIATUM; DOPAMINE; FEEDBACK, PSYCHOLOGICAL; FEMALE; HIPPOCAMPUS; HUMANS; LEARNING DISORDERS; MALE; MEMORY DISORDERS; MEMORY, EPISODIC; MENTAL PROCESSES; MIDDLE AGED; NEUROPSYCHOLOGICAL TESTS; PARKINSON DISEASE; PROBABILITY LEARNING; RECOGNITION (PSYCHOLOGY);

EID: 84870057618     PISSN: 16602854     EISSN: 16602862     Source Type: Journal    
DOI: 10.1159/000342000     Document Type: Article

References (73)

1. Agid Y, Cervera P, Hirsch E, Javoy-Agid F, Lehericy S, Raisman R, Ruberg M: Biochemistry of Parkinson's disease 28 years later: a critical review. Mov Disord 1989; 4(suppl 1):S126-S144.
2. Hornykiewicz O: Ageing and neurotoxins as causative factors in idiopathic Parkinson's disease-A critical analysis of the neurochemical evidence. Prog Neuropsychopharmacol Biol Psychiatry 1989; 13: 319-328.
3. White NM, McDonald RJ: Multiple parallel memory systems in the brain of the rat. Neurobiol Learn Mem 2002; 77: 125-184.
4. Knowlton BJ, Mangels JA, Squire LR: A neostriatal habit learning system in humans. Science 1996; 273: 1399-1402.
5. Saint-Cyr JA, Taylor AE, Lang AE: Procedural learning and neostriatal dysfunction in man. Brain 1988; 111(Pt 4):941-959.
6. Saint-Cyr JA, Taylor AE, Nicholson K: Behavior and the basal ganglia. Adv Neurol 1995; 65: 1-28.
7. Salmon DP, Butters N: Neurobiology of skill and habit learning. Curr Opin Neurobiol 1995; 5: 184-190.
8. Frank MJ: Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. J Cogn Neurosci 2005; 17: 51-72.
9. Cools R: Dopaminergic modulation of cognitive function-implications for L-DOPA treatment in Parkinson's disease. Neurosci Biobehav Rev 2006; 30: 1-23.
10. Moustafa AA, Gluck MA: A neurocomputational model of dopamine and prefrontalstriatal interactions during multicue category learning by Parkinson patients. J Cogn Neurosci 2011; 23: 151-167.
11. Schultz W: Dopamine neurons and their role in reward mechanisms. Curr Opin Neurobiol 1997; 7: 191-197.
12. Faure A, Haberland U, Conde F, El Massioui N: Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation. J Neurosci 2005; 25: 2771-2780.
13. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD: Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 2006; 442: 1042-1045.
14. Shohamy D, Myers CE, Grossman S, Sage J, Gluck MA, Poldrack RA: Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. Brain 2004; 127(Pt 4):851-859.
15. Frank MJ, Seeberger LC, O'Reilly RC: By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 2004; 306: 1940-1943.
16. Myers CE, Shohamy D, Gluck MA, Grossman S, Kluger A, Ferris S, Golomb J, Schnirman G, Schwartz R: Dissociating hippocampal versus basal ganglia contributions to learning and transfer. J Cogn Neurosci 2003; 15: 185-193.
17. Schonberg T, O'Doherty JP, Joel D, Inzelberg R, Segev Y, Daw ND: Selective impairment of prediction error signaling in human dorsolateral but not ventral striatum in Parkinson's disease patients: evidence from a model-based fMRI study. Neuroimage 2010; 49: 772-781.
18. Foerde K, Shohamy D: Feedback timing modulates brain systems for learning in humans. J Neurosci 2011; 31: 13157-13167.
19. Jahanshahi M, Wilkinson L, Gahir H, Dharmarinda A, Lagnado DA: Medication impairs probabilistic classification learning in Parkinson's disease. Neuropsychologia 2010; 48: 1096-1103.
20. Frank MJ, Samanta J, Moustafa AA, Sherman SJ: Hold your horses: impulsivity, deep brain stimulation, and medication in parkinsonism. Science 2007; 318: 1309-1312.
21. Foerde K, Shohamy D: The role of the basal ganglia in learning and memory: insight from Parkinson's disease. Neurobiol Learn Mem 2011; 96: 624-636.
22. Ashby FG, Maddox WT: Human category learning. Annu Rev Psychol 2005; 56: 149-178.
23. Filoteo JV, Maddox WT, Salmon DP, Song DD: Information-integration category learning in patients with striatal dysfunction. Neuropsychology 2005; 19: 212-222.
24. Cools R, Barker RA, Sahakian BJ, Robbins TW: Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. Cereb Cortex 2001; 11: 1136-1143.
25. Cools R, Altamirano L, D'Esposito M: Reversal learning in Parkinson's disease depends on medication status and outcome valence. Neuropsychologia 2006; 44: 1663-1673.
26. Cools R, Lewis SJ, Clark L, Barker RA, Robbins TW: L-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson's disease. Neuropsychopharmacology 2007; 32: 180-189.
27. Cools R, Stefanova E, Barker RA, Robbins TW, Owen AM: Dopaminergic modulation of high-level cognition in Parkinson's disease: the role of the prefrontal cortex revealed by PET. Brain 2002; 125(Pt 3):584-594.
28. Shohamy D, Myers CE, Geghman KD, Sage J, Gluck MA: L-dopa impairs learning, but spares generalization, in Parkinson's disease. Neuropsychologia 2006; 44: 774-784.
29. Seo M, Beigi M, Jahanshahi M, Averbeck BB: Effects of dopamine medication on sequence learning with stochastic feedback in Parkinson's disease. Front Syst Neurosci 2010; 4: 36.
30. Dayan P, Balleine BW: Reward, motivation, and reinforcement learning. Neuron 2002; 36: 285-298.
31. Daw ND, Doya K: The computational neurobiology of learning and reward. Curr Opin Neurobiol 2006; 16: 199-204.
32. Bodi N, Keri S, Nagy H, Moustafa A, Myers CE, Daw N, Dibo G, Takats A, Bereczki D, Gluck MA: Reward-learning and the novelty-seeking personality: a between-And within-subjects study of the effects of dopamine agonists on young Parkinson's patients. Brain 2009; 132(Pt 9):2385-2395.
33. Shiner T, Seymour B, Wunderlich K, Hill C, Bhatia KP, Dayan P, Dolan RJ: Dopamine and performance in a reinforcement learning task: evidence from Parkinson's disease. Brain 2012; 135(Pt 6):1871-1883.
34. Smittenaar P, Chase HW, Aarts E, Nusselein B, Bloem BR, Cools R: Decomposing effects of dopaminergic medication in Parkinson's disease on probabilistic action selection-learning or performance? Eur J Neurosci 2012; 35: 1144-1151.
35. Foerde K, Knowlton BJ, Poldrack RA: Modulation of competing memory systems by distraction. Proc Natl Acad Sci USA 2006; 103: 11778-11783.
36. Gabrieli JD: Cognitive neuroscience of human memory. Annu Rev Psychol 1998; 49: 87-115.
37. Squire LR, Zola SM: Structure and function of declarative and nondeclarative memory systems. Proc Natl Acad Sci USA 1996; 93: 13515-13522.
38. Knowlton BJ, Squire LR, Gluck MA: Probabilistic classification learning in amnesia. Learn Mem 1994; 1: 106-120.
39. Reber PJ, Knowlton BJ, Squire LR: Dissociable properties of memory systems: differences in the flexibility of declarative and nondeclarative knowledge. Behav Neurosci 1996; 110: 861-871.
40. Poldrack RA, Packard MG: Competition among multiple memory systems: converging evidence from animal and human brain studies. Neuropsychologia 2003; 41: 245-251.
41. Frank MJ, O'Reilly RC, Curran T: When memory fails, intuition reigns: midazolam enhances implicit inference in humans. Psychol Sci 2006; 17: 700-707.
42. Poldrack RA, Clark J, Pare-Blagoev EJ, Shohamy D, Moyano JC, Myers C, Gluck MA: Interactive memory systems in the human brain. Nature 2001; 414: 546-550.
43. Voermans NC, Petersson KM, Daudey L, Weber B, Van Spaendonck KP, Kremer HP, Fernandez G: Interaction between the human hippocampus and the caudate nucleus during route recognition. Neuron 2004; 43: 427-435.
44. Lieberman MD, Chang GY, Chiao J, Bookheimer SY, Knowlton BJ: An event-related fMRI study of artificial grammar learning in a balanced chunk strength design. J Cogn Neurosci 2004; 16: 427-438.
45. Moody TD, Bookheimer SY, Vanek Z, Knowlton BJ: An implicit learning task activates medial temporal lobe in patients with Parkinson's disease. Behav Neurosci 2004; 118: 438-442.
46. Packard MG, Hirsh R, White NM: Differential effects of fornix and caudate nucleus lesions on two radial maze tasks: evidence for multiple memory systems. J Neurosci 1989; 9: 1465-1472.
47. Packard MG, Knowlton BJ: Learning and memory functions of the basal ganglia. Annu Rev Neurosci 2002; 25: 563-593.
48. Packard MG, McGaugh JL: Double dissociation of fornix and caudate nucleus lesions on acquisition of two water maze tasks: further evidence for multiple memory systems. Behav Neurosci 1992; 106: 439-446.
49. Packard MG, McGaugh JL: Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiol Learn Mem 1996; 65: 65-72.
50. Packard MG, Teather LA: Double dissociation of hippocampal and dorsal-striatal memory systems by posttraining intracerebral injections of 2-Amino-5-phosphonopentanoic acid. Behav Neurosci 1997; 111: 543-551.
51. Packard MG, White NM: Dissociation of hippocampus and caudate nucleus memory systems by posttraining intracerebral injection of dopamine agonists. Behav Neurosci 1991; 105: 295-306.
52. McDonald RJ, White NM: A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum. Behav Neurosci 1993; 107: 3-22.
53. McDonald RJ, White NM: Parallel information processing in the water maze: evidence for independent memory systems involving dorsal striatum and hippocampus. Behav Neural Biol 1994; 61: 260-270.
54. Schroeder JP, Wingard JC, Packard MG: Post-training reversible inactivation of hippocampus reveals interference between memory systems. Hippocampus 2002; 12: 280-284.
55. Hopkins RO, Myers CE, Shohamy D, Grossman S, Gluck M: Impaired probabilistic category learning in hypoxic subjects with hippocampal damage. Neuropsychologia 2004; 42: 524-535.
56. Gluck MA, Shohamy D, Myers C: How do people solve the 'weather prediction' task? Individual variability in strategies for probabilistic category learning. Learn Mem 2002; 9: 408-418.
57. Fiorillo CD, Newsome WT, Schultz W: The temporal precision of reward prediction in dopamine neurons. Nat Neurosci 2008; 11: 966-973.
58. Kobayashi S, Schultz W: Influence of reward delays on responses of dopamine neurons. J Neurosci 2008; 28: 7837-7846.
59. Davachi L: Item, context and relational episodic encoding in humans. Curr Opin Neurobiol 2006; 16: 693-700.
60. Wallenstein GV, Eichenbaum H, Hasselmo ME: The hippocampus as an associator of discontiguous events. Trends Neurosci 1998; 21: 317-323.
61. Cohen NJ, Eichenbaum H: Memory, Amnesia, and the Hippocampal System. Cambridge, MIT Press, 1993.
62. Shohamy D, Wagner AD: Integrating memories in the human brain: hippocampal-midbrain encoding of overlapping events. Neuron 2008; 60: 378-389.
63. Cavaco S, Anderson SW, Allen JS, Castro-Caldas A, Damasio H: The scope of preserved procedural memory in amnesia. Brain 2004; 127(Pt 8):1853-1867.
64. Klimkowicz-Mrowiec A, Slowik A, Krzywoszanski L, Herzog-Krzywoszanska R, Szczudlik A: Severity of explicit memory impairment due to Alzheimer's disease improves effectiveness of implicit learning. J Neurol 2008; 255: 502-509.
65. Davidson PS, Anaki D, Saint-Cyr JA, Chow TW, Moscovitch M: Exploring the recognition memory deficit in Parkinson's disease: estimates of recollection versus familiarity. Brain 2006; 129(Pt 7):1768-1779.
66. Whittington CJ, Podd J, Kan MM: Recognition memory impairment in Parkinson's disease: power and meta-Analyses. Neuropsychology 2000; 14: 233-246.
67. Whittington CJ, Podd J, Stewart-Williams S: Memory deficits in Parkinson's disease. J Clin Exp Neuropsychol 2006; 28: 738-754.
68. Cohn M, Moscovitch M, Davidson PS: Double dissociation between familiarity and recollection in Parkinson's disease as a function of encoding tasks. Neuropsychologia 2010; 48: 4142-4147.
69. Bronnick K, Alves G, Aarsland D, Tysnes OB, Larsen JP: Verbal memory in drug-naive, newly diagnosed Parkinson's disease. The retrieval deficit hypothesis revisited. Neuropsychology 2011; 25: 114-124.
70. Hay JF, Moscovitch M, Levine B: Dissociating habit and recollection: evidence from Parkinson's disease, amnesia and focal lesion patients. Neuropsychologia 2002; 40: 1324-1334.
71. Jokinen P, Bruck A, Aalto S, Forsback S, Parkkola R, Rinne JO: Impaired cognitive performance in Parkinson's disease is related to caudate dopaminergic hypofunction and hippocampal atrophy. Parkinsonism Relat Disord 2009; 15: 88-93.
72. Kenny ER, Burton EJ, O'Brien JT: A volumetric magnetic resonance imaging study of entorhinal cortex volume in dementia with Lewy bodies. A comparison with Alzheimer's disease and Parkinson's disease with and without dementia. Dement Geriatr Cogn Disord 2008; 26: 218-225.
73. Rutledge RB, Lazzaro SC, Lau B, Myers CE, Gluck MA, Glimcher PW: Dopaminergic drugs modulate learning rates and perseveration in Parkinson's patients in a dynamic foraging task. J Neurosci 2009; 29: 15104-15114.