Distinct hippocampal and basal ganglia contributions to probabilistic learning and reversal

Journal of Cognitive Neuroscience

Volumn 21, Issue 9, 2009, Pages 1821-1833

  Shohamy, Daphna ^a   Myers, Catherine E ^b   Hopkins, Ramona O ^c   Sage, Jake ^d   Gluck, Mark A ^b  

^a Howard Hughes Medical Institute   (United States)

^b RUTGERS UNIVERSITY   (United States)

^c BRIGHAM YOUNG UNIVERSITY   (United States)

^d UNIVERSITY OF MEDICINE AND DENTISTRY OF NEW JERSEY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE RECEPTOR STIMULATING AGENT; LEVODOPA; PRAMIPEXOLE;

ADULT; AMNESIA; ARTICLE; BASAL GANGLION; BRAIN; CLINICAL ARTICLE; CONTROLLED STUDY; FEMALE; HIPPOCAMPUS; HUMAN; LEARNING; MALE; MEMORY; MINI MENTAL STATE EXAMINATION; NEUROIMAGING; NEUROLOGIC DISEASE; NUCLEAR MAGNETIC RESONANCE IMAGING; PARKINSON DISEASE; PRIORITY JOURNAL; TASK PERFORMANCE;

ADULT; AGED; AMNESIA; ANALYSIS OF VARIANCE; ASSOCIATION LEARNING; BASAL GANGLIA; CUES; FEMALE; GAMBLING; HIPPOCAMPUS; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; NEUROPSYCHOLOGICAL TESTS; PARKINSON DISEASE; PROBABILITY LEARNING; REVERSAL LEARNING;

BASAL GANGLIA; FUNCTION CONTROL; HEALTHY CONTROLS; LEARN+; LEARNING AND MEMORY; MEMORY SYSTEMS; PROBABILISTIC LEARNING; TWO WAYS;

EID: 67650410009     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn.2009.21138     Document Type: Article

References (67)

1. Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986). Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annual Review of Neuroscience, 9, 357-381.
2. Annett, L. E., McGregor, A., & Robbins, T. W. (1989). The effects of ibotenic acid lesions of the nucleus accumbens on spatial learning and extinction in the rat. Behavioural Brain Research, 31, 231-242.
3. Ashby, F. G., Noble, S., Filoteo, J. V., Waldron, E. M., & Ell, S. W. (2003). Category learning deficits in Parkinson's disease. Neuropsychology, 17, 115-124.
4. Bakker, A., Kirwan, C. B., Miller, M., & Stark, C. E. (2008). Pattern separation in the human hippocampal ca3 and dentate gyrus. Science, 319, 1640-1642.
5. Beck, A. (1987). Beck depression inventory. San Antonio, TX: The Psychological Corporation.
6. Berger, T. W., & Orr, W. B. (1983). Hippocampectomy selectively disrupts discrimination reversal conditioning of the rabbit nictitating membrane response. Behavioural Brain Research, 8, 49-68.
7. Bigler, E. D., Blatter, D. D., Anderson, C. V., Johnson, S. C., Gale, S. D., Hopkins, R. O., et al. (1997). Hippocampal volume in normal aging and traumatic brain injury. AJNR, American Journal of Neuroradiology, 18, 11-23.
8. Carrillo, M. C., Gabrieli, J. D., Hopkins, R. O., McGlinchey-Berroth, R., Fortier, C. B., Kesner, R. P., et al. (2001). Spared discrimination and impaired reversal eyeblink conditioning in patients with temporal lobe amnesia. Behavioral Neuroscience, 115, 1171-1179.
9. Cohen, N. J., & Eichenbaum, H. (1993). Memory, amnesia, and the hippocampal system. Cambridge, MA: MIT Press.
10. Cools, R., Altamirano, L., & D'Esposito, M. (2006). Reversal learning in Parkinson's disease depends on medication status and outcome valence. Neuropsychologia, 44, 1663-1673.
11. Cools, R., Barker, R. A., Sahakian, B. J., & Robbins, T. W. (2001). Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. Cerebral Cortex, 11, 1136-1143.
12. Cools, R., Barker, R. A., Sahakian, B. J., & Robbins, T. W. (2003). L-Dopa medication remediates cognitive inflexibility, but increases impulsivity in patients with Parkinson's disease. Neuropsychologia, 41, 1431-1441.
13. Cools, R., Clark, L., Owen, A. M., & Robbins, T. W. (2002). Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging. Journal of Neuroscience, 22, 4563-4567.
14. Cools, R., Gibbs, S. E., Miyakawa, A., Jagust, W., & D'Esposito, M. (2008). Working memory capacity predicts dopamine synthesis capacity in the human striatum. Journal of Neuroscience, 28, 1208-1212.
15. Delgado, M. R., Miller, M. M., Inati, S., & Phelps, E. A. (2005). An fMRI study of reward-related probability learning. Neuroimage, 24, 862-873.
16. Dusek, J. A., & Eichenbaum, H. (1997). The hippocampus and memory for orderly stimulus relations. Proceedings of the National Academy of Sciences, U.S.A., 94, 7109-7114.
17. Eichenbaum, H. (2000). A cortical-hippocampal system for declarative memory. Nature Reviews Neuroscience, 1, 41-50.
18. Eichenbaum, H. E., & Cohen, N. J. (2001). From conditioning to conscious recollection: Memory systems of the brain. New York: Oxford University Press.
19. Fagan, A. M., & Olton, D. S. (1986). Learning sets, discrimination reversal, and hippocampal function. Behavioural Brain Research, 21, 13-20.
20. Filoteo, J. V., Maddox, W. T., Salmon, D. P., & Song, D. D. (2005). Information-integration category learning in patients with striatal dysfunction. Neuropsychology, 19, 212-222.
21. Foerde, K., Knowlton, B. J., & Poldrack, R. A. (2006). Modulation of competing memory systems by distraction. Proceedings of the National Academy of Sciences, U.S.A., 103, 11778-11783.
22. Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975). "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12, 189-198.
23. Frank, M. J. (2005). Dynamic dopamine modulation in the basal ganglia: A neurocomputational account of cognitive deficits in medicated and nonmedicated parkinsonism. Journal of Cognitive Neuroscience, 17, 51-72.
24. Frank, M. J., & Claus, E. D. (2006). Anatomy of a decision: Striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychological Review, 113, 300-326.
25. Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004). By carrot or by stick: Cognitive reinforcement learning in parkinsonism. Science, 306, 1940-1943.
26. Gabrieli, J. D. (1998). Cognitive neuroscience of human memory. Annual Review of Psychology, 49, 87-115.
27. Gluck, M. A., Shohamy, D., & Myers, C. (2002). How do people solve the "weather prediction" task? Individual variability in strategies for probabilistic category learning. Learning and Memory, 9, 408-418.
28. Goldman-Rakic, P. S., Selemon, L. D., & Schwartz, M. L. (1984). Dual pathways connecting the dorsolateral prefrontal cortex with the hippocampal formation and parahippocampal cortex in the rhesus monkey. Neuroscience, 12, 719-743.
29. Heckers, S., Zalesak, M., Weiss, A. P., Ditman, T., & Titone, D. (2004). Hippocampal activation during transitive inference in humans. Hippocampus, 14, 153-162.
30. Hopkins, R. O., Myers, C. E., Shohamy, D., Grossman, S., & Gluck, M. (2004). Impaired probabilistic category learning in hypoxic subjects with hippocampal damage. Neuropsychologia, 42, 524-535.
31. Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996). A neostriatal habit learning system in humans. Science, 273, 1399-1402.
32. Knowlton, B. J., Squire, L. R., & Gluck, M. A. (1994). Probabilistic classification learning in amnesia. Learning and Memory, 1, 106-120.
33. Leutgeb, J. K., Leutgeb, S., Moser, M. B., & Moser, E. I. (2007). Pattern separation in the dentate gyrus and ca3 of the hippocampus. Science, 315, 961-966.
34. Lewis, S. J., Slabosz, A., Robbins, T. W., Barker, R. A., & Owen, A. M. (2005). Dopaminergic basis for deficits in working memory but not attentional set-shifting in Parkinson's disease. Neuropsychologia, 43, 823-832.
35. Maddox, W. T., Aparicio, P., Marchant, N. L., & Ivry, R. B. (2005). Rule-based category learning is impaired in patients with Parkinson's disease but not in patients with cerebellar disorders. Journal of Cognitive Neuroscience, 17, 707-723.
36. Marston, H. M., Everitt, B. J., & Robbins, T. W. (1993). Comparative effects of excitotoxic lesions of the hippocampus and septum/diagonal band on conditional visual discrimination and spatial learning. Neuropsychologia, 31, 1099-1118.
37. Myers, C. E., Deluca, J., Hopkins, R. O., & Gluck, M. A. (2006). Conditional discrimination and reversal in amnesia subsequent to hypoxic brain injury or anterior communicating artery aneurysm rupture. Neuropsychologia, 44, 130-139.
38. Myers, C. E., & Gluck, M. A. (1994). Context, conditioning, and hippocampal rerepresentation in animal learning. Behavioral Neuroscience, 108, 835-847.
39. Myers, C. E., Hopkins, R. O., Kesner, R. P., Monti, L., & Gluck, M. (2000). Conditional spatial discrimination in humans with hypoxic brain injury. Psychobiology, 28, 275-282.
40. Myers, C. E., Shohamy, D., Gluck, M. A., Grossman, S., Kluger, A., Ferris, S., et al. (2003). Dissociating hippocampal versus basal ganglia contributions to learning and transfer. Journal of Cognitive Neuroscience, 15, 185-193.
41. Owen, A. M., Beksinska, M., James, M., Leigh, P. N., Summers, B. A., Marsden, C. D., et al. (1993). Visuospatial memory deficits at different stages of Parkinson's disease. Neuropsychologia, 31, 627-644.
42. Owen, A. M., Roberts, A. C., Hodges, J. R., Summers, B. A., Polkey, C. E., & Robbins, T. W. (1993). Contrasting mechanisms of impaired attentional set-shifting in patients with frontal lobe damage or Parkinson's disease. Brain, 116, 1159-1175.
43. Poldrack, R. A., Clark, J., Pare-Blagoev, E. J., Shohamy, D., Creso Moyano, J., Myers, C., et al. (2001). Interactive memory systems in the human brain. Nature, 414, 546-550.
44. Poldrack, R. A., & Packard, M. G. (2003). Competition among multiple memory systems: Converging evidence from animal and human brain studies. Neuropsychologia, 41, 245-251.
45. Poldrack, R. A., Prabhakaran, V., Seger, C. A., & Gabrieli, J. D. (1999). Striatal activation during acquisition of a cognitive skill. Neuropsychology, 13, 564-574.
46. Preston, A. R., Shrager, Y., Dudukovic, N. M., & Gabrieli, J. D. (2004). Hippocampal contribution to the novel use of relational information in declarative memory. Hippocampus, 14, 148-152.
47. Radloff, L. S. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1, 385-401.
48. Robbins, T. W. (1996). Refining the taxonomy of memory. Science, 273, 1353-1354.
49. Schacter, D. L., & Wagner, A. D. (1999). Medial temporal lobe activations in fMRI and pet studies of episodic encoding and retrieval. Hippocampus, 9, 7-24.
50. Schoenbaum, G., & Setlow, B. (2003). Lesions of nucleus accumbens disrupt learning about aversive outcomes. Journal of Neuroscience, 23, 9833-9841.
51. Schultz, W. (2000). Multiple reward signals in the brain. Nature Reviews Neuroscience, 1, 199-207.
52. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-1599.
53. Seger, C. A., & Cincotta, C. M. (2005). The roles of the caudate nucleus in human classification learning. Journal of Neuroscience, 25, 2941-2951.
54. Setlow, B., Schoenbaum, G., & Gallagher, M. (2003). Neural encoding in ventral striatum during olfactory discrimination learning. Neuron, 38, 625-636.
55. Shin, J. C., & Ivry, R. B. (2003). Spatial and temporal sequence learning in patients with Parkinson's disease or cerebellar lesions. Journal of Cognitive Neuroscience, 15, 1232-1243.
56. Shohamy, D., Myers, C. E., Geghman, K. D., Sage, J., & Gluck, M. A. (2006). L-Dopa impairs learning, but spares generalization, in Parkinson's disease. Neuropsychologia, 44, 774-784.
57. Shohamy, D., Myers, C. E., Grossman, S., Sage, J., & Gluck, M. A. (2005). The role of dopamine in cognitive sequence learning: Evidence from Parkinson's disease. Behavioural Brain Research, 156, 191-199.
58. Shohamy, D., Myers, C. E., Grossman, S., Sage, J., Gluck, M. A., & Poldrack, R. A. (2004). Cortico-striatal contributions to feedback-based learning: Converging data from neuroimaging and neuropsychology. Brain, 127, 851-859.
59. Shohamy, D., Myers, C. E., Kalanithi, J., & Gluck, M. A. (2008). Basal ganglia and dopamine contributions to probabilistic category learning. Neuroscience and Biobehavioral Reviews, 32, 219-236.
60. Shohamy, D., Myers, C. E., Onlaor, S., & Gluck, M. A. (2004). Role of the basal ganglia in category learning: How do patients with Parkinson's disease learn? Behavioral Neuroscience, 118, 676-686.
61. Shohamy, D., & Wagner, A. D. (in press). Integrating memories in the human brain: Hippocampal-midbrain encoding of overlapping events. Neuron.
62. Slabosz, A., Lewis, S. J., Smigasiewicz, K., Szymura, B., Barker, R. A., & Owen, A. M. (2006). The role of learned irrelevance in attentional set-shifting impairments in Parkinson's disease. Neuropsychology, 20, 578-588.
63. Squire, L. R. (1987). The organization and neural substrates of human memory. International Journal of Neurology, 21-22, 218-222.
64. Suzuki, W. A., & Amaral, D. G. (2004). Functional neuroanatomy of the medial temporal lobe memory system. Cortex, 40, 220-222.
65. Swainson, R., Rogers, R. D., Sahakian, B. J., Summers, B. A., Polkey, C. E., & Robbins, T. W. (2000). Probabilistic learning and reversal deficits in patients with Parkinson's disease or frontal or temporal lobe lesions: Possible adverse effects of dopaminergic medication. Neuropsychologia, 38, 596-612.
66. Swainson, R., SenGupta, D., Shetty, T., Watkins, L. H., Summers, B. A., Sahakian, B. J., et al. (2006). Impaired dimensional selection but intact use of reward feedback during visual discrimination learning in Parkinson's disease. Neuropsychologia, 44, 1290-1304.
67. Zola, S. M., & Mahut, H. (1973). Paradoxical facilitation of object reversal learning after transection of the fornix in monkeys. Neuropsychologia, 11, 271-284.