Feedback signals in the caudate reflect goal achievement on a declarative memory task

NeuroImage

Volumn 41, Issue 3, 2008, Pages 1154-1167

  Tricomi, Elizabeth ^a   Fiez, Julie A ^a  

^a UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

Author keywords

Basal ganglia; fMRI; Learning; Memory; Reinforcement; Striatum

Indexed keywords

ADULT; ARTICLE; BASAL GANGLION; CAUDATE NUCLEUS; CLINICAL TRIAL; CORPUS STRIATUM; DIAGNOSTIC ACCURACY; FEEDBACK SYSTEM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GOAL ATTAINMENT; HUMAN; HUMAN EXPERIMENT; INFORMATION PROCESSING; MALE; MEMORY; NORMAL HUMAN; PRIORITY JOURNAL; REWARD; TASK PERFORMANCE; WORD RECOGNITION;

ADULT; BRAIN MAPPING; CAUDATE NUCLEUS; FEEDBACK; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MEMORY;

EID: 44449122702     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2008.02.066     Document Type: Article

References (73)

1. Adcock R.A., Thangavel A., Whitfield-Gabrieli S., Knutson B., and Gabrieli J.D.E. Reward-motivated learning: mesolimbic activation precedes memory formation. Neuron 50 (2006) 507
2. Aron A.R., Shohamy D., Clark J., Myers C., Gluck M.A., and Poldrack R.A. Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. J. Neurophysiol. 92 (2004) 1144-1152
3. Bar-Gad I., Morris G., and Bergman H. Information processing, dimensionality reduction and reinforcement learning in the basal ganglia. Prog. Neurobiol. 71 (2003) 439-473
4. Bayley P.J., Franscino J.C., and Squire L.R. Robust habit learning in the absence of awareness and independent of the medial temporal lobe. Nature 436 (2005) 550-553
5. Berns G.S., McClure S.M., Pagnoni G., and Montague P.R. Predictability modulates human brain response to reward. J. Neurosci. 21 (2001) 2793-2798
6. Brewer J.B., Zhao Z., Desmond J.E., Glover G.H., and Gabrieli J.D.E. Making memories: Brain activity that predicts how well visual experience will be remembered. Science 281 (1998) 1185-1187
7. Cincotta C.M., and Seger C.A. Dissociation between striatal regions while learning to categorize via feedback and via observation. J. Cogn. Neurosci. 19 (2007) 249-265
8. Coltheart M. The MRC psycholinguistic database. Q. J. Exp. Psychol. A 33 (1981) 497-505
9. Cools R. Dopaminergic modulation of cognitive function-implications for L-DOPA treatment in Parkinson's disease. Neurosci. Biobehav. Rev. 30 (2006) 1-23
10. Cox R.W. AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput. Biomed. Res. 29 (1996) 162-173
11. Delgado M.R., Nystrom L.E., Fissell C., Noll D.C., and Fiez J.A. Tracking the hemodynamic responses to reward and punishment in the striatum. J. Neurophysiol. 84 (2000) 3072-3077
12. Delgado M.R., Locke H.M., Stenger V.A., and Fiez J.A. Dorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations. Cogn. Affect. Behav. Neurosci. 3 (2003) 27-38
13. Delgado M.R., Stenger V.A., and Fiez J.A. Motivation-dependent responses in the human caudate nucleus. Cereb. Cortex 14 (2004) 1022-1030
14. Delgado M.R., Miller M.M., Inati S., and Phelps E.A. An fMRI study of reward-related probability learning. NeuroImage 24 (2005) 862-873
15. Dolan R.J., and Fletcher P.C. Dissociating prefrontal and hippocampal function in episodic memory encoding. Nature 388 (1997) 582-585
16. Elliott R., Frith C.D., and Dolan R.J. Differential neural response to positive and negative feedback in planning and guessing tasks. Neuropsychologia 35 (1997) 1395-1404
17. Elliott R., Dolan R.J., and Frith C.D. Dissociable functions in the medial and lateral orbitofrontal cortex: evidence from human neuroimaging studies. Cereb. Cortex 10 (2000) 308-317
18. Elliott R., Friston K.J., and Dolan R.J. Dissociable neural responses in human reward systems. J. Neurosci. 20 (2000) 6159-6165
19. Fellows L.K., and Farah M.J. Different underlying impairments in decision-making following ventromedial and dorsolateral frontal lobe damage in humans. Cereb. Cortex 15 (2005) 58-63
20. Fiorillo C.D., Tobler P.N., and Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299 (2003) 1898-1902
21. Forman S.D., Cohen J.D., Fitzgerald M., Eddy W.F., Mintun M.A., and Noll D.C. Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold. Magn. Reson. Med. 33 (1995) 636-647
22. Frank M.J., Seeberger L.C., O'Reilly R., and C. By carrot or by stick: cognitive reinforcement learning in Parkinsonism. Science 306 (2004) 1940-1943
23. Haber S.N., and Fudge J.L. The primate substantia nigra and VTA: integrative circuitry and function. Crit. Rev. Neurobiol. 11 (1997) 323-342
24. Haber S.N., Fudge J.L., and McFarland N.R. Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J. Neurosci. 20 (2000) 2369-2382
25. Haber S.N., Kim K.-S., Mailly P., and Calzavara R. Reward-related cortical inputs define a large striatal region in primates that interface with associative cortical connections, providing a substrate for incentive-based learning. J. Neurosci. 26 (2006) 8368-8376
26. Haruno M., Kuroda T., Doya K., Toyama K., Kimura M., Samejima K., Imamizu H., and Kawato M. A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task. J. Neurosci. 24 (2004) 1660-1665
27. Holroyd C., and Coles M. The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol. Rev. 109 (2002) 679-709
28. Ito R., Dalley J.W., Howes S.R., Robbins T.W., and Everitt B.J. Dissociation in conditioned dopamine release in the nucleus accumbens core and shell in response to cocaine cues and during cocaine-seeking behavior in rats. J. Neurosci. 20 (2000) 7489-7495
29. Ito R., Dalley J.W., Robbins T.W., and Everitt B.J. Dopamine release in the dorsal striatum during cocaine-seeking behavior under the control of a drug-associated cue. J. Neurosci. 22 (2002) 6247-6253
30. Jueptner M., Stephan K.M., Frith C.D., Brooks D.J., Frackowiak R.S.J., and Passingham R.E. Anatomy of motor learning. I. Frontal cortex and attention to action. J. Neurophysiol. 77 (1997) 1313-1324
31. Kluger A.N., and DeNisi A. The effects of feedback intervention on performance: a historical review, a meta-analysis and a preliminary feedback intervention theory. Psychol. Bull. 119 (1996) 254-284
32. Knowlton B.J., Mangles J.A., and Squire L.R. A neostriatal habit learning system in humans. Science 273 (1996) 1399-1402
33. Knutson B., Westdorp A., Kaiser E., and Hommer D. FMRI visualization of brain activity during a monetary incentive delay task. NeuroImage 12 (2000) 20-27
34. Landauer T.K., Foltz P.W., and Laham D. Introduction to latent semantic analysis. Discourse Processes 25 (1998) 259-284
35. Law J.R., Flanery M.A., Wirth S., Yanike M., Smith A.C., Frank L.M., Suzuki W.A., Brown E.N., and Stark C.E.L. Functional magnetic resonance imaging activity during the gradual acquisition and expression of paired-associate memory. J. Neurosci. 25 (2005) 5720-5729
36. Lisman J.E., and Grace A.A. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 46 (2005) 703-713
37. Maddox W.T., Ashby F.G., and Bohil C.J. Delayed feedback effects on rule-based and information-integration category learning. J. Exp. Psychol. Learn. Mem. Cogn. 29 (2003) 650-662
38. Maguire E.A., Frackowiak R.S., and Frith C.D. Recalling routes around London: activation of the right hippocampus in taxi drivers. J. Neurosci. 17 (1997) 7103-7110
39. McClure S.M., Berns G.S., and Montague P.R. Temporal prediction errors in a passive learning task activate human striatum. Neuron 38 (2003) 339-346
40. Middleton F.A., and Strick P.L. Basal-ganglia 'projections' to the prefrontal cortex of the primate. Cereb. Cortex 12 (2002) 926-935
41. Monchi O., Petrides M., Doyon J., Postuma R.B., Worsley K., and Dagher A. Neural bases of set-shifting deficits in Parkinson's disease. J. Neurosci. 24 (2004) 702-710
42. Nieuwenhuis S., Heslenfeld D.J., Alting von Geusau N.J., Mars R.B., Holroyd C.B., and Yeung N. Activity in human reward-sensitive brain areas is strongly context dependent. NeuroImage 25 (2005) 1302-1309
43. Nomura E.M., Maddox W.T., Filoteo J.V., Ing A.D., Gitelman D.R., Parrish T.B., Mesulam M.M., and Reber P.J. Neural correlates of rule-based and information-integration visual category learning. Cereb. Cortex 17 (2007) 37-43
44. O'Doherty J., Kringelbach M.L., Rolls E.T., Hornak J., and Andrews C. Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci. 4 (2001) 95-102
45. O'Doherty J., Dayan P., Schultz J., Deichmann R., Friston K., and Dolan R.J. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304 (2004) 452-454
46. Packard M.G., and McGaugh J.L. Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiol. Learn. Mem. 65 (1996) 65-72
47. Packard M.G., and Knowlton B.J. Learning and memory functions of the basal ganglia. Annu. Rev. Neurosci. 25 (2002) 563-593
48. Pasupathy A., and Miller E.K. Different time course of learning-related activity in the prefrontal cortex and striatum. Nature 433 (2005) 873-876
49. Poldrack R.A., Prabhakaran V., Seger C.A., and Gabrieli J.D.E. Striatal activation during acquisition of a cognitive skill. Neuropsychology 13 (1999) 564-574
50. Poldrack R.A., Clark J., Pare-Blagoev E.J., Shohamy D., Creso Moyano J., Myers C., and Gluck M.A. Interactive memory systems in the human brain. Nature 414 (2001) 546-550
51. Reber P.J., Siwiec R.M., Gitelman D.R., Parrish T.B., Mesulam M.-M., and Paller K.A. Neural correlates of successful encoding identified using functional magnetic resonance imaging. J. Neurosci. 22 (2002) 9541-9548
52. Robbins T.W., and Everitt B.J. Functions of dopamine in the dorsal and ventral striatum. Semin. Neurosci. 4 (1992) 119-127
53. Schneider W., Eschman A., and Zuccolotto A. E-prime user's guide (2002), Psychological Software Tools Inc., Pittsburgh
54. Seger C.A. Implicit learning. Psychol. Bull. 115 (1994) 163-196
55. Seger C.A., and Cincotta C.M. The roles of the caudate nucleus in human classification learning. J. Neurosci. 25 (2005) 2941-2951
56. Shohamy D., Myers C.E., Grossman S., Sage J., Gluck M.A., and Poldrack R.A. Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. Brain 127 (2004) 851-859
57. Smith J.G., and McDowall J. When artificial grammar acquisition in Parkinson's disease is impaired: the case of learning via trial-by-trial feedback. Brain Res. 1067 (2006) 216
58. Squire L.R. Memory systems of the brain: a brief history and current perspective. Neurobiol. Learn. Mem. 82 (2004) 171-177
59. Stark C.E.L., and Squire L.R. When zero is not zero: the problem of ambiguous baseline conditions in fMRI. Proc. Natl. Acad. Sci. U. S. A. (2001) 12760-12766
60. Talairach J., and Tournoux P. Co-planar stereotaxic atlas of the human brain: An approach to medical cerebral imaging. G. Thieme (1988), Thieme Medical Publishers, Stuttgart; New York
61. Tricomi E., Delgado M.R., McCandliss B.D., McClelland J.L., and Fiez J.A. Performance feedback drives caudate activation in a phonological learning task. J. Cogn. Neurosci. 18 (2006) 1029-1043
62. Tricomi E.M., Delgado M.R., and Fiez J.A. Modulation of caudate activity by action contingency. Neuron 41 (2004) 281-292
63. Tulving E., Markowitsch H.J., Craik F.E., Habib R., and Houle S. Novelty and familiarity activations in PET studies of memory encoding and retrieval. Cereb. Cortex 6 (1996) 71-79
64. Voermans N.C., Petersson K.M., Daudey L., Weber B., van Spaendonck K.P., Kremer H.P., and Fernandez G. Interaction between the human hippocampus and the caudate nucleus during route recognition. Neuron 43 (2004) 427-435
65. Wagner A.D., Schacter D.L., Rotte M., Koutstaal W., Maril A., Dale A.M., Rosen B.R., and Buckner R.L. Building memories: remembering and forgetting of verbal experiences as predicted by brain activity. Science 21 (1998) 1188-1191
66. Williams Z.M., and Eskandar E.N. Selective enhancement of associative learning by microstimulation of the anterior caudate. Nat. Neurosci. 9 (2006) 562-568
67. Wittmann B.C., Schott B.H., Guderian S., Frey J.U., Heinze H.-J., and Duzel E. Reward-related fMRI activation of dopaminergic midbrain is associated with enhanced hippocampus- dependent long-term memory formation. Neuron 45 (2005) 459-467
68. Woods R.P., Cherry S.R., and Mazziotta J.C. Rapid automated algorithm for aligning and reslicing pet images. J. Comput. Assist. Tomogr. 16 (1992) 620-633
69. Woods R.P., Mazziotta J.C., and Cherry S.R. MRI-PET registration with automated algorithm. J. Comput. Assist. Tomogr. 17 (1993) 536-546
70. Yin H.H., and Knowlton B.J. The role of the basal ganglia in habit formation. Nat. Rev., Neurosci. 7 (2006) 464-476
71. Zink C.F., Pagnoni G., Martin-Skurski M.E., Chappelow J.C., and Berns G.S. Human striatal responses to monetary reward depend on saliency. Neuron 42 (2004) 509-517
72. Zink C.F., Pagnoni G., Martin M.E., Dhamala M., and Berns G.S. Human striatal response to salient nonrewarding stimuli. J. Neurosci. 23 (2003) 8092-8097
73. Zola S.M., and Squire L.R. The medial temporal lobe and the hippocampus. In: Tulving E., and Craik F.I.M. (Eds). The Oxford Handbook of Memory (2000), Oxford University Press, Oxford 485-500