Information content and reward processing in the human striatum during performance of a declarative memory task

Cognitive, Affective and Behavioral Neuroscience

Volumn 12, Issue 2, 2012, Pages 361-372

  Tricomi, Elizabeth ^a   Fiez, Julie A ^b,c  

^a RUTGERS UNIVERSITY   (United States)

^b UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

^c CENTER FOR THE NEURAL BASIS OF COGNITION   (United States)

Author keywords

Caudate; Episodic memory. Feedback; Learning; Motivation; Prefrontal cortex

Indexed keywords

OXYGEN;

ADAPTIVE BEHAVIOR; ADULT; ANALYSIS OF VARIANCE; ARTICLE; BLOOD; BRAIN MAPPING; CORPUS STRIATUM; DECISION MAKING; EPISODIC MEMORY; FEMALE; HEMISPHERIC DOMINANCE; HUMAN; IMAGE PROCESSING; LEARNING; LINGUISTICS; MALE; NEUROPSYCHOLOGICAL TEST; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PREFRONTAL CORTEX; REACTION TIME; REWARD; VASCULARIZATION;

ANALYSIS OF VARIANCE; ASSOCIATION LEARNING; BRAIN MAPPING; CHOICE BEHAVIOR; CORPUS STRIATUM; FEEDBACK, PSYCHOLOGICAL; FEMALE; FUNCTIONAL LATERALITY; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MEMORY, EPISODIC; NEUROPSYCHOLOGICAL TESTS; OXYGEN; PREFRONTAL CORTEX; REACTION TIME; REWARD; VOCABULARY; YOUNG ADULT;

EID: 84863625992     PISSN: 15307026     EISSN: None     Source Type: Journal    
DOI: 10.3758/s13415-011-0077-3     Document Type: Article

References (58)

1. Bischoff-Grethe, A., Hazeltine, E., Bergren, L., Ivry, R. B., & Grafton, S. T. (2009). The influence of feedback valence in associative learning. NeuroImage, 44, 243-251.
2. Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001). Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron, 30, 619-639. (Pubitemid 32530601)
3. Brewer, J. B., Zhao, Z., Desmond, J. E., Glover, G. H., & Gabrieli, J. D. E. (1998). Making memories: Brain activity that predicts how well visual experience will be remembered. Science, 281, 1185-1187. doi:10.1126/science.281. 5380.1185 (Pubitemid 28406292)
4. Bromberg-Martin, E. S., & Hikosaka, O. (2011). Lateral habenula neurons signal errors in the prediction of reward information. Nature Neuroscience, 14, 1209-1216.
5. Chase, H. W., Frank, M. J., Michael, A., Bullmore, E. T., Sahakian, B. J., & Robbins, T. W. (2010). Approach and avoidance learning in patients with major depression and healthy controls: Relation to anhedonia. Psychological Medicine, 40, 433-440. doi:10.1017/ S0033291709990468
6. Cohen, L., Lehéricy, S., Chochon, F., Lemer, C., Rivaud, S., & Dehaene, S. (2002). Language-specific tuning of visual cortex? Functional properties of the Visual Word Form Area. Brain, 125, 1054-1069. (Pubitemid 34464617)
7. Coltheart, M. (1981). The MRC psycholinguistic database. Quarterly Journal of Experimental Psychology, 33A, 497-505. doi:10.1080/ 14640748108400805
8. Cox, R. W. (1996). AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Computers and Biomedical Research, 29, 162-173. (Pubitemid 26266657)
9. Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011). Model-based influences on humans' choices and striatal prediction errors. Neuron, 69, 1204-1215.
10. Dayan, P., & Balleine, B. W. (2002). Reward, motivation, and reinforcement learning. Neuron, 36, 285-298. (Pubitemid 35217892)
11. Delgado, M. R. (2007). Reward-related responses in the human striatum. In B. W. Balleine, K. Doya, J. O'Doherty, & M. Sakagami (Eds.), Reward and decision making in corticobasal ganglia networks (Annals of the New York Academy of Sciences, Vol. 1104, pp. 70-88). Malden, MA: Blackwell. (Pubitemid 47092728)
12. Delgado, M. R., Locke, H. M., Stenger, V. A., & Fiez, J. A. (2003). Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations. Cognitive, Affective, & Behavioral Neuroscience, 3, 27-38. doi:10.3758/ CABN.3.1.27 (Pubitemid 37517033)
13. Delgado, M. R., Miller, M. M., Inati, S., & Phelps, E. A. (2005). An fMRI study of reward-related probability learning. NeuroImage, 24, 862-873. doi:10.1016/j.neuroimage.2004.10.002 (Pubitemid 40094568)
14. Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000). Tracking the hemodynamic responses to reward and punishment in the striatum. Journal of Neurophysiology, 84, 3072-3077.
15. Dickerson, K. C., Li, J., & Delgado, M. R. (2011). Parallel contributions of distinct human memory systems during probabilistic learning. NeuroImage, 55, 266-276.
16. Elliott, R., Frith, C. D., & Dolan, R. J. (1997). Differential neural response to positive and negative feedback in planning and guessing tasks. Neuropsychologia, 35, 1395-1404. doi:10.1016/S0028-3932(97)00055-9 (Pubitemid 27455567)
17. Forman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C. (1995). Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): Use of a cluster-size threshold. Magnetic Resonance in Medicine, 33, 636-647.
18. Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004). By carrot or by stick: Cognitive reinforcement learning in Parkinsonism. Science, 306, 1940-1943. doi:10.1126/science.1102941 (Pubitemid 39627859)
19. Grahn, J. A., Parkinson, J. A., & Owen, A. M. (2008). The cognitive functions of the caudate nucleus. Progress in Neurobiology, 86, 141-155.
20. Graybiel, A. M. (1995). Building action repertoires: Memory and learning functions of the basal ganglia. Current Opinion in Neurobiology, 5, 733-741. (Pubitemid 26042622)
21. Han, S., Huettel, S. A., Raposo, A., Adcock, R. A., & Dobbins, I. G. (2010). Functional significance of striatal responses during episodic decisions: Recovery or goal attainment? Journal of Neuroscience, 30, 4767-4775. doi:10.1523/JNEUROSCI.3077-09.2010
22. Haruno, M., Kuroda, T., Doya, K., Toyama, K., Kimura, M., Samejima, K., . . . Kawato, M. (2004). A neural correlate of reward-based behavioral learning in caudate nucleus: A functional magnetic resonance imaging study of a stochastic decision task. Journal of Neuroscience, 24, 1660-1665. (Pubitemid 38240962)
23. Holroyd, C. B., & Coles, M. G. H. (2002). The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709. doi:10.1037/0033-295X.109.4.679
24. Kable, J. W., & Glimcher, P. W. (2007). The neural correlates of subjective value during intertemporal choice. Nature Neuroscience, 10, 1625-1633. (Pubitemid 350175876)
25. Kim, H., Shimojo, S., & O'Doherty, J. P. (2006). Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biology, 4, e233.
26. Lancaster, J. L., Woldorff, M. G., Parsons, L. M., Liotti, M., Freitas, C. S., Rainey, L., . . . Fox, P. T. (2000). Automated Talairach atlas labels for functional brain mapping. Human Brain Mapping, 10, 120-131. (Pubitemid 30456920)
27. Landauer, T. K., Foltz, P. W., & Laham, D. (1998). Introduction to latent semantic analysis. Discourse Processes, 25, 259-284. doi:10.1080/ 01638539809545028
28. Law, J. R., Flanery, M. A., Wirth, S., Yanike, M., Smith, A. C., Frank, L. M., . . . Stark, C. E. L. (2005). Functional magnetic resonance imaging activity during the gradual acquisition and expression of paired-associate memory. Journal of Neuroscience, 25, 5720-5729. doi:10.1523/JNEUROSCI.4935-04. 2005 (Pubitemid 40847884)
29. Lohrenz, T., McCabe, K., Camerer, C. F., & Montague, P. R. (2007). Neural signature of fictive learning signals in a sequential investment task. Proceedings of the National Academy of Sciences, 104, 9493-9498. (Pubitemid 47185807)
30. Matsumoto, M., & Hikosaka, O. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature, 459, 837-841. doi:10.1038/nature08028
31. Mattfeld, A. T., & Stark, C. E. (2011). Striatal and medial temporal lobe functional interactions during visuomotor associative learning. Cerebral Cortex, 21, 647-658.
32. McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004). Separate neural systems value immediate and delayed monetary rewards. Science, 306, 503-507. doi:10.1126/ science.1100907 (Pubitemid 39372453)
33. Meltzer, J. A., & Constable, R. T. (2005). Activation of human hippocampal formation reflects success in both encoding and cued recall of paired associates. NeuroImage, 24, 384-397. doi:10.1016/j.neuroimage.2004.09.001 (Pubitemid 41359035)
34. Mullette-Gillman, O. A., Detwiler, J. M., Winecoff, A., Dobbins, I., & Huettel, S. A. (2011). Infrequent, task-irrelevant monetary gains and losses engage dorsolateral and ventrolateral prefrontal cortex. Brain Research, 1395, 53-61.
35. Nieuwenhuis, S., Heslenfeld, D. J., Alting von Geusau, N. J., Mars, R. B., Holroyd, C. B., & Yeung, N. (2005). Activity in human reward-sensitive brain areas is strongly context dependent. Neuro-Image, 25, 1302-1309. doi:10.1016/j.neuroimage.2004.12.043
36. O'Doherty, J. P. (2004). Reward representations and reward-related learning in the human brain: Insights from neuroimaging. Current Opinion in Neurobiology, 14, 769-776. (Pubitemid 39576211)
37. Packard, M. G., & Knowlton, B. J. (2002). Learning and memory functions of the basal ganglia. Annual Review of Neuroscience, 25, 563-593. (Pubitemid 34748029)
38. Poldrack, R. A., Clark, J., Paré-Blagoev, E. J., Shohamy, D., Creso Moyano, J., Myers, C., & Gluck, M. A. (2001). Interactive memory systems in the human brain. Nature, 414, 546-550. doi:10.1038/ 35107080 (Pubitemid 33131537)
39. Reber, P. J., Siwiec, R. M., Gitelman, D. R., Parrish, T. B., Mesulam, M.-M., & Paller, K. A. (2002). Neural correlates of successful encoding identified using functional magnetic resonance imaging. Journal of Neuroscience, 22, 9541-9548. (Pubitemid 35356195)
40. Sadeh, T., Shohamy, D., Levy, D. R., Reggev, N., & Maril, A. (2011). Cooperation between the hippocampus and the striatum during episodic encoding. Journal of Cognitive Neuroscience, 23, 1597-1608. doi:10.1162/jocn.2010.21549
41. Schneider, W., Eschman, A., & Zuccolotto, A. (2002). E-Prime user's guide. Pittsburgh, PA: Psychology Software Tools.
42. Schultz, W., & Dickinson, A. (2000). Neuronal coding of prediction errors. Annual Review of Neuroscience, 23, 473-500. (Pubitemid 30350051)
43. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-1599. (Pubitemid 27120526)
44. Seger, C. A., & Cincotta, C. M. (2005). The roles of the caudate nucleus in human classification learning. Journal of Neuroscience, 25, 2941-2951. doi:10.1523/JNEUROSCI.3401-04.2005 (Pubitemid 40389252)
45. Shannon, C. E. (1948). A mathematical theory of communication. Bell System Technical Journal, 27(379-423), 623-656.
46. Shohamy, D., Myers, C. E., Kalanithi, J., & Gluck, M. A. (2008). Basal ganglia and dopamine contributions to probabilistic category learning. Neuroscience and Biobehavioral Reviews, 32, 219-236.
47. Tom, S. M., Fox, C. R., Trepel, C., & Poldrack, R. A. (2007). The neural basis of loss aversion in decision-making under risk. Science, 315, 515-518. doi:10.1126/science.1134239 (Pubitemid 46175755)
48. Tricomi, E., & Fiez, J. A. (2008). Feedback signals in the caudate reflect goal achievement on a declarative memory task. Neuro-Image, 41, 1154-1167.
49. Tricomi, E., Delgado, M. R., McCandliss, B. D., McClelland, J. L., & Fiez, J. A. (2006). Performance feedback drives caudate activation in a phonological learning task. Journal of Cognitive Neuroscience, 18, 1029-1043. doi:10.1162/jocn.2006.18.6.1029 (Pubitemid 44066138)
50. Tricomi, E. M., Delgado, M. R., & Fiez, J. A. (2004). Modulation of caudate activity by action contingency. Neuron, 41, 281-292. (Pubitemid 38125188)
51. Ullsperger, M., & von Cramon, D. Y. (2003). Error monitoring using external feedback: Specific roles of the habenular complex, the reward system, and the cingulate motor area revealed by functional magnetic resonance imaging. Journal of Neuroscience, 23, 4308-4314. (Pubitemid 36958451)
52. Ursu, S., & Carter, C. S. (2005). Outcome representations, counterfactual comparisons and the human orbitofrontal cortex: Implications for neuroimaging studies of decision-making. Cognitive Brain Research, 23, 51-60. (Pubitemid 40417506)
53. Wächter, T., Lungu, O. V., Liu, T., Willingham, D. T., & Ashe, J. (2009). Differential effect of reward and punishment on procedural learning. Journal of Neuroscience, 29, 436-443. doi:10.1523/ JNEUROSCI.4132-08.2009
54. Wagner, A. D., Koutstaal, W., & Schacter, D. L. (1999). When encoding yields remembering: Insights from event-related neuroimaging. Philosophical Transactions of the Royal Society B, 354, 1307-1324. (Pubitemid 29400908)
55. Wagner, A. D., Schacter, D. L., Rotte, M., Koutstaal, W., Maril, A., Dale, A. M., . . . Buckner, R. L. (1998). Building memories: Remembering and forgetting of verbal experiences as predicted by brain activity. Science, 281, 1188-1191. doi:10.1126/science.281.5380.1188 (Pubitemid 28406293)
56. Woods, R. P., Cherry, S. R., & Mazziotta, J. C. (1992). Rapid automated algorithm for aligning and reslicing PET images. Journal of Computer Assisted Tomography, 16, 620-633.
57. Woods, R. P., Mazziotta, J. C., & Cherry, S. R. (1993). MRI-PET registration with automated algorithm. Journal of Computer Assisted Tomography, 17, 536-546. (Pubitemid 23206731)
58. Zink, C. F., Pagnoni, G., Martin, M. E., Dhamala, M., & Berns, G. S. (2003). Human striatal response to salient nonrewarding stimuli. Journal of Neuroscience, 23, 8092-8097. (Pubitemid 37082462)