Remembering with gains and losses: Effects of monetary reward and punishment on successful encoding activation of source memories

Cerebral Cortex

Volumn 24, Issue 5, 2014, Pages 1319-1331

  Shigemune, Yayoi ^a,b   Tsukiura, Takashi ^a,b   Kambara, Toshimune ^a,c   Kawashima, Ryuta ^a  

^a TOHOKU UNIVERSITY   (Japan)

^b KYOTO UNIVERSITY   (Japan)

^c JAPAN SOCIETY FOR THE PROMOTION OF SCIENCE   (Japan)

Author keywords

functional magnetic resonance imaging; punishment; reward; source memory

Indexed keywords

ADULT; ANTERIOR CINGULATE; ARTICLE; BLOOD OXYGENATION; BRAIN FORNIX; BRAIN REGION; CEREBELLUM; CLAUSTRUM; CONTROLLED STUDY; CUNEUS; EPISODIC MEMORY; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; MONETARY REWARD; MONTE CARLO METHOD; MOTIVATION; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE SCANNER; NUCLEUS ACCUMBENS; PRIORITY JOURNAL; PUNISHMENT; RESPONSE TIME; REWARD; RIGHT HANDEDNESS; SUBSTANTIA NIGRA; SUPPLEMENTARY MOTOR AREA; VENTRAL TEGMENTUM; ADAPTIVE BEHAVIOR; BLOOD; BRAIN; BRAIN MAPPING; IMAGE PROCESSING; LEARNING; MEMORY; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; REACTION TIME; RECALL; STATISTICS; VASCULARIZATION;

OXYGEN;

ADULT; BRAIN; BRAIN MAPPING; FEEDBACK, PSYCHOLOGICAL; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MEMORY; MENTAL RECALL; MOTIVATION; OXYGEN; PUNISHMENT; REACTION TIME; REWARD; STATISTICS AS TOPIC; VERBAL LEARNING;

EID: 84898839256     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhs415     Document Type: Article

References (113)

1. Adcock RA, Thangavel A, Whitfield-Gabrieli S, Knutson B, Gabrieli JD. 2006. Reward-motivated learning: mesolimbic activation precedes memory formation. Neuron. 50:507-517.
2. Amaral DG, Cowan WM. 1980. Subcortical afferents to the hippocam-pal formation in the monkey. J Comp Neurol. 189:573-591.
3. Anderson AK, Christoff K, Stappen I, Panitz D, Ghahremani DG, Glover G, Gabrieli JD, Sobel N. 2003. Dissociated neural representations of intensity and valence in human olfaction. Nat Neurosci. 6:196-202.
4. Beck SM, Locke HS, Savine AC, Jimura K, Braver TS. 2010. Primary and secondary rewards differentially modulate neural activity dynamics during working memory. PLoS One. 5:e9251.
5. Bjork JM, Smith AR, Chen G, Hommer DW. 2010. Adolescents, adults and rewards: comparing motivational neurocircuitry recruitment using fMRI. PLoS One. 5:e11440.
6. Bray S, Shimojo S, O'Doherty JP. 2010. Human medial orbitofrontal cortex is recruited during experience of imagined and real rewards. J Neurophysiol. 103:2506-2512.
7. Breiter HC, Aharon I, Kahneman D, Dale A, Shizgal P. 2001. Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron. 30:619-639.
8. Carter DA, Fibiger HC. 1977. Ascending projections of presumed dopamine-containing neurons in the ventral tegmentum of the rat as demonstrated by horseradish peroxidase. Neuroscience. 2:569-576.
9. Carter RM, Macinnes JJ, Huettel SA, Adcock RA. 2009. Activation in the VTA and nucleus accumbens increases in anticipation of both gains and losses. Front Behav Neurosci. 3:21.
10. Coghill RC, Talbot JD, Evans AC, Meyer E, Gjedde A, Bushnell MC, Duncan GH. 1994. Distributed processing of pain and vibration by the human brain. J Neurosci. 14:4095-4108.
11. Coizet V, Dommett EJ, Redgrave P, Overton PG. 2006. Nociceptive responses of midbrain dopaminergic neurones are modulated by the superior colliculus in the rat. Neuroscience. 139:1479-1493.
12. Cooper JC, Knutson B. 2008. Valence and salience contribute to nucleus accumbens activation. Neuroimage. 39:538-547.
13. Cox SM, Andrade A, Johnsrude IS. 2005. Learning to like: a role for human orbitofrontal cortex in conditioned reward. J Neurosci. 25:2733-2740.
14. D'Ardenne K, McClure SM, Nystrom LE, Cohen JD. 2008. BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science. 319:1264-1267.
15. Daselaar SM, Fleck MS, Dobbins IG, Madden DJ, Cabeza R. 2006. Effects of healthy aging on hippocampal and rhinal memory functions: an event-related fMRI study. Cereb Cortex. 16:1771-1782.
16. Davachi L. 2006. Item, context and relational episodic encoding in humans. Curr Opin Neurobiol. 16:693-700.
17. Davachi L, Mitchell JP, Wagner AD. 2003. Multiple routes to memory: distinct medial temporal lobe processes build item and source memories. Proc Natl Acad Sci USA. 100:2157-2162.
18. Delgado MR, Jou RL, Phelps EA. 2011. Neural systems underlying aversive conditioning in humans with primary and secondary rein-forcers. Front Neurosci. 5:71.
19. Delgado MR, Nystrom LE, Fissell C, Noll DC, Fiez JA. 2000. Tracking the hemodynamic responses to reward and punishment in the striatum. J Neurophysiol. 84:3072-3077.
20. Diana RA, Yonelinas AP, Ranganath C. 2007. Imaging recollection and familiarity in the medial temporal lobe: a three-component model. Trends Cogn Sci. 11:379-386.
21. Dolan RJ. 2000. Functional neuroimaging of the amygdala during emotional processing and learning. In: Aggleton JP, editor. The amygdala: a functional analysis. 2nd ed. UK: Oxford University Press. p. 631-653.
22. Dolcos F, LaBar KS, Cabeza R. 2004. Interaction between the amygdala and the medial temporal lobe memory system predicts better memory for emotional events. Neuron. 42:855-863.
23. Dreher JC, Kohn P, Berman KF. 2006. Neural coding of distinct statistical properties of reward information in humans. Cereb Cortex. 16:561-573.
24. Eichenbaum H, Yonelinas AP, Ranganath C. 2007. The medial temporal lobe and recognition memory. Annu Rev Neurosci. 30:123-152.
25. Everitt BJ, Cardinal RN, Hall J, Parkinson JA, Robbins TW. 2000. Differential involvement of amygdala subsystems in appetitive conditioning and drug addiction. In: Aggleton JP, editor. The amygdala: a functional analysis. 2nd ed. UK: Oxford University Press. p. 353-390.
26. Friedman DP, Murray EA, O'Neill JB, Mishkin M. 1986. Cortical connections of the somatosensory fields of the lateral sulcus of macaques: evidence for a corticolimbic pathway for touch. J Comp Neurol. 252:323-347.
27. Gallagher M. 2000. The amygdala and associative learning. In: Aggle-ton JP, editor. The amygdala: a functional analysis. 2nd ed. UK: Oxford University Press. p. 311-329.
28. Galvan A, Hare TA, Davidson M, Spicer J, Glover G, Casey BJ. 2005. The role of ventral frontostriatal circuitry in reward-based learning in humans. J Neurosci. 25:8650-8656.
29. Gasbarri A, Campana E, Pacitti C, Hajdu F, Tombol T. 1991. Organization of the projections from the ventral tegmental area of Tsai to the hippocampal formation in the rat. J Hirnforsch. 32:429-437.
30. Gasbarri A, Packard MG, Campana E, Pacitti C. 1994. Anterograde and retrograde tracing of projections from the ventral tegmental area to the hippocampal formation in the rat. Brain Res Bull. 33:445-452.
31. Gasbarri A, Sulli A, Innocenzi R, Pacitti C, Brioni JD. 1996. Spatial memory impairment induced by lesion of the mesohippocampal dopaminergic system in the rat. Neuroscience. 74:1037-1044.
32. Gasbarri A, Verney C, Innocenzi R, Campana E, Pacitti C. 1994. Meso-limbic dopaminergic neurons innervating the hippocampal formation in the rat: a combined retrograde tracing and immunohistochemical study. Brain Res. 668:71-79.
33. Guarraci FA, Kapp BS. 1999. An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit. Behav Brain Res. 99:169-179.
34. Haber SN, Knutson B. 2010. The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology. 35:4-26.
35. Hamann SB, Ely TD, Grafton ST, Kilts CD. 1999. Amygdala activity related to enhanced memory for pleasant and aversive stimuli. Nat Neurosci. 2:289-293.
36. Hare TA, O'Doherty J, Camerer CF, Schultz W, Rangel A. 2008. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J Neurosci. 28:5623-5630.
37. Itsukushima Y, Ishihara O, Nagata Y, Koike Y. 1991. Research of two-Chinese character word attributes: imagery, concreteness, and ease of learning. Psychol Res Nihon Univ. 12:1-19.
38. Jacoby LL. 1991. A process dissociation framework: separating automatic from intentional uses of memory. J Mem Lang. 30:513-541.
39. Johnson JD, Rugg MD. 2007. Recollection and the reinstatement of encoding-related cortical activity. Cereb Cortex. 17:2507-2515.
40. Kensinger EA. 2004. Remembering emotional experiences: the contribution of valence and arousal. Rev Neurosci. 15:241-251.
41. Kensinger EA, Schacter DL. 2006. Amygdala activity is associated with the successful encoding of item, but not source, information for positive and negative stimuli. J Neurosci. 26:2564-2570.
42. Kim H, Cabeza R. 2007. Trusting our memories: dissociating the neural correlates of confidence in veridical versus illusory memories. J Neurosci. 27:12190-12197.
43. Kim H, Shimojo S, O'Doherty JP. 2006. Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol. 4:e233.
44. Knutson B, Adams CM, Fong GW, Hommer D. 2001. Anticipation of increasing monetary reward selectively recruits nucleus accum-bens. J Neurosci. 21:RC159.
45. Knutson B, Fong GW, Adams CM, Varner JL, Hommer D. 2001. Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport. 12:3683-3687.
46. Knutson B, Greer SM. 2008. Anticipatory affect: neural correlates and consequences for choice. Philos Trans R Soc Lond B Biol Sci. 363:3771-3786.
47. Knutson B, Westdorp A, Kaiser E, Hommer D. 2000. fMRI visualization of brain activity during a monetary incentive delay task. Neu-roimage. 12:20-27.
48. Kringelbach ML, O'Doherty J, Rolls ET, Andrews C. 2003. Activation of the human orbitofrontal cortex to a liquid food stimulus is correlated with its subjective pleasantness. Cereb Cortex. 13:1064-1071.
49. LeDoux J. 2000. The amygdala and emotion: a view through fear. In: Aggleton JP, editor. The amygdala: a functional analysis. 2nd ed. UK: Oxford University Press. p. 289-310.
50. Lewis DA, Melchitzky DS, Sesack SR, Whitehead RE, Auh S, Sampson A. 2001. Dopamine transporter immunoreactivity in monkey cerebral cortex: regional, laminar, and ultrastructural localization. J Comp Neurol. 432:119-136.
51. Lewis PA, Critchley HD, Rotshtein P, Dolan RJ. 2007. Neural correlates of processing valence and arousal in affective words. Cereb Cortex. 17:742-748.
52. Lisman JE, Grace AA. 2005. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron. 46:703-713.
53. Liu X, Powell DK, Wang H, Gold BT, Corbly CR, Joseph JE. 2007. Functional dissociation in frontal and striatal areas for processing of positive and negative reward information. J Neurosci. 27:4587-4597.
54. Ljungberg T, Apicella P, Schultz W. 1992. Responses of monkey dopa-mine neurons during learning of behavioral reactions. J Neurophy-siol. 67:145-163.
55. Martig AK, Mizumori SJ. 2011. Ventral tegmental area disruption selectively affects CA1/CA2 but not CA3 place fields during a differential reward working memory task. Hippocampus. 21:172-184.
56. Matsumoto M, Hikosaka O. 2009. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature. 459:837-841.
57. Mitchell KJ, Johnson MK. 2009. Source monitoring 15 years later: what have we learned from fMRI about the neural mechanisms of source memory? Psychol Bull. 135:638-677.
58. Montaldi D, Spencer TJ, Roberts N, Mayes AR. 2006. The neural system that mediates familiarity memory. Hippocampus. 16:504-520.
59. Murty VP, Labar KS, Adcock RA. 2012. Threat of punishment motivates memory encoding via amygdala, not midbrain, interactions with the medial temporal lobe. J Neurosci. 32:8969-8976.
60. Nazari-Serenjeh F, Rezayof A, Zarrindast MR. 2011. Functional correlation between GABAergic and dopaminergic systems of dorsal hippocampus and ventral tegmental area in passive avoidance learning in rats. Neuroscience. 196:104-114.
61. Nitschke JB, Sarinopoulos I, Mackiewicz KL, Schaefer HS, Davidson RJ. 2006. Functional neuroanatomy of aversion and its anticipation. Neuroimage. 29:106-116.
62. O'Carroll CM, Martin SJ, Sandin J, Frenguelli B, Morris RG. 2006. Dopaminergic modulation of the persistence of one-trial hippocampus-dependent memory. Learn Mem. 13:760-769.
63. O'Doherty J, Critchley H, Deichmann R, Dolan RJ. 2003. Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. J Neurosci. 23:7931-7939.
64. O'Doherty J, Kringelbach ML, Rolls ET, Hornak J, Andrews C. 2001. Abstract reward and punishment representations in the human or-bitofrontal cortex. Nat Neurosci. 4:95-102.
65. O'Doherty J, Winston J, Critchley H, Perrett D, Burt DM, Dolan RJ. 2003. Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness. Neuropsychologia. 41:147-155.
66. Olds J, Milner P. 1954. Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. J Comp Physiol Psychol. 47:419-427.
67. Otten LJ. 2007. Fragments of a larger whole: retrieval cues constrain observed neural correlates of memory encoding. Cereb Cortex. 17:2030-2038.
68. Paller KA, Wagner AD. 2002. Observing the transformation of experience into memory. Trends Cogn Sci. 6:93-102.
69. Peters J, Suchan B, Koster O, Daum I. 2007. Domain-specific retrieval of source information in the medial temporal lobe. Eur J Neurosci. 26:1333-1343.
70. Phillips ML, Young AW, Senior C, Brammer M, Andrew C, Calder AJ, Bullmore ET, Perrett DI, Rowland D, Williams SC et al. 1997. A specific neural substrate for perceiving facial expressions of disgust. Nature. 389:495-498.
71. Ploghaus A, Tracey I, Gati JS, Clare S, Menon RS, Matthews PM, Rawlins JN. 1999. Dissociating pain from its anticipation in the human brain. Science. 284:1979-1981.
72. Pribram KH, Maclean PD. 1953. Neuronographic analysis of medial and basal cerebral cortex. II. Monkey. J Neurophysiol. 16:324-340.
73. Ranganath C, Yonelinas AP, Cohen MX, Dy CJ, Tom SM, D'Esposito M. 2004. Dissociable correlates of recollection and familiarity within the medial temporal lobes. Neuropsychologia. 42:2-13.
74. Rasch B, Spalek K, Buholzer S, Luechinger R, Boesiger P, Papassotir-opoulos A, de Quervain DJ. 2009. A genetic variation of the nor-adrenergic system is related to differential amygdala activation during encoding of emotional memories. Proc Natl Acad Sci USA. 106:19191-19196.
75. Richardson MP, Strange BA, Dolan RJ. 2004. Encoding of emotional memories depends on amygdala and hippocampus and their interactions. Nat Neurosci. 7:278-285.
76. Rissman J, Gazzaley A, D'Esposito M. 2004. Measuring functional connectivity during distinct stages of a cognitive task. Neuroimage. 23:752-763.
77. Ritchey M, Dolcos F, Cabeza R. 2008. Role of amygdala connectivity in the persistence of emotional memories over time: an event-related FMRI investigation. Cereb Cortex. 18:2494-2504.
78. Rolls ET. 2007. Reward-and punishment-related learning; emotion and motivation. In: Memory, attention, and decision-making: a unifying computational neuroscience approach. 1st ed. UK: Oxford University Press. p. 113-261.
79. Rutecki PA, Grossman RG, Armstrong D, Irish-Loewen S. 1989. Elec-trophysiological connections between the hippocampus and en-torhinal cortex in patients with complex partial seizures. J Neurosurg. 70:667-675.
80. Samanez-Larkin GR, Gibbs SE, Khanna K, Nielsen L, Carstensen LL, Knutson B. 2007. Anticipation of monetary gain but not loss in healthy older adults. Nat Neurosci. 10:787-791.
81. Samson Y, Wu JJ, Friedman AH, Davis JN. 1990. Catecholaminergic innervation of the hippocampus in the cynomolgus monkey. J Comp Neurol. 298:250-263.
82. Schultz W. 1998. Predictive reward signal of dopamine neurons. J Neurophysiol. 80:1-27.
83. Schultz W, Dayan P, Montague PR. 1997. A neural substrate of prediction and reward. Science. 275:1593-1599.
84. Sescousse G, Redoute J, Dreher JC. 2010. The architecture of reward value coding in the human orbitofrontal cortex. J Neurosci. 30:13095-13104.
85. Seymour B, Singer T, Dolan R. 2007. The neurobiology of punishment. Nat Rev Neurosci. 8:300-311.
86. Shigemune Y, Abe N, Suzuki M, Ueno A, Mori E, Tashiro M, Itoh M, Fujii T. 2010. Effects of emotion and reward motivation on neural correlates of episodic memory encoding: a PET study. Neurosci Res. 67:72-79.
87. Small DM, Gregory MD, Mak YE, Gitelman D, Mesulam MM, Parrish T. 2003. Dissociation of neural representation of intensity and affective valuation in human gustation. Neuron. 39:701-711.
88. Smith BW, Mitchell DG, Hardin MG, Jazbec S, Fridberg D, Blair RJ, Ernst M. 2009. Neural substrates of reward magnitude, probability, and risk during a wheel of fortune decision-making task. Neuro-image. 44:600-609.
89. Sommer T, Rose M, Glascher J, Wolbers T, Buchel C. 2005. Dissociable contributions within the medial temporal lobe to encoding of object-location associations. Learn Mem. 12:343-351.
90. St Jacques PL, Dolcos F, Cabeza R. 2009. Effects of aging on functional connectivity of the amygdala for subsequent memory of negative pictures: a network analysis of functional magnetic resonance imaging data. Psychol Sci. 20:74-84.
91. Staudinger MR, Erk S, Abler B, Walter H. 2009. Cognitive reappraisal modulates expected value and prediction error encoding in the ventral striatum. Neuroimage. 47:713-721.
92. Swanson LW. 1982. The projections of the ventral tegmental area and adjacent regions: a combined fluorescent retrograde tracer and im-munofluorescence study in the rat. Brain Res Bull. 9:321-353.
93. Tsukiura T, Cabeza R. 2008. Orbitofrontal and hippocampal contributions to memory for face-name associations: the rewarding power of a smile. Neuropsychologia. 46:2310-2319.
94. Tsukiura T, Cabeza R. 2011. Remembering beauty: roles of orbitofron-tal and hippocampal regions in successful memory encoding of attractive faces. Neuroimage. 54:653-660.
95. Tsukiura T, Shigemune Y, Nouchi R, Kambara T, Kawashima R. 2012. Insular and hippocampal contributions to remembering people with an impression of bad personality. Soc Cogn Affect Neurosci. [Epub ahead of print].
96. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, Mazoyer B, Joliot M. 2002. Automated anatomical labeling of activations in SPM using a macroscopic anatomical par-cellation of the MNI MRI single-subject brain. Neuroimage. 15:273-289.
97. Uncapher MR, Otten LJ, Rugg MD. 2006. Episodic encoding is more than the sum of its parts: an fMRI investigation of multifeatural contextual encoding. Neuron. 52:547-556.
98. Uncapher MR, Rugg MD. 2005. Encoding and the durability of episodic memory: a functional magnetic resonance imaging study. J Neurosci. 25:7260-7267.
99. Ungless MA, Magill PJ, Bolam JP. 2004. Uniform inhibition of dopa-mine neurons in the ventral tegmental area by aversive stimuli. Science. 303:2040-2042.
100. Valentin VV, O'Doherty JP. 2009. Overlapping prediction errors in dorsal striatum during instrumental learning with juice and money reward in the human brain. J Neurophysiol. 102:3384-3391.
101. Wais PE. 2008. fMRI signals associated with memory strength in the medial temporal lobes: a meta-analysis. Neuropsychologia. 46:3185-3196.
102. Weis S, Specht K, Klaver P, Tendolkar I, Willmes K, Ruhlmann J, Elger CE, Fernandez G. 2004. Process dissociation between contextual retrieval and item recognition. Neuroreport. 15:2729-2733.
103. Wicker B, Keysers C, Plailly J, Royet JP, Gallese V, Rizzolatti G. 2003. Both of us disgusted in My insula: the common neural basis of seeing and feeling disgust. Neuron. 40:655-664.
104. Wittmann BC, Schiltz K, Boehler CN, Duzel E. 2008. Mesolimbic interaction of emotional valence and reward improves memory formation. Neuropsychologia. 46:1000-1008.
105. Wittmann BC, Schott BH, Guderian S, Frey JU, Heinze HJ, Duzel E. 2005. Reward-related fMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron. 45:459-467.
106. Wixted JT, Stretch V. 2004. In defense of the signal detection interpretation of remember/know judgments. Psychon Bull Rev. 11:616-641.
107. Worsley KJ, Marrett S, Neelin P, Vandal AC, Friston KJ, Evans AC. 1996. A unified statistical approach for determining significant signals in images of cerebral activation. Hum Brain Mapp. 4:58-73.
108. Wrase J, Kahnt T, Schlagenhauf F, Beck A, Cohen MX, Knutson B, Heinz A. 2007. Different neural systems adjust motor behavior in response to reward and punishment. Neuroimage. 36:1253-1262.
109. Yacubian J, Glascher J, Schroeder K, Sommer T, Braus DF, Buchel C. 2006. Dissociable systems for gain-and loss-related value predic tions and errors of prediction in the human brain. J Neurosci. 26:9530-9537.
110. Yefet K, Merhav M, Kuulmann-Vander S, Elkobi A, Belelovsky K, Jacobson-Pick S, Meiri N, Rosenblum K. 2006. Different signal transduction cascades are activated simultaneously in the rat insular cortex and hippocampus following novel taste learning. Eur J Neurosci. 24:1434-1442.
111. Yonelinas AP. 2001. Components of episodic memory: the contribution of recollection and familiarity. Philos Trans R Soc Lond B Biol Sci. 356:1363-1374.
112. Yonelinas AP. 2002. The nature of recollection and familiarity: a review of 30 years of research. J Mem Lang. 46:441-517.
113. Yonelinas AP, Kroll NE, Quamme JR, Lazzara MM, Sauve MJ, Widaman KF, Knight RT. 2002. Effects of extensive temporal lobe damage or mild hypoxia on recollection and familiarity. Nat Neurosci. 5:1236-1241.