Contextual interaction between novelty and reward processing within the mesolimbic system

Human Brain Mapping

Volumn 33, Issue 6, 2012, Pages 1309-1324

  Bunzeck, Nico ^a   Doeller, Christian F ^b,c,d   Dolan, Ray J ^e   Duzel, Emrah ^b,f  

^a UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

^d RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^e WELLCOME TRUST CENTRE FOR NEUROIMAGING   (United Kingdom)

^f OTTO VON GUERICKE UNIVERSITY   (Germany)

Author keywords

Exploration bonus; Hippocampus; Memory; Mesolimbic system; MOFC; Novelty; Reward; Substantia nigra ventral tegmental area; Ventral striatum

Indexed keywords

ADULT; ARTICLE; CORPUS STRIATUM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HIPPOCAMPUS; HUMAN; HUMAN EXPERIMENT; LEARNING; LIMBIC SYSTEM; LONG TERM MEMORY; MALE; MEDIAL ORBITOFRONTAL CORTEX; MEDIAL TEMPORAL LOBE; NEUROIMAGING; NORMAL HUMAN; NOVELTY; ORBITAL CORTEX; PRIORITY JOURNAL; REWARD; SUBSTANTIA NIGRA; TEMPORAL LOBE; VENTRAL TEGMENTUM;

ADULT; BASAL GANGLIA; BRAIN MAPPING; DISCRIMINATION (PSYCHOLOGY); EXPLORATORY BEHAVIOR; FEMALE; FRONTAL LOBE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MEMORY; MESENCEPHALON; NERVE NET; NEURAL PATHWAYS; NEUROPSYCHOLOGICAL TESTS; REWARD;

EID: 84860841120     PISSN: 10659471     EISSN: 10970193     Source Type: Journal    
DOI: 10.1002/hbm.21288     Document Type: Article

References (69)

1. Adcock RA, Thangavel A, Whitfield-Gabrieli S, Knutson B, Gabrieli JD. (2006): Reward-motivated learning: Mesolimbic activation precedes memory formation. Neuron 50: 507-517.
2. Andersson JL, Hutton C, Ashburner J, Turner R, Friston K. (2001): Modeling geometric deformations in EPI time series. Neuroimage 13: 903-919.
3. Ashburner J, Friston KJ. (1999): Nonlinear spatial normalization using basis functions. Hum Brain Mapp 7: 254-266.
4. Berridge KC. (2007): The debate over dopamine's role in reward: The case for incentive salience. Psychopharmacology (Berl) 191: 391-431.
5. Brown MW, Xiang JZ. (1998): Recognition memory: neuronal substrates of the judgement of prior occurrence. Prog Neurobiol 55: 149-189.
6. Bunzeck N, Duzel E. (2006): Absolute Coding of Stimulus Novelty in the Human Substantia Nigra/VTA. Neuron 51: 369-379.
7. Bunzeck N, Schutze H, Stallforth S, Kaufmann J, Duzel S, Heinze HJ, Duzel E. (2007): Mesolimbic novelty processing in older adults. Cereb Cortex 17: 2940-2948.
8. Bunzeck N, Doeller CF, Fuentemilla L, Dolan RJ, Duzel E. (2009): Reward motivation accelerates the onset of neural novelty signals in humans to 85 milliseconds. Curr Biol 19: 1294-1300.
9. Bunzeck N, Dayan P, Dolan RJ, Duzel E. (2010): A common mechanism for adaptive scaling of reward and novelty. Hum Brain Mapp 31: 1380-1394.
10. Deichmann R, Gottfried JA, Hutton C, Turner R. (2003): Optimized EPI for fMRI studies of the orbitofrontal cortex. Neuroimage 19(2 Pt 1): 430-441.
11. Devenport LD, Devenport JA, Holloway FA. (1981): Reward-induced stereotypy: Modulation by the hippocampus. Science 212: 1288-1289.
12. Dolan RJ, Fletcher PC. (1997): Dissociating prefrontal and hippocampal function in episodic memory encoding. Nature 388: 582-585.
13. Duzel E, Bunzeck N, Guitart-Masip M, Wittmann B, Schott BH, Tobler PN. (2009): Functional imaging of the human dopaminergic midbrain. Trends Neurosci 32: 321-328.
14. Eckert T, Sailer M, Kaufmann J, Schrader C, Peschel T, Bodammer N, Heinze HJ, Schoenfeld MA. (2004): Differentiation of idiopathic Parkinson's disease, multiple system atrophy, progressive supranuclear palsy, and healthy controls using magnetization transfer imaging. Neuroimage 21: 229-235.
15. Ferino F, Thierry AM, Glowinski J. (1987): Anatomical and electrophysiological evidence for a direct projection from Ammon's horn to the medial prefrontal cortex in the rat. Exp Brain Res 65: 421-426.
16. Fields HL, Hjelmstad GO, Margolis EB, Nicola SM. (2007): Ventral Tegmental Area Neurons in Learned Appetitive Behavior and Positive Reinforcement. Annu Rev Neurosci 30: 289-316.
17. Frey U, Morris RG. (1998): Synaptic tagging: implications for late maintenance of hippocampal long-term potentiation. Trends Neurosci 21: 181-188.
18. Frey U, Schroeder H, Matthies H. (1990): Dopaminergic antagonists prevent long-term maintenance of posttetanic LTP in the CA1 region of rat hippocampal slices. Brain Res 522: 69-75.
19. Friedman DP, Aggleton JP, Saunders RC. (2002): Comparison of hippocampal, amygdala, and perirhinal projections to the nucleus accumbens: combined anterograde and retrograde tracing study in the Macaque brain. J Comp Neurol 450: 345-365.
20. Friston KJ, Fletcher P, Josephs O, Holmes A, Rugg MD, Turner R. (1998): Event-related fMRI: characterizing differential responses. Neuroimage 7: 30-40.
21. Gasbarri A, Packard MG, Campana E, Pacitti C. (1994): Anterograde and retrograde tracing of projections from the ventral tegmental area to the hippocampal formation in the rat. Brain Res Bull 33: 445-452.
22. Gasbarri A, Sulli A, Packard MG. (1997): The dopaminergic mesencephalic projections to the hippocampal formation in the rat. Prog Neuropsychopharmacol Biol Psychiatry 21: 1-22.
23. Godden DR, Baddeley AD. (1975): Context-dependent memory in two natural environments: On land and underwater. British Journal of Psychology 66: 325-331.
24. Goto Y, Grace AA. (2008): Limbic and cortical information processing in the nucleus accumbens. Trends Neurosci 31: 552-558.
25. Helms G, Draganski B, Frackowiak R, Ashburner J, Weiskopf N. (2009): Improved segmentation of deep brain grey matter structures using magnetization transfer (MT) parameter maps. Neuroimage 47: 194-198.
26. Holscher C, Jacob W, Mallot HA. (2003): Reward modulates neuronal activity in the hippocampus of the rat. Behav Brain Res 142: 181-191.
27. Huang YY, Kandel ER. (1995): D1/D5 receptor agonists induce a protein synthesis-dependent late potentiation in the CA1 region of the hippocampus. Proc Natl Acad Sci U S A 92: 2446-2450.
28. Hutton C, Bork A, Josephs O, Deichmann R, Ashburner J, Turner R. (2002): Image distortion correction in fMRI: A quantitative evaluation. Neuroimage 16: 217-240.
29. Hutton C, Deichmann R, Turner R, Andersson JL. (2004): Combined correction for geometric distortion and its interaction with head motion in fMRI; Proceedings of ISMRM 12, Kyoto, Japan.
30. Ikemoto S. (2007): Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens-olfactory tubercle complex. Brain Res Rev 56: 27-78.
31. Jay TM. (2003): Dopamine: a potential substrate for synaptic plasticity and memory mechanisms. Prog Neurobiol 69: 375-390.
32. Johnson JD, Muftuler LT, Rugg MD. (2008): Multiple repetitions reveal functionally and anatomically distinct patterns of hippocampal activity during continuous recognition memory. Hippocampus 18: 975-980.
33. Kakade S, Dayan P. (2002): Dopamine: Generalization and bonuses. Neural Netw 15: 549-559.
34. Knight R. (1996): Contribution of human hippocampal region to novelty detection. Nature 383: 256-259.
35. Knutson B, Cooper JC. (2005): Functional magnetic resonance imaging of reward prediction. Curr Opin Neurol 18: 411-417.
36. Krebs RM, Schott BH, Schutze H, Duzel E. (2009): The novelty exploration bonus and its attentional modulation. Neuropsychologia 47: 2272-2281.
37. Li S, Cullen WK, Anwyl R, Rowan MJ. (2003): Dopamine-dependent facilitation of LTP induction in hippocampal CA1 by exposure to spatial novelty. Nat Neurosci 6: 526-531.
38. Lisman JE, Grace AA. (2005): The Hippocampal-VTA Loop: Controlling the Entry of Information into Long-Term Memory. Neuron 46: 703-713.
39. Ljungberg T, Apicella P, Schultz W. (1992): Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 67: 145-163.
40. Mesulam MM. (1998): From sensation to cognition. Brain 121 (Pt 6): 1013-1052.
41. Morris RG. (2006): Elements of a neurobiological theory of hippocampal function: The role of synaptic plasticity, synaptic tagging and schemas. Eur J Neurosci 23: 2829-2846.
42. Niv Y, Daw ND, Joel D, Dayan P. (2007): Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl) 191: 507-520.
43. O'Carroll CM, Martin SJ, Sandin J, Frenguelli B, Morris RG. (2006): Dopaminergic modulation of the persistence of one-trial hippocampus-dependent memory. Learn Mem 13: 760-769.
44. O'Doherty JP, Deichmann R, Critchley HD, Dolan RJ. (2002): Neural responses during anticipation of a primary taste reward. Neuron 33: 815-826.
45. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ. (2004): Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304: 452-454.
46. Ploghaus A, Tracey I, Clare S, Gati JS, Rawlins JN, Matthews PM. (2000): Learning about pain: The neural substrate of the prediction error for aversive events. Proc Natl Acad Sci U S A 97: 9281-9286.
47. Purves D, Bonardi C, Hall G. (1995): Enhancement of latent inhibition in rats with electrolytic lesions of the hippocampus. Behav Neurosci 109: 366-370.
48. Ranganath C, Rainer G. (2003): Neural mechanisms for detecting and remembering novel events. Nat Rev Neurosci 4: 193-202.
49. Rolls ET, Xiang JZ. (2005): Reward-spatial view representations and learning in the primate hippocampus. J Neurosci 25: 6167-6174.
50. Rosene DL, Van Hoesen GW. (1977): Hippocampal efferents reach widespread areas of cerebral cortex and amygdala in the rhesus monkey. Science 198: 315-317.
51. Selden NR, Gitelman DR, Salamon-Murayama N, Parrish TB, Mesulam MM. (1998): Trajectories of cholinergic pathways within the cerebral hemispheres of the human brain. Brain 121 (Pt 12): 2249-2257.
52. Smith Y, Kieval JZ. (2000): Anatomy of the dopamine system in the basal ganglia. Trends Neurosci 23(10 Suppl): S28-S33.
53. Sokolov EN. (1963): Higher nervous functions; the orienting reflex. Annu Rev Physiol 25: 545-580.
54. Solomon PR, Vander Schaaf ER, Thompson RF, Weisz DJ. (1986): Hippocampus and trace conditioning of the rabbit's classically conditioned nictitating membrane response. Behav Neurosci 100: 729-744.
55. Strange BA, Fletcher PC, Henson RN, Friston KJ, Dolan RJ. (1999): Segregating the functions of human hippocampus. Proc Natl Acad Sci U S A 96: 4034-4039.
56. Sutton RS, Barto AG. (1981): Toward a modern theory of adaptive networks: Expectation and prediction. Psychol Rev 88: 135-170.
57. Tabuchi ET, Mulder AB, Wiener SI. (2000): Position and behavioral modulation of synchronization of hippocampal and accumbens neuronal discharges in freely moving rats. Hippocampus 10: 717-728.
58. Thierry AM, Gioanni Y, Degenetais E, Glowinski J. (2000): Hippocampo-prefrontal cortex pathway: Anatomical and electrophysiological characteristics. Hippocampus 10: 411-419.
59. Tulving E. (1985): Memory and consciousness. Canadian Psychology 26: 1-12.
60. Weiner I. (2003): The "two-headed" latent inhibition model of schizophrenia: Modeling positive and negative symptoms and their treatment. Psychopharmacology (Berl) 169(3-4): 257-297.
61. Weiskopf N, Helms G. (2008): Multi-parameter mapping of the human brain at 1mm resolution in less than 20 minutes; ISMRM 16, Toronto, Canada.
62. Weiskopf N, Hutton C, Josephs O, Deichmann R. (2006): Optimal EPI parameters for reduction of susceptibility-induced BOLD sensitivity losses: A whole-brain analysis at 3 T and 1.5 T. Neuroimage 33: 493-504.
63. Wilson FA, Rolls ET. (1990a): Learning and memory is reflected in the responses of reinforcement-related neurons in the primate basal forebrain. J Neurosci 10: 1254-1267.
64. Wilson FA, Rolls ET. (1990b): Neuronal responses related to the novelty and familarity of visual stimuli in the substantia innominata, diagonal band of Broca and periventricular region of the primate basal forebrain. Exp Brain Res 80: 104-120.
65. Wirth S, Avsar E, Chiu CC, Sharma V, Smith AC, Brown E, Suzuki WA. (2009): Trial outcome and associative learning signals in the monkey hippocampus. Neuron 61: 930-940.
66. Wittmann BC, Schott BH, Guderian S, Frey JU, Heinze HJ, Duzel E. (2005): Reward-related FMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron 45: 459-467.
67. Wittmann BC, Bunzeck N, Dolan RJ, Duzel E. (2007): Anticipation of novelty recruits reward system and hippocampus while promoting recollection. Neuroimage 38: 194-202.
68. Wittmann BC, Daw ND, Seymour B, Dolan RJ. (2008): Striatal activity underlies novelty-based choice in humans. Neuron 58: 967-973.
69. Yamaguchi S, Hale LA, D'Esposito M, Knight RT. (2004): Rapid prefrontal-hippocampal habituation to novel events. J Neurosci 24: 5356-5363.