Dopamine and adaptive memory

Trends in Cognitive Sciences

Volumn 14, Issue 10, 2010, Pages 464-472

  Shohamy, Daphna ^a   Adcock, R Alison ^b  

^a Och Spine at New York Presbyterian Hospitals   (United States)

^b DUKE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE BEHAVIOR; ADAPTIVE MEMORY; BRAIN SYSTEMS; LONG TERM MEMORY; TIME-SCALES;

BRAIN;

DOPAMINE;

ADAPTIVE BEHAVIOR; ADAPTIVE MEMORY; HIPPOCAMPUS; HUMAN; LEARNING; MEMORY; MOTIVATION; NEUROIMAGING; NONHUMAN; REVIEW;

ADAPTATION, PSYCHOLOGICAL; ANIMALS; BRAIN; DOPAMINE; HIPPOCAMPUS; HUMANS; MEMORY; MOTIVATION; NEUROTRANSMITTER AGENTS;

EID: 77956880130     PISSN: 13646613     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.tics.2010.08.002     Document Type: Review

References (99)

1. Eichenbaum H.E., Cohen N.J. From Conditioning to Conscious Recollection: Memory Systems of the Brain 2001, Oxford University Press.
2. Davachi L. Item, context and relational episodic encoding in humans. Curr. Opin. Neurobiol. 2006, 16:693-700.
3. Squire L.R. Memory and the hippocampus: a synthesis from findings with rats, monkeys, and humans. Psychol. Rev. 1992, 99:195-231.
4. Paller K.A., Wagner A.D. Observing the transformation of experience into memory. Trends. Cogn. Sci. 2002, 6:93-102.
5. Scoville W.B., Milner B. Loss of recent memory after bilateral hippocampal lesions. J. Neurol. Neurosurg. Psychiatry 1957, 20:11-21.
6. Gabrieli J.D. Cognitive neuroscience of human memory. Annu. Rev. Psychol. 1998, 49:87-115.
7. Wirth S., et al. Trial outcome and associative learning signals in the monkey hippocampus. Neuron 2009, 61:930-940.
8. Johnson A., Redish A.D. Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. J. Neurosci. 2007, 27:12176-12189.
9. Hassabis D., et al. Patients with hippocampal amnesia cannot imagine new experiences. Proc. Natl. Acad. Sci. U. S. A. 2007, 104:1726-1731.
10. Schacter D.L., Addis D.R. The cognitive neuroscience of constructive memory: remembering the past and imagining the future. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2007, 362:773-786.
11. Peters J., Buchel C. Episodic future thinking reduces reward delay discounting through an enhancement of prefrontal-mediotemporal interactions. Neuron 2010, 66:138-148.
12. Shohamy D., Wagner A.D. Integrating memories in the human brain: hippocampal-midbrain encoding of overlapping events. Neuron 2008, 60:378-389.
13. Schultz W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 1998, 80:1-27.
14. Daw N.D., Doya K. The computational neurobiology of learning and reward. Curr. Opin. Neurobiol. 2006, 16:199-204.
15. Matsumoto M., Hikosaka O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 2009, 459:837-841.
16. Delgado M.R., et al. Avoiding negative outcomes: tracking the mechanisms of avoidance learning in humans during fear conditioning. Front. Behav. Neurosci. 2009, 3:33.
17. Carter R.M., et al. Activation in the VTA and nucleus accumbens increases in anticipation of both gains and losses. Front. Behav. Neurosci. 2009, 3:21.
18. Mazzoni P., et al. Why don't we move faster? Parkinson's disease, movement vigor, and implicit motivation. J. Neurosci. 2007, 27:7105-7116.
19. Berridge K.C. The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology 2007, 191:391-431.
20. Salamone J.D., et al. Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology 2007, 191:461-482.
21. Niv Y., et al. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology. 2007, 191:507-520.
22. Robbins T.W., Everitt B.J. A role for mesencephalic dopamine in activation: commentary on Berridge (2006). Psychopharmacology 2007, 191:433-437.
23. Redgrave P., et al. What is reinforced by phasic dopamine signals?. Brain Res. Rev. 2008, 58:322-339.
24. Samson Y., et al. Catecholaminergic innervation of the hippocampus in the cynomolgus monkey. J. Comp. Neurol. 1990, 298:250-263.
25. Gasbarri A., et al. Anterograde and retrograde tracing of projections from the ventral tegmental area to the hippocampal formation in the rat. Brain Res. Bull. 1994, 33:445-452.
26. Otmakhova N.A., Lisman J.E. D1/D5 dopamine receptors inhibit depotentiation at CA1 synapses via cAMP-dependent mechanism. J. Neurosci. 1998, 18:1270-1279.
27. Huang Y.Y., Kandel E.R. D1/D5 receptor agonists induce a protein synthesis-dependent late potentiation in the CA1 region of the hippocampus. Proc. Natl. Acad. Sci. U. S. A. 1995, 92:2446-2450.
28. Frey U., et al. Dopaminergic antagonists prevent long-term maintenance of posttetanic LTP in the CA1 region of rat hippocampal slices. Brain Res. 1990, 522:69-75.
29. O'Carroll C.M., et al. Dopaminergic modulation of the persistence of one-trial hippocampus-dependent memory. Learn. Mem. 2006, 13:760-769.
30. Rossato J.I., et al. Dopamine controls persistence of long-term memory storage. Science 2009, 325:1017-1020.
31. Bethus I., et al. Dopamine and memory: modulation of the persistence of memory for novel hippocampal NMDA receptor-dependent paired associates. J. Neurosci. 2010, 30:1610-1618.
32. Neugebauer F., et al. Modulation of extracellular monoamine transmitter concentrations in the hippocampus after weak and strong tetanization of the perforant path in freely moving rats. Brain Res. 2009, 1273:29-38.
33. Lisman J.E., Grace A.A. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 2005, 46:703-713.
34. Frank M.J., et al. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 2004, 306:1940-1943.
35. Knowlton B.J., et al. A neostriatal habit learning system in humans. Science 1996, 273:1399-1402.
36. Shohamy D., et al. Basal ganglia and dopamine contributions to probabilistic category learning. Neurosci. Biobehav. Rev. 2008, 32:219-236.
37. Schott B.H., et al. Mesolimbic functional magnetic resonance imaging activations during reward anticipation correlate with reward-related ventral striatal dopamine release. J. Neurosci. 2008, 28:14311-14319.
38. Kumaran D., Maguire E.A. An unexpected sequence of events: mismatch detection in the human hippocampus. PLoS Biol. 2006, 4:e424.
39. Kirchhoff B.A., et al. Prefrontal-temporal circuitry for episodic encoding and subsequent memory. J. Neurosci. 2000, 20:6173-6180.
40. Schott B.H., et al. Activation of midbrain structures by associative novelty and the formation of explicit memory in humans. Learn. Mem. 2004, 11:383-387.
41. Axmacher N., et al. Intracranial EEG correlates of expectancy and memory formation in the human hippocampus and nucleus accumbens. Neuron 2010, 65:541-549.
42. Schott B.H., et al. The dopaminergic midbrain participates in human episodic memory formation: evidence from genetic imaging. J. Neurosci. 2006, 26:1407-1417.
43. Li S., et al. Dopamine-dependent facilitation of LTP induction in hippocampal CA1 by exposure to spatial novelty. Nat. Neurosci. 2003, 6:526-531.
44. Fenker D.B., et al. Novel scenes improve recollection and recall of words. J. Cogn. Neurosci. 2008, 20:1250-1265.
45. Zald D.H., et al. Midbrain dopamine receptor availability is inversely associated with novelty-seeking traits in humans. J. Neurosci. 2008, 28:14372-14378.
46. Wittmann B.C., et al. Mesolimbic interaction of emotional valence and reward improves memory formation. Neuropsychologia 2008, 46:1000-1008.
47. Guitart-Masip M., et al. Contextual novelty changes reward representations in the striatum. J. Neurosci. 2010, 30:1721-1726.
48. Bunzeck N., et al. A common mechanism for adaptive scaling of reward and novelty. Hum. Brain Mapp. 2010, 31:1380-1394.
49. Bunzeck N., et al. Reward motivation accelerates the onset of neural novelty signals in humans to 85 milliseconds. Curr. Biol. 2009, 19:1294-1300.
50. Knutson B., et al. Distributed neural representation of expected value. J. Neurosci. 2005, 25:4806-4812.
51. D'Ardenne K., et al. BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 2008, 319:1264-1267.
52. Wittmann B.C., et al. Reward-related FMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron 2005, 45:459-467.
53. Krebs R.M., et al. The novelty exploration bonus and its attentional modulation. Neuropsychologia 2009, 47:2272-2281.
54. Adcock R.A., et al. Reward-motivated learning: mesolimbic activation precedes memory formation. Neuron 2006, 50:507-517.
55. Kuhl B.A., et al. Resistance to forgetting associated with hippocampus-mediated reactivation during new learning. Nat. Neurosci. 2010, 13:501-506.
56. Cohen N.J., Eichenbaum H. Memory, amnesia, and the hippocampal system 1993, MIT Press.
57. Heckers S., et al. Hippocampal activation during transitive inference in humans. Hippocampus 2004, 14:153-162.
58. O'Carroll C.M., Morris R.G. Heterosynaptic co-activation of glutamatergic and dopaminergic afferents is required to induce persistent long-term potentiation. Neuropharmacology 2004, 47:324-332.
59. Otmakhova N.A., Lisman J.E. D1/D5 dopamine receptor activation increases the magnitude of early long-term potentiation at CA1 hippocampal synapses. J. Neurosci. 1996, 16:7478-7486.
60. Lansink C.S., et al. Hippocampus leads ventral striatum in replay of place-reward information. PLoS Biol. 2009, 7:e1000173.
61. Singer A.C., Frank L.M. Rewarded outcomes enhance reactivation of experience in the hippocampus. Neuron 2009, 64:910-921.
62. Lindsten, J. (1992) Nobel Lectures in Physiology or Medicine, World Scientific Publishing Co. 690.
63. Lodge D.J., Grace A.A. The hippocampus modulates dopamine neuron responsivity by regulating the intensity of phasic neuron activation. Neuropsychopharmacology 2006, 31:1356-1361.
64. Zweifel L.S., et al. Disruption of NMDAR-dependent burst firing by dopamine neurons provides selective assessment of phasic dopamine-dependent behavior. Proc. Natl. Acad. Sci. U. S. A. 2009, 106:7281-7288.
65. Floresco S.B. Dopaminergic regulation of limbic-striatal interplay. J. Psychiatry Neurosci. 2007, 32:400-411.
66. Astafiev S.V., et al. Comment on " Modafinil shifts human locus coeruleus to low-tonic, high-phasic activity during functional MRI" and " Homeostatic sleep pressure and responses to sustained attention in the suprachiasmatic area" Science 2010, 328:309.
67. Duzel E., et al. Functional imaging of the human dopaminergic midbrain. Trends Neurosci. 2009, 32:321-328.
68. Knutson B., Gibbs S.E. Linking nucleus accumbens dopamine and blood oxygenation. Psychopharmacology 2007, 191:813-822.
69. Bertolino A., et al. Epistasis between dopamine regulating genes identifies a nonlinear response of the human hippocampus during memory tasks. Biol. Psychiatry 2008, 64:226-234.
70. Shohamy D., et al. L-dopa impairs learning, but spares generalization, in Parkinson's disease. Neuropsychologia 2006, 44:774-784.
71. Volkow N.D., et al. Dopamine increases in striatum do not elicit craving in cocaine abusers unless they are coupled with cocaine cues. Neuroimage 2008, 39:1266-1273.
72. Cools R., et al. Striatal dopamine predicts outcome-specific reversal learning and its sensitivity to dopaminergic drug administration. J. Neurosci. 2009, 29:1538-1543.
73. Bauer E.P., et al. Gamma oscillations coordinate amygdalo-rhinal interactions during learning. J. Neurosci. 2007, 27:9369-9379.
74. Popescu A.T., et al. Coherent gamma oscillations couple the amygdala and striatum during learning. Nat. Neurosci. 2009, 12:801-807.
75. Dolcos F., et al. Interaction between the amygdala and the medial temporal lobe memory system predicts better memory for emotional events. Neuron 2004, 42:855-863.
76. Ritchey M., et al. Cereb. Cortex 2008, 18:2494-2504.
77. Poldrack R.A., Rodriguez P. How do memory systems interact? Evidence from human classification learning. Neurobiol. Learn. Mem. 2004, 82:324-332.
78. Hartley T., Burgess N. Complementary memory systems: competition, cooperation and compensation. Trends Neurosci. 2005, 28:169-170.
79. Kroener S., et al. Dopamine modulates persistent synaptic activity and enhances the signal-to-noise ratio in the prefrontal cortex. PLoS One 2009, 4:e6507.
80. Peters Y., et al. Prefrontal cortical up states are synchronized with ventral tegmental area activity. Synapse 2004, 52:143-152.
81. Gao W.J., Goldman-Rakic P.S. Selective modulation of excitatory and inhibitory microcircuits by dopamine. Proc. Natl. Acad. Sci. U. S. A. 2003, 100:2836-2841.
82. Beck S.M., et al. Primary and secondary rewards differentially modulate neural activity dynamics during working memory. PLoS One 2010, 5:e9251.
83. Delgado M.R., et al. An fMRI study of reward-related probability learning. Neuroimage 2005, 24:862-873.
84. Sara S.J. The locus coeruleus and noradrenergic modulation of cognition. Nat. Rev. Neurosci. 2009, 10:211-223.
85. Kenney J.W., Gould T.J. Modulation of hippocampus-dependent learning and synaptic plasticity by nicotine. Mol. Neurobiol. 2008, 38:101-121.
86. Bergson C., et al. Regional, cellular, and subcellular variations in the distribution of D1 and D5 dopamine receptors in primate brain. J. Neurosci. 1995, 15:7821-7836.
87. Floresco S.B., et al. Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nat. Neurosci. 2003, 6:968-973.
88. Paspalas C.D., Goldman-Rakic P.S. Microdomains for dopamine volume neurotransmission in primate prefrontal cortex. J. Neurosci. 2004, 24:5292-5300.
89. Little K.Y., et al. Characterization and localization of [125I]RTI-121 binding sites in human striatum and medial temporal lobe. J. Pharmacol. Exp. Ther. 1995, 274:1473-1483.
90. Khan Z.U., et al. Dopamine D5 receptors of rat and human brain. Neuroscience 2000, 100:689-699.
91. Camps M., et al. Autoradiographic localization of dopamine D 1 and D 2 receptors in the brain of several mammalian species. J. Neural Transm. Gen. Sect. 1990, 80:105-127.
92. Lewis D.A., et al. Dopamine transporter immunoreactivity in monkey cerebral cortex: regional, laminar, and ultrastructural localization. J. Comp. Neurol. 2001, 432:119-136.
93. Ciliax B.J., et al. Dopamine D(5) receptor immunolocalization in rat and monkey brain. Synapse 2000, 37:125-145.
94. Jiao X., et al. Strain differences in the distribution of dopamine transporter sites in rat brain. Prog. Neuropsychopharmacol. Biol. Psychiatry 2003, 27:913-919.
95. Fiorillo C.D., et al. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
96. Williams S.M., Goldman-Rakic P.S. Characterization of the dopaminergic innervation of the primate frontal cortex using a dopamine-specific antibody. Cereb. Cortex 1993, 3:199-222.
97. Oades R.D., Halliday G.M. Ventral tegmental (A10) system: neurobiology. 1. Anatomy and connectivity. Brain Res. 1987, 434:117-165.
98. Sesack S.R., Grace A.A. Cortico-Basal Ganglia reward network: microcircuitry. Neuropsychopharmacology 2010, 35:27-47.
99. Morris R.G., et al. Elements of a neurobiological theory of the hippocampus: the role of activity-dependent synaptic plasticity in memory. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2003, 358:773-786.