NOvelty-related Motivation of Anticipation and exploration by Dopamine (NOMAD): Implications for healthy aging

Neuroscience and Biobehavioral Reviews

Volumn 34, Issue 5, 2010, Pages 660-669

  Düzel, Emrah ^a,b   Bunzeck, Nico ^a   Guitart Masip, Marc ^a   Düzel, Sandra ^b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b OTTO VON GUERICKE UNIVERSITY   (Germany)

Author keywords

Aging; Consolidation; Dopamine; Hippocampus; Memory; Motivation; Novelty; Substantia nigra VTA

Indexed keywords

DOPAMINE;

AGING; ANTICIPATION; BODY MASS; DECLARATIVE MEMORY; DOPAMINERGIC NERVE CELL; DOPAMINERGIC SYSTEM; EXPLORATORY BEHAVIOR; HIPPOCAMPUS; HUMAN; LIMBIC SYSTEM; LONG TERM MEMORY; MEMORY DISORDER; MOTIVATION; NERVE CELL PLASTICITY; NEUROANATOMY; NEUROMODULATION; NEUROPATHOLOGY; NONHUMAN; PERSONALITY; PRIORITY JOURNAL; REVIEW; REWARD; SUBSTANTIA NIGRA; SYNAPTIC TRANSMISSION; VENTRAL TEGMENTUM; VERBAL MEMORY;

AGING; ANIMALS; BRAIN; DOPAMINE; EXPLORATORY BEHAVIOR; HUMANS; MODELS, NEUROLOGICAL; MOTIVATION;

EID: 77649339615     PISSN: 01497634     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neubiorev.2009.08.006     Document Type: Review

References (107)

1. Araki M., McGeer P.L., and McGeer E.G. Retrograde HRP tracing combined with a pharmacohistochemical method for GABA transaminase for the identification of presumptive GABAergic projections to the habenula. Brain Res. 304 (1984) 271-277
2. Backman L., Nyberg L., Lindenberger U., Li S.C., and Farde L. The correlative triad among aging, dopamine, and cognition: current status and future prospects. Neurosci. Biobehav. Rev. 30 (2006) 791-807
3. Bäckman L., Ginovart N., Dixon A.R., Wahlin T.B.R., Wahlin S.A., Halldin C., and Farde L. Age-related cognitive deficits mediated by changes in the striatal dopamine system. Am. J. Psychiatry 157 (2000) 635-637
4. Baddeley A., Cocchini G., Della Sala S., Logie R.H., and Spinnler H. Working memory and vigilance: evidence from normal aging and Alzheimer's disease. Brain Cogn. 41 (1999) 87-108
5. F. Ballarini, D. Moncada, M.C. Martineza, N. Alena, H. Viola, 2009. Behavioral tagging is a general mechanism of long-term memory formation. www.pnas.org cgi doi:10.1073pnas.0907078106.
6. Beckstead R.M., Domesick V.B., and Nauta W.J. Efferent connections of the substantia nigra and ventral tegmental area in the rat. Brain Res. 175 (1979) 191-217
7. Berridge K.C. Motivation concepts in behavioral neuroscience. Physiol. Behav. 81 (2004) 179-209
8. Berridge K.C. The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology (Berl) 191 (2007) 391-431
9. Boyle P.A., Wilson R.S., Aggarwal N.T., Arvanitakis Z., Kelly J., Bienias J.L., and Bennett D.A. Parkinsonian signs in subjects with mild cognitive impairment. Neurology 65 (2005) 1901-1906
10. Boyle P.A., Wilson R.S., Buchman A.S., Aggarwal N.T., Tang Y., Arvanitakis Z., Kelly J., and Bennett D.A. Lower extremity motor function and disability in mild cognitive impairment. Exp. Aging Res. 33 (2007) 355-371
11. Bromberg-Martin E.S., and Hikosaka O. Midbrain dopamine neurons signal preference for advance information about upcoming rewards. Neuron 63 (2009) 119-126
12. Buchman A.S., Wilson R.S., Boyle P.A., Bienias J.L., and Bennett D.A. Grip strength and the risk of incident Alzheimer's disease. Neuroepidemiology 29 (2007) 66-73
13. Buckner R.L., Andrews-Hanna J.R., and Schacter D.L. The brain's default network: anatomy, function, and relevance to disease. Ann. N.Y. Acad. Sci. 1124 (2008) 1-38
14. Bunzeck N., and Duzel E. Absolute coding of stimulus novelty in the human substantia nigra/VTA. Neuron 51 (2006) 369-379
15. Bunzeck N., Schutze H., Stallforth S., Kaufmann J., Duzel S., Heinze H.J., and Duzel E. Mesolimbic novelty processing in older adults. Cereb. Cortex 17 (2007) 2940-2948
16. Cardinal R.N., Parkinson J.A., Hall J., and Everitt B.J. Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci. Biobehav. Rev. 26 (2002) 321-352
17. Cervenka S., Backman L., Cselenyi Z., Halldin C., and Farde L. Associations between dopamine D2-receptor binding and cognitive performance indicate functional compartmentalization of the human striatum. Neuroimage 40 (2008) 1287-1295
18. Cortes R., Gueye B., Pazos A., Probst A., and Palacios J.M. Dopamine receptors in human brain: autoradiographic distribution of D1 sites. Neuroscience 28 (1989) 263-273
19. Cotman C.W., Berchtold N.C., and Christie L.A. Exercise builds brain health: key roles of growth factor cascades and inflammation. Trends Neurosci. 30 (2007) 464-472
20. Craik F.I., and Tulving E. Depth of processing and the retention of words in episodic memory. J. Exp. Psychol.: Gen. 104 (1975) 268-294
21. Dahlström A., and Fuxe K. Evidence for the existence of monoamine containing neurons in the central nervous system. I. Demonstration of monoamines in the cell bodies of brain stem neurons. Acta Physiol. Scand. 62 (1964) 1-80
22. Davis C.D., Jones F.L., and Derrick B.E. Novel environments enhance the induction and maintenance of long-term potentiation in the dentate gyrus. J. Neurosci. 24 (2004) 6497-6506
23. Duzel E., Vargha-Khadem F., Heinze H.J., and Mishkin M. Brain activity evidence for recognition without recollection after early hippocampal damage. Proc. Natl. Acad. Sci. U.S.A. 98 (2001) 8101-8106
24. Duzel S., Schutze H., Stallforth S., Kaufmann J., Bodammer N., Bunzeck N., Munte T.F., Lindenberger U., Heinze H.J., and Duzel E. A close relationship between verbal memory and SN/VTA integrity in young and older adults. Neuropsychologia 46 (2008) 3042-3052
25. Duzel E., Bunzeck N., Guitart-Masip M., Wittmann B., Schott B.H., and Tobler P.N. Functional imaging of the human dopaminergic midbrain. Trends Neurosci. 32 (2009) 321-328
26. Eckert T., Sailer M., Kaufmann J., Schrader C., Peschel T., Bodammer N., Heinze H.J., and Schoenfeld M.A. Differentiation of idiopathic Parkinson's disease, multiple system atrophy, progressive supranuclear palsy, and healthy controls using magnetization transfer imaging. Neuroimage 21 (2004) 229-235
27. Erixon-Lindroth N., Farde L., Wahlin T.B., Sovago J., Halldin C., and Backman L. The role of the striatal dopamine transporter in cognitive aging. Psychiatry Res. 138 (2005) 1-12
28. Fasano M., Bergamasco B., and Lopiano L. Is neuromelanin changed in Parkinson's disease? Investigations by magnetic spectroscopies. J. Neural Transm. 113 (2006) 769-774
29. Fearnley J.M., and Lees A.J. Ageing and Parkinson's disease: substantia nigra regional selectivity. Brain 114 Pt 5 (1991) 2283-2301
30. Fenker D.B., Frey J.U., Schuetze H., Heipertz D., Heinze H.J., and Duzel E. Novel scenes improve recollection and recall of words. J. Cogn. Neurosci. (2008)
31. Floresco S.B., West A.R., Ash B., Moore H., and Grace A.A. Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nat. Neurosci. 6 (2003) 968-973
32. Frank M.J., Seeberger L.C., and O'Reilly R.C. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306 (2004) 1940-1943
33. Freundlieb N., Francois C., Tande D., Oertel W.H., Hirsch E.C., and Hoglinger G.U. Dopaminergic substantia nigra neurons project topographically organized to the subventricular zone and stimulate precursor cell proliferation in aged primates. J. Neurosci. 26 (2006) 2321-2325
34. Frey J.U. Cell Polarity and Subcellular RNA Localization (2001), Springer-Verlag, Berlin-Heidelberg
35. Frey S., and Frey J.U. 'Synaptic tagging' and 'cross-tagging' and related associative reinforcement processes of functional plasticity as the cellular basis for memory formation. In: Sossin W.S., L J.-C., Castellucci V.F., and Belleville S. (Eds). Progress in Brain Research (2008), Elsevier
36. Frey U., and Morris R.G. Synaptic tagging and long-term potentiation [see comments]. Nature 385 (1997) 533-536
37. Frey U., and Morris R.G. Synaptic tagging: implications for late maintenance of hippocampal long-term potentiation. Trends Neurosci. 21 (1998) 181-188
38. Fudge J.L., and Haber S.N. Bed nucleus of the stria terminalis and extended amygdala inputs to dopamine subpopulations in primates. Neuroscience 104 (2001) 807-827
39. Geisler S., and Zahm D.S. Afferents of the ventral tegmental area in the rat-anatomical substratum for integrative functions. J. Comp. Neurol. 490 (2005) 270-294
40. Gould E. How widespread is adult neurogenesis in mammals?. Nat. Rev. Neurosci. 8 (2007) 481-488
41. Gould E., Beylin A., Tanapat P., Reeves A., and Shors T.J. Learning enhances adult neurogenesis in the hippocampal formation [see comments]. Nat. Neurosci. 2 (1999) 260-265
42. Govindarajan A., Kelleher R.J., and Tonegawa S. A clustered plasticity model of long-term memory engrams. Nat. Rev. Neurosci. 7 (2006) 575-583
43. Grace A.A., Floresco S.B., Goto Y., and Lodge D.J. Regulation of firing of dopaminergic neurons and control of goal-directed behaviors. Trends Neurosci. (2007)
44. Hooks M.S., and Kalivas P.W. The role of mesoaccumbens-pallidal circuitry in novelty-induced behavioral activation. Neuroscience 64 (1995) 587-597
45. Hyman S.E., Malenka R.C., and Nestler E.J. Neural mechanisms of addiction: the role of reward-related learning and memory. Annu. Rev. Neurosci. 29 (2006) 565-598
46. Kakade S., and Dayan P. Dopamine: generalization and bonuses. Neural Netw. 15 (2002) 549-559
47. Karpicke J.D., and Roediger III H.L. The critical importance of retrieval for learning. Science 319 (2008) 966-968
48. Knutson B., and Cooper J.C. Functional magnetic resonance imaging of reward prediction. Curr. Opin. Neurol. 18 (2005) 411-417
49. Knutson B., and Cooper J.C. The lure of the unknown. Neuron 51 (2006) 280-282
50. Knutson B., Fong G.W., Adams C.M., Varner J.L., and Hommer D. Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport 12 (2001) 3683-3687
51. Kray J., and Lindenberger U. Adult age differences in task switching. Psychol. Aging 15 (2000) 126-147
52. Krebs R.M., Schott B.H., and Duzel E. Personality traits are differentially associated with patterns of reward and novelty processing in the human substantia nigra/ventral tegmental area. Biol. Psychiatry 65 (2009) 103-110
53. Krebs R.M., Schott B.H., Schütze H., and Duzel E. The novelty exploration bonus and its attentional modulation. Neuropsychologia 47 11 (2009) 2272-2281
54. Kumaran D., and Duzel E. The hippocampus and dopaminergic midbrain: old couple, new insights. Neuron 60 (2008) 197-200
55. Li S.C., Lindenberger U., and Sikstrom S. Aging cognition: from neuromodulation to representation. Trends Cogn. Sci. 5 (2001) 479-486
56. Li S., Cullen W.K., Anwyl R., and Rowan M.J. Dopamine-dependent facilitation of LTP induction in hippocampal CA1 by exposure to spatial novelty. Nat. Neurosci. 6 (2003) 526-531
57. Lindenberger U., Marsiske M., and Baltes P.B. Memorizing while walking: increase in dual-task costs from young adulthood to old age. Psychol. Aging 15 (2000) 417-436
58. Lisman J.E., and Grace A.A. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 46 (2005) 703-713
59. Lundin-Olsson L., Nyberg L., and Gustafson Y. Stops walking when talking" as a predictor of falls in elderly people. Lancet 349 (1997) 617
60. McGaugh J.L. Emotional arousal and enhanced amygdala activity: new evidence for the old preservation-consolidation hypothesis. Learn. Mem. 12 (2005) 77-79
61. McHaffie J.G., Jiang H., May P.J., Coizet V., Overton P.G., Stein B.E., and Redgrave P. A direct projection from superior colliculus to substantia nigra pars compacta in the cat. Neuroscience 138 (2006) 221-234
62. Mesulam M. The cholinergic lesion of Alzheimer's disease: pivotal factor or side show?. Learn. Mem. 11 (2004) 43-49
63. Mesulam M.M., Geula C., Bothwell M.A., and Hersh L.B. Human reticular formation: cholinergic neurons of the pedunculopontine and laterodorsal tegmental nuclei and some cytochemical comparisons to forebrain cholinergic neurons. J. Comp. Neurol. 283 (1989) 611-633
64. Mishkin M., Vargha-Khadem F., and Gadian D.G. Amnesia and the organization of the hippocampal system. Hippocampus 8 (1998) 212-216
65. Mozley L.H., Gur R.C., Mozley P.D., and Gur R.E. Striatal dopamine transporters and cognitive functioning in healthy men and women. Am. J. Psychiatry 158 (2001) 1492-1499
66. Nair-Roberts R.G., Chatelain-Badie S.D., Benson E., White-Cooper H., Bolam J.P., and Ungless M.A. Stereological estimates of dopaminergic, GABAergic and glutamatergic neurons in the ventral tegmental area, substantia nigra and retrorubral field in the rat. Neuroscience 152 (2008) 1024-1031
67. Nestor P.J., Fryer T.D., Ikeda M., and Hodges J.R. Retrosplenial cortex (BA 29/30) hypometabolism in mild cognitive impairment (prodromal Alzheimer's disease). Eur. J. Neurosci. 18 (2003) 2663-2667
68. Niv Y., Joel D., and Dayan P. A normative perspective on motivation. Trends Cogn. Sci. 10 (2006) 375-381
69. Niv Y., Daw N.D., Joel D., and Dayan P. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl) 191 (2007) 507-520
70. O'Carroll C.M., Martin S.J., Sandin J., Frenguelli B., and Morris R.G. Dopaminergic modulation of the persistence of one-trial hippocampus-dependent memory. Learn. Mem. 13 (2006) 760-769
71. O'Doherty J.P., Dayan P., Friston K., Critchley H., and Dolan R.J. Temporal difference models and reward-related learning in the human brain. Neuron 38 (2003) 329-337
72. Panksepp J. Affective Neuroscience: The Foundations of Human and Animal Emotions (1998), Oxford University Press, New York
73. Parkin A.J. Human memory. Curr. Biol. 9 (1999) R582-R585
74. Parkinson J.A., Dalley J.W., Cardinal R.N., Bamford A., Fehnert B., Lachenal G., Rudarakanchana N., Halkerston K.M., Robbins T.W., and Everitt B.J. Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlovian approach behaviour: implications for mesoaccumbens dopamine function. Behav. Brain Res. 137 (2002) 149-163
75. Pessiglione M., Seymour B., Flandin G., Dolan R.J., and Frith C.D. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442 (2006) 1042-1045
76. Price J.L., and Amaral D.G. An autoradiographic study of the projections of the central nucleus of the monkey amygdala. J. Neurosci. 1 (1981) 1242-1259
77. Reed P., Mitchell C., and Nokes T. Intrinsic reinforcing properties of putatively neutral stimuli in an instrumental two-lever discrimination task. Anim. Learn. Behav. 24 (1996) 38-45
78. Rinne J.O., Lonnberg P., and Marjamaki P. Age-dependent decline in human brain dopamine D1 and D2 receptors. Brain Res. 508 (1990) 349-352
79. Robbins T.W., and Everitt B.J. A role for mesencephalic dopamine in activation: commentary on Berridge (2006). Psychopharmacology (Berl) 191 (2007) 433-437
80. Robinson T.E., and Flagel S.B. Dissociating the predictive and incentive motivational properties of reward-related cues through the study of individual differences. Biol. Psychiatry (2008)
81. Ross G.W., Petrovitch H., Abbott R.D., Nelson J., Markesbery W., Davis D., Hardman J., Launer L., Masaki K., Tanner C.M., and White L.R. Parkinsonian signs and substantia nigra neuron density in decendents elders without PD. Ann. Neurol. 56 (2004) 532-539
82. Ruprecht-Dorfler P., Klotz P., Becker G., and Berg D. Substantia nigra hyperechogenicity correlates with subtle motor dysfunction in tap dancers. Parkinsonism Relat. Disord. 13 (2007) 362-364
83. Sajikumar S., and Frey J.U. Late-associativity, synaptic tagging, and the role of dopamine during LTP and LTD. Neurobiol. Learn. Mem. 82 (2004) 12-25
84. Salthouse T.A. Aging and measures of processing speed. Biol. Psychol. 54 (2000) 35-54
85. Schott B.H., Sellner D.B., Lauer C.J., Habib R., Frey J.U., Guderian S., Heinze H.J., and Duzel E. Activation of midbrain structures by associative novelty and the formation of explicit memory in humans. Learn. Mem. 11 (2004) 383-387
86. Schott B.H., Niehaus L., Wittmann B.C., Schutze H., Seidenbecher C.I., Heinze H.J., and Duzel E. Ageing and early-stage Parkinson's disease affect separable neural mechanisms of mesolimbic reward processing. Brain 130 (2007) 2412-2424
87. Schott B.H., Minuzzi L., Krebs R.M., Elmenhorst D., Lang M., Winz O.H., Seidenbecher C.I., Coenen H.H., Heinze H.J., Zilles K., Duzel E., and Bauer A. Mesolimbic functional magnetic resonance imaging activations during reward anticipation correlate with reward-related ventral striatal dopamine release. J. Neurosci. 28 (2008) 14311-14319
88. Schultz W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80 (1998) 1-27
89. Schultz W. Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology. Curr. Opin. Neurobiol. 14 (2004) 139-147
90. Seeman P., Bzowej N.H., Guan H.C., Bergeron C., Becker L.E., Reynolds G.P., Bird E.D., Riederer P., Jellinger K., Watanabe S., et al. Human brain dopamine receptors in children and aging adults. Synapse 1 (1987) 399-404
91. Seppi K., and Schocke M.F. An update on conventional and advanced magnetic resonance imaging techniques in the differential diagnosis of neurodegenerative parkinsonism. Curr. Opin. Neurol. 18 (2005) 370-375
92. Sesack S.R., Carr D.B., Omelchenko N., and Pinto A. Anatomical substrates for glutamate-dopamine interactions: evidence for specificity of connections and extrasynaptic actions. Ann. N. Y. Acad. Sci. 1003 (2003) 36-52
93. Smiley J.F., Subramanian M., and Mesulam M.M. Monoaminergic-cholinergic interactions in the primate basal forebrain. Neuroscience 93 (1999) 817-829
94. Snow B.J., Tooyama I., McGeer E.G., Yamada T., Calne D.B., Takahashi H., and Kimura H. Human positron emission tomographic [18F]fluorodopa studies correlate with dopamine cell counts and levels. Ann. Neurol. 34 (1993) 324-330
95. Squire L.R., Stark C.E., and Clark R.E. The medial temporal lobe. Annu. Rev. Neurosci. 27 (2004) 279-306
96. Straube T., Korz V., Balschun D., and Frey J.U. Requirement of beta-adrenergic receptor activation and protein synthesis for LTP-reinforcement by novelty in rat dentate gyrus. J. Physiol. 552 (2003) 953-960
97. Sutton R.S., and Barto A.G. Reinforcement Learning (1998), MIT Press, Cambridge, MA
98. Talmi D., Seymour B., Dayan P., and Dolan R.J. Human pavlovian-instrumental transfer. J. Neurosci. 28 (2008) 360-368
99. Volkow N.D., Gur R.C., Wang G.J., Fowler J.S., Moberg P.J., Ding Y.S., Hitzemann R., Smith G., and Logan J. Association between decline in brain dopamine activity with age and cognitive and motor impairment in healthy individuals. Am. J. Psychiatry 155 (1998) 344-349
100. Wang H.X., Karp A., Herlitz A., Crowe M., Kareholt I., Winblad B., and Fratiglioni L. Personality and lifestyle in relation to dementia incidence. Neurology 72 (2009) 253-259
101. Weiner I. The "two-headed" latent inhibition model of schizophrenia: modeling positive and negative symptoms and their treatment. Psychopharmacology (Berl) 169 (2003) 257-297
102. Wirtshafter D., Stratford T.R., and Asin K.E. Evidence that serotonergic projections to the substantia nigra in the rat arise in the dorsal, but not the median, raphe nucleus. Neurosci. Lett. 77 (1987) 261-266
103. Witte A.V., Fobker M., Gellner R., Knecht S., and Floel A. Caloric restriction improves memory in elderly humans. Proc. Natl. Acad. Sci. U.S.A. 106 (2009) 1255-1260
104. Wittmann B.C., Schott B.H., Guderian S., Frey J.U., Heinze H.J., and Duzel E. Reward-related FMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron 45 (2005) 459-467
105. Wittmann B.C., Bunzeck N., Dolan R.J., and Duzel E. Anticipation of novelty recruits reward system and hippocampus while promoting recollection. Neuroimage 38 (2007) 194-202
106. Wittmann B.C., Daw N.D., Seymour B., and Dolan R.J. Striatal activity underlies novelty-based choice in humans. Neuron 58 (2008) 967-973
107. Zald D.H., Cowan R.L., Riccardi P., Baldwin R.M., Ansari M.S., Li R., Shelby E.S., Smith C.E., McHugo M., and Kessler R.M. Midbrain dopamine receptor availability is inversely associated with novelty-seeking traits in humans. J. Neurosci. 28 (2008) 14372-14378