Reward-based decision-making and aging

Brain Research Bulletin

Volumn 67, Issue 5, 2005, Pages 382-390

  Marschner, A ^a   Mell, T ^a   Wartenburger, I ^a,b   Villringer, A ^a   Reischies, F M ^a   Heekeren, H R ^a  

^a CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

^b OTTO VON GUERICKE UNIVERSITY   (Germany)

Author keywords

Aging; Dopamine; fMRI; Neuroimaging; PFC; Reward; Reward association learning; Striatum

Indexed keywords

AGING; COGNITION; CONFERENCE PAPER; CORRELATION ANALYSIS; DECISION MAKING; DEGENERATIVE DISEASE; DOPAMINERGIC SYSTEM; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; LEARNING; MEMORY; NEUROANATOMY; NEUROBIOLOGY; NEUROECONOMICS; NEUROIMAGING; NEUROPHYSIOLOGY; NEUROSCIENCE; NONHUMAN; PRIORITY JOURNAL; REINFORCEMENT; REWARD; SEROTONINERGIC SYSTEM; STIMULUS RESPONSE; TASK PERFORMANCE; WORKING MEMORY;

AGING; ANIMALS; BRAIN; COGNITION DISORDERS; DECISION MAKING; DISEASE MODELS, ANIMAL; HUMANS; LEARNING DISORDERS; MEMORY DISORDERS; NEURAL PATHWAYS; REWARD;

EID: 26244452546     PISSN: 03619230     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.brainresbull.2005.06.010     Document Type: Conference Paper

References (99)

1. G.K. Aguirre, E. Zarahn, and M. D'Esposito The variability of human, BOLD hemodynamic responses Neuroimage 8 1998 360 369
2. M.S. Albert Age-related changes in cognitive function M.L. Albert J.E. Knoefel Clinical Neurobiology of Aging 1994 Oxford University Press New York 314 328
3. L. Backman, N. Ginovart, R.A. Dixon, T.B. Wahlin, A. Wahlin, C. Halldin, and L. Farde Age-related cognitive deficits mediated by changes in the striatal dopamine system Am. J. Psychiatry 157 2000 635 637
4. R.T. Bartus, R.L. Dean III, and D.L. Fleming Aging in the rhesus monkey: effects on visual discrimination learning and reversal learning J. Gerontol. 34 1979 209 219
5. M.G. Baxter, and E.A. Murray The amygdala and reward Nat. Rev. Neurosci. 3 2002 563 573
6. A. Bechara Neurobiology of decision-making: risk and reward Semin. Clin. Neuropsychiatry 6 2001 205 216
7. A. Bechara, A.R. Damasio, H. Damasio, and S.W. Anderson Insensitivity to future consequences following damage to human prefrontal cortex Cognition 50 1994 7 15
8. G.S. Berns, S.M. McClure, G. Pagnoni, and P.R. Montague Predictability modulates human brain response to reward J. Neurosci. 21 2001 2793 2798
9. H. Braak, E. Braak, and J. Bohl Staging of Alzheimer-related cortical destruction Eur. Neurol. 33 1993 403 408
10. T.S. Braver, and D.M. Barch A theory of cognitive control, aging cognition, and neuromodulation Neurosci. Biobehav. Rev. 26 2002 809 817
11. H.C. Breiter, I. Aharon, D. Kahneman, A. Dale, and P. Shizgal Functional imaging of neural responses to expectancy and experience of monetary gains and losses Neuron 30 2001 619 639
12. R. Cabeza, and L. Nyberg Neural bases of learning and memory: functional neuroimaging evidence Curr. Opin. Neurol. 13 2000 415 421
13. R. Cabeza, N.D. Anderson, J.K. Locantore, and A.R. McIntosh Aging gracefully: compensatory brain activity in high-performing older adults Neuroimage 17 2002 1394 1402
14. F.I.M. Craik, and J.M. Jennings Human memory F.I.M. Craik T.A. Salthouse Handbook of Aging and Cognition 1992 Erlbaum Hillsdale, NJ 51 109
15. S. Daigneault, and C.M. Braun Working memory and the self-ordered pointing task: further evidence of early prefrontal decline in normal aging J. Clin. Exp. Neuropsychol. 15 1993 881 895
16. J. Deakin, M. Aitken, T. Robbins, and B.J. Sahakian Risk taking during decision-making in normal volunteers changes with age J. Int. Neuropsychol. Soc. 10 2004 590 598
17. M. D'Esposito, L.Y. Deouell, and A. Gazzaley Alterations in the BOLD fMRI signal with ageing and disease: a challenge for neuroimaging Nat. Rev. Neurosci. 4 2003 863 872
18. R. Elliott, R.J. Dolan, and C.D. Frith Dissociable functions in the medial and lateral orbitofrontal cortex: evidence from human neuroimaging studies Cereb. Cortex 10 2000 308 317
19. R. Elliott, C.D. Frith, and R.J. Dolan Differential neural response to positive and negative feedback in planning and guessing tasks Neuropsychologia 35 1997 1395 1404
20. G. Esposito, B.S. Kirkby, J.D. Van Horn, T.M. Ellmore, and K.F. Berman Context-dependent, neural system-specific neurophysiological concomitants of ageing: mapping PET correlates during cognitive activation Brain 122 Pt 5 1999 963 979
21. C.D. Fiorillo, P.N. Tobler, and W. Schultz Discrete coding of reward probability and uncertainty by dopamine neurons Science 299 2003 1898 1902
22. M. Freedman, and M. Oscar-Berman Spatial and visual learning deficits in Alzheimer's and Parkinson's disease Brain Cogn. 11 1989 114 126
23. S. Frey, and M. Petrides Orbitofrontal cortex: a key prefrontal region for encoding information Proc. Natl. Acad. Sci. U.S.A. 97 2000 8723 8727
24. S. Frey, and M. Petrides Orbitofrontal cortex and memory formation Neuron 36 2002 171 176
25. F.M. Gunning-Dixon, D. Head, J. McQuain, J.D. Acker, and N. Raz Differential aging of the human striatum: a prospective MR imaging study AJNR Am. J. Neuroradiol. 19 1998 1501 1507
26. M. Hartman, E. Bolton, and S.E. Fehnel Accounting for age differences on the Wisconsin Card Sorting Test: decreased working memory, not inflexibility Psychol. Aging 16 2001 385 399
27. L. Hasher, and R.T. Zacks Working memory, comprehension, and aging: a review and a new view G.H. Bower The Psychology of Learning and Motivation vol. 22 1988 Academic Press San Diego 193 225
28. T. Hedden, and J.D. Gabrieli Insights into the ageing mind: a view from cognitive neuroscience Nat. Rev. Neurosci. 5 2004 87 96
29. H.R. Heekeren, S. Marrett, P.A. Bandettini, and L.G. Ungerleider A general mechanism for perceptual decision-making in the human brain Nature 431 2004 859 862
30. J.G. Herndon, M.B. Moss, D.L. Rosene, and R.J. Killiany Patterns of cognitive decline in aged rhesus monkeys Behav. Brain Res. 87 1997 25 34
31. C. Hock, F. Muller-Spahn, S. Schuh-Hofer, M. Hofmann, U. Dirnagl, and A. Villringer Age dependency of changes in cerebral hemoglobin oxygenation during brain activation: a near-infrared spectroscopy study J. Cereb. Blood Flow Metab. 15 1995 1103 1108
32. P.R. Hof, and J.H. Morrison The aging brain: morphomolecular senescence of cortical circuits Trends Neurosci. 27 2004 607 613
33. S.A. Huettel, J.D. Singerman, and G. McCarthy The effects of aging upon the hemodynamic response measured by functional MRI Neuroimage 13 2001 161 175
34. B. Jones, and M. Mishkin Limbic lesions and the problem of stimulus-reinforcement associations Exp. Neurol. 36 1972 362 377
35. V. Kaasinen, H. Vilkman, J. Hietala, K. Nagren, H. Helenius, H. Olsson, L. Farde, and J. Rinne Age-related dopamine D2/D3 receptor loss in extrastriatal regions of the human brain Neurobiol. Aging 21 2000 683 688
36. T.L. Kemper Neuroanatomical and neuropathological changes in normal aging and in dementia M. Albert J. Knoefel Clinical Neurology of Aging 1994 Oxford University Press New York and Oxford 3 78
37. B. Knutson, C.M. Adams, G.W. Fong, and D. Hommer Anticipation of increasing monetary reward selectively recruits nucleus accumbens J. Neurosci. 21 2001 RC159
38. A.F. Kramer, D.G. Humphrey, J.F. Larish, G.D. Logan, and D.L. Strayer Aging and inhibition: beyond a unitary view of inhibitory processing in attention Psychol. Aging 9 1994 491 512
39. J. Kray, and U. Lindenberger Adult age differences in task switching Psychol. Aging 15 2000 126 147
40. M.L. Kringelbach, and E.T. Rolls The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology Prog. Neurobiol. 72 2004 341 372
41. A.D. Lawrence, B.J. Sahakian, R.D. Rogers, J.R. Hodge, and T.W. Robbins Discrimination, reversal, and shift learning in Huntington's disease: mechanisms of impaired response selection Neuropsychologia 37 1999 1359 1374
42. B. Levine, D.T. Stuss, and W.P. Milberg Effects of aging on conditional associative learning: process analyses and comparison with focal frontal lesions Neuropsychology 11 1997 367 381
43. S.C. Li, U. Lindenberger, B. Hommel, G. Aschersleben, W. Prinz, and P.B. Baltes Transformations in the couplings among intellectual abilities and constituent cognitive processes across the life span Psychol. Sci. 15 2004 155 163
44. S.C. Li, U. Lindenberger, and S. Sikstrom Aging cognition: from neuromodulation to representation Trends Cogn. Sci. 5 2001 479 486
45. U. Lindenberger, and P.B. Baltes Intellectual functioning in old and very old age: cross-sectional results from the Berlin Aging Study Psychol. Aging 12 1997 410 432
46. U. Lindenberger, U. Mayr, and R. Kliegl Speed and intelligence in old age Psychol. Aging 8 1993 207 220
47. T. Ljungberg, P. Apicella, and W. Schultz Responses of monkey dopamine neurons during learning of behavioral reactions J. Neurophysiol. 67 1992 145 163
48. S.E. MacPherson, L.H. Phillips, and S.S. Della Age, executive function, and social decision making: a dorsolateral prefrontal theory of cognitive aging Psychol. Aging 17 2002 598 609
49. D.J. Madden, and J.M. Hoffmann Application of positron emission tomography to age related cognitive changes K.R.R. Krishnan P.M. Doraiswamy Brain Imaging in Clinical Psychiatry 1997 Marcel Dekker New York 575 613
50. D.J. Madden, T.G. Turkington, R.E. Coleman, J.M. Provenzale, T.R. DeGrado, and J.M. Hoffman Adult age differences in regional cerebral blood flow during visual world identification: evidence from H215O PET Neuroimage 3 1996 127 142
51. A. Marschner, H.R. Heekeren, T. Mell, D. Kronfeldt, I. Wartenburger, A. Villringer, and F.M. Reischies Reward association learning modulates activity in dorsolateral prefrontal cortex during decision-making processes Neuroimage 16 2002 1077
52. T. Mell, H.R. Heekeren, A. Marschner, I. Wartenburger, A. Villringer, and F.M. Reischies Effect of aging on stimulus-reward association learning Neuropsychologia 43 2005 554 563
53. T. Mell, I. Wartenburger, A. Marschner, A. Villringer, H.R. Heekeren, and F.M. Reischies Reward association learning and expectancy control: aging effects on the mesolimbic reward system Biol. Psychiatry 55 2004 156
54. Y. Nagahama, H. Fukuyama, H. Yamauchi, Y. Katsumi, Y. Magata, H. Shibasaki, and J. Kimura Age-related changes in cerebral blood flow activation during a Card Sorting Test Exp. Brain Res. 114 1997 571 577
55. J. O'Doherty, R. Deichmann, H.D. Critchley, and R.J. Dolan Neural responses during anticipation of a primary taste reward Neuron 33 2002 815 826
56. J. O'Doherty, M.L. Kringelbach, E.T. Rolls, J. Hornak, and C. Andrews Abstract reward and punishment representations in the human orbitofrontal cortex Nat. Neurosci. 4 2001 95 102
57. M. Oscar-Berman, and S.M. Zola-Morgan Comparative neuropsychology and Korsakoff's syndrome. I. Spatial and visual reversal learning Neuropsychologia 18 1980 499 512
58. G. Pagnoni, C.F. Zink, P.R. Montague, and G.S. Berns Activity in human ventral striatum locked to errors of reward prediction Nat. Neurosci. 5 2002 97 98
59. D.C. Park, A.D. Smith, G. Lautenschlager, J.L. Earles, D. Frieske, M. Zwahr, and C.L. Gaines Mediators of long-term memory performance across the life span Psychol. Aging 11 1996 621 637
60. A.J. Parkin, and A. Lawrence A dissociation in the relation between memory tasks and frontal lobe tests in the normal elderly Neuropsychologia 32 1994 1523 1532
61. M. Petrides, and B. Milner Deficits on subject-ordered tasks after frontal- and temporal-lobe lesions in man Neuropsychologia 20 1982 249 262
62. S. Rahman, J. Sahakia, N. Cardinal, R. Rogers, and T. Robbins Decision-making and neuropsychiatry Trends Cogn. Sci. 5 2001 271 277
63. P.R. Rapp Visual discrimination and reversal learning in the aged monkey (Macaca mulatta) Behav. Neurosci. 104 1990 876 884
64. N. Raz Aging of the brain and its impact on cognitive performance: integration of structural and functional findings F.I.M. Craik T.A. Salthouse Handbook of Aging and Cognition 2000 Erlbaum Mahwah, NJ 1 90
65. N. Raz, F.M. Gunning-Dixon, D. Head, J.H. Dupuis, and J.D. Acker Neuroanatomical correlates of cognitive aging: evidence from structural magnetic resonance imaging Neuropsychology 12 1998 95 114
66. N. Raz, F.M. Gunning, D. Head, J.H. Dupuis, J. McQuain, S.D. Briggs, W.J. Loken, A.E. Thornton, and J.D. Acker Selective aging of the human cerebral cortex observed in vivo: differential vulnerability of the prefrontal gray matter Cereb. Cortex 7 1997 268 282
67. N. Raz, F. Gunning-Dixon, D. Head, K.M. Rodrigue, A. Williamson, and J.D. Acker Aging, sexual dimorphism, and hemispheric asymmetry of the cerebral cortex: replicability of regional differences in volume Neurobiol. Aging 25 2004 377 396
68. F.M. Reischies Pattern of disturbance of different ventral frontal functions in organic depression Ann. N. Y. Acad. Sci. 877 1999 775 780
69. S.M. Resnick, D.L. Pham, M.A. Kraut, A.B. Zonderman, and C. Davatzikos Longitudinal magnetic resonance imaging studies of older adults: a shrinking brain J. Neurosci. 23 2003 3295 3301
70. P.A. Reuter-Lorenz, J. Jonides, E.E. Smith, A. Hartley, A. Miller, C. Marshuetz, and R.A. Koeppe Age differences in the frontal lateralization of verbal and spatial working memory revealed by PET J. Cogn. Neurosci. 12 2000 174 187
71. K.R. Ridderinkhof, M.M. Span, and M.W. van der Molen Perseverative behavior and adaptive control in older adults: performance monitoring, rule induction, and set shifting Brain Cogn. 49 2002 382 401
72. R.D. Rogers, B.J. Everitt, A. Baldacchino, A.J. Blackshaw, R. Swainson, K. Wynne, N.B. Baker, J. Hunter, T. Carthy, E. Booker, M. London, J.F. Deakin, B.J. Sahakian, and T.W. Robbins Dissociable deficits in the decision-making cognition of chronic amphetamine abusers, opiate abusers, patients with focal damage to prefrontal cortex, and tryptophan-depleted normal volunteers: evidence for monoaminergic mechanisms Neuropsychopharmacology 20 1999 322 339
73. R.D. Rogers, A.M. Owen, H.C. Middleton, E.J. Williams, J.D. Pickard, B.J. Sahakian, and T.W. Robbins Choosing between small, likely rewards and large, unlikely rewards activates inferior and orbital prefrontal cortex J. Neurosci. 19 1999 9029 9038
74. E.T. Rolls The orbitofrontal cortex and reward Cereb. Cortex 10 2000 284 294
75. E.T. Rolls, J. Hornak, D. Wade, and J. McGrath Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage J. Neurol. Neurosurg. Psychiatry 57 1994 1518 1524
76. R. Romo, and E. Salinas Flutter discrimination: neural codes, perception, memory and decision making Nat. Rev. Neurosci. 4 2003 203 218
77. J.B. Rowe, I. Toni, O. Josephs, R.S. Frackowiak, and R.E. Passingham The prefrontal cortex: response selection or maintenance within working memory? Science 288 2000 1656 1660
78. B. Rypma, and M. D'Esposito Isolating the neural mechanisms of age-related changes in human working memory Nat. Neurosci. 3 2000 509 515
79. D.H. Salat, J.A. Kaye, and J.S. Janowsky Greater orbital prefrontal volume selectively predicts worse working memory performance in older adults Cereb. Cortex 12 2002 494 505
80. K.W. Schaie Intellectual Development in Adulthood: The Seattle Longitudinal Study 1996 Cambridge University Press Cambridge
81. G. Schoenbaum, S. Nugent, M.P. Saddoris, and M. Gallagher Teaching old rats new tricks: age-related impairments in olfactory reversal learning Neurobiol. Aging 23 2002 555 564
82. W. Schultz Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey J. Neurophysiol. 56 1986 1439 1461
83. W. Schultz Multiple reward signals in the brain Nat. Rev. Neurosci. 1 2000 199 207
84. W. Schultz, and R. Romo Dopamine neurons of the monkey midbrain: contingencies of responses to stimuli eliciting immediate behavioral reactions J. Neurophysiol. 63 1990 607 624
85. M.N. Shadlen, and W.T. Newsome Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey J. Neurophysiol. 86 2001 1916 1936
86. A.P. Shimamura, and P.J. Jurica Memory interference effects and aging: findings from a test of frontal lobe function Neuropsychology 8 1994 408 412
87. P.D. Tapp, C.T. Siwak, J. Estrada, E. Head, B.A. Muggenburg, C.W. Cotman, and N.W. Milgram Size and reversal learning in the beagle dog as a measure of executive function and inhibitory control in aging Learn. Membr. 10 2003 64 73
88. L. Tremblay, and W. Schultz Relative reward preference in primate orbitofrontal cortex Nature 398 1999 704 708
89. M. Ullsperger, and D.Y. von Cramon Error monitoring using external feedback: specific roles of the habenular complex, the reward system, and the cingulate motor area revealed by functional magnetic resonance imaging J. Neurosci. 23 2003 4308 4314
90. M. Ullsperger, and D.Y. von Cramon Decision making, performance and outcome monitoring in frontal cortical areas Nat. Neurosci. 7 2004 1173 1174
91. G.W. Van Hoesen, J. Parvizi, and C.C. Chu Orbitofrontal cortex pathology in Alzheimer's disease Cereb. Cortex 10 2000 243 251
92. N.D. Volkow, R.C. Gur, G.J. Wang, J.S. Fowler, P.J. Moberg, Y.S. Ding, R. Hitzemann, G. Smith, and J. Logan Association between decline in brain dopamine activity with age and cognitive and motor impairment in healthy individuals Am. J. Psychiatry 155 1998 344 349
93. K.G. Volz, R.I. Schubotz, and D.Y. von Cramon Predicting events of varying probability: uncertainty investigated by fMRI Neuroimage 19 2003 271 280
94. M.L. Voytko Impairments in acquisition and reversals of two-choice discriminations by aged rhesus monkeys Neurobiol. Aging 20 1999 617 627
95. G.J. Wang, N.D. Volkow, J. Logan, J.S. Fowler, D. Schlyer, R.R. MacGregor, R.J. Hitzemann, R.C. Gur, and A.P. Wolf Evaluation of age-related changes in serotonin 5-HT2 and dopamine D2 receptor availability in healthy human subjects Life Sci. 56 1995 L249 L253
96. F. Wenz, K. Rempp, G. Brix, M.V. Knopp, F. Guckel, T. Hess, and G. van Kaick Age dependency of the regional cerebral blood volume (rCBV) measured with dynamic susceptibility contrast MR imaging (DSC) Magn. Reson. Imaging 14 1996 157 162
97. R.L. West An application of prefrontal cortex function theory to cognitive aging Psychol. Bull. 120 1996 272 292
98. R. West, A.M. Ergis, G. Winocur, and J. Saint-Cyr The contribution of impaired working memory monitoring to performance of the self-ordered pointing task in normal aging and Parkinson's disease Neuropsychology 12 1998 546 554
99. A.M. Young, M.H. Joseph, and J.A. Gray Increased dopamine release in vivo in nucleus accumbens and caudate nucleus of the rat during drinking: a microdialysis study Neuroscience 48 1992 871 876