Dopamine restores reward prediction errors in old age

Nature Neuroscience

Volumn 16, Issue 5, 2013, Pages 648-653

  Chowdhury, Rumana ^a,b   Guitart Masip, Marc ^b,c   Lambert, Christian ^b,d   Dayan, Peter ^e   Huys, Quentin ^b,e,f,g   Düzel, Emrah ^a,h,i   Dolan, Raymond J ^b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c KAROLINSKA INSTITUTE   (Sweden)

^d ST GEORGE'S UNIVERSITY OF LONDON   (United Kingdom)

^e UNIVERSITY COLLEGE LONDON   (United Kingdom)

^f UNIVERSITY OF ZURICH   (Switzerland)

^g UNIVERSITY HOSPITAL ZURICH   (Switzerland)

^h OTTO VON GUERICKE UNIVERSITY   (Germany)

ⁱ GERMAN CENTER FOR NEURODEGENERATIVE DISEASES DZNE   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BENSERAZIDE PLUS LEVODOPA; DOPAMINE; PLACEBO;

ADULT; AGED; ARTICLE; CONTROLLED STUDY; CORPUS STRIATUM; DIFFUSION TENSOR IMAGING; DOPAMINERGIC NERVE CELL; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE SCANNER; NUCLEUS ACCUMBENS; ORANGE JUICE; PRIORITY JOURNAL; RANDOMIZED CONTROLLED TRIAL; REINFORCEMENT; REWARD; SENESCENCE; SUBSTANTIA NIGRA; TASK PERFORMANCE; VENTRAL TEGMENTUM;

ADULT; AGED; AGING; ALKALOIDS; BRAIN; CONDITIONING, OPERANT; DOPAMINE AGENTS; DOUBLE-BLIND METHOD; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LEVODOPA; MAGNETIC RESONANCE IMAGING; MALE; OXYGEN; REINFORCEMENT (PSYCHOLOGY); REWARD; TIME FACTORS; YOUNG ADULT;

EID: 84876930902     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.3364     Document Type: Article

References (54)

1. Eppinger, B., Hämmerer, D. & Li, S.-C. Neuromodulation of reward-based learning and decision making in human aging. Ann. NY Acad. Sci. 1235, 1-17 (2011).
2. Mell, T. et al. Effect of aging on stimulus-reward association learning. Neuropsychologia 43, 554-563 (2005). (Pubitemid 40248912)
3. Schultz, W., Dayan, P. & Montague, P.R. A neural substrate of prediction and reward. Science 275, 1593-1599 (1997). (Pubitemid 27120526)
4. Salamone, J.D., Correa, M., Mingote, S.M. & Weber, S.M. Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine. Curr. Opin. Pharmacol. 5, 34-41 (2005). (Pubitemid 40124532)
5. Haber, S.N., Fudge, J.L. & McFarland, N.R. Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J. Neurosci. 20, 2369-2382 (2000). (Pubitemid 30230089)
6. O'Doherty, J. et al. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304, 452-454 (2004). (Pubitemid 38495943)
7. O'Doherty, J.P., Dayan, P., Friston, K., Critchley, H. & Dolan, R.J. Temporal difference models and reward-related learning in the human brain. Neuron 38, 329-337 (2003). (Pubitemid 36555657)
8. Daw, N.D., O'Doherty, J.P., Dayan, P., Seymour, B. & Dolan, R.J. Cortical substrates for exploratory decisions in humans. Nature 441, 876-879 (2006).
9. Knutson, B. & Gibbs, S. Linking nucleus accumbens dopamine and blood oxygenation. Psychopharmacology (Berl.) 191, 813-822 (2007). (Pubitemid 46355904)
10. Pessiglione, M., Seymour, B., Flandin, G., Dolan, R.J. & Frith, C.D. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442, 1042-1045 (2006). (Pubitemid 44330261)
11. Rutledge, R.B. et al. Dopaminergic drugs modulate learning rates and perseveration in parkinson's patients in a dynamic foraging task. J. Neurosci. 29, 15104-15114 (2009).
12. Bäckman, L., Nyberg, L., Lindenberger, U., Li, S.-C. & Farde, L. The correlative triad among aging, dopamine and cognition: current status and future prospects. Neurosci. Biobehav. Rev. 30, 791-807 (2006). (Pubitemid 44389711)
13. Düzel, E., Bunzeck, N., Guitart-Masip, M. & Duzel, S. Novelty-related motivation of anticipation and exploration by dopamine (NOMAD): implications for healthy aging. Neurosci. Biobehav. Rev. 34, 660-669 (2010).
14. Fearnley, J.M. & Lees, A.J. Ageing and Parkinson's disease: substantia nigra regional selectivity. Brain 114, 2283-2301 (1991).
15. Vaillancourt, D.E., Spraker, M.B., Prodoehl, J., Zhou, X.J. & Little, D.M. Effects of aging on the ventral and dorsal substantia nigra using diffusion tensor imaging. Neurobiol. Aging 33, 35-42 (2012).
16. Samanez-Larkin, G.R., Kuhnen, C.M., Yoo, D.J. & Knutson, B. Variability in nucleus accumbens activity mediates age-related suboptimal financial risk taking. J. Neurosci. 30, 1426-1434 (2010).
17. Schott, B.H. et al. Ageing and early-stage Parkinson's disease affect separable neural mechanisms of mesolimbic reward processing. Brain 130, 2412-2424 (2007). (Pubitemid 47327626)
18. Cox, K.M., Aizenstein, H.J. & Fiez, J.A. Striatal outcome processing in healthy aging. Cogn. Affect. Behav. Neurosci. 8, 304-317 (2008).
19. Behrens, T.E.J., Hunt, L.T., Woolrich, M.W. & Rushworth, M.F.S. Associative learning of social value. Nature 456, 245-249 (2008).
20. Cools, R. & D'Esposito, M. Inverted U-shaped dopamine actions on human working memory and cognitive control. Biol. Psychiatry 69, e113-e125 (2011).
21. Li, J. & Daw, N.D. Signals in human striatum are appropriate for policy update rather than value prediction. J. Neurosci. 31, 5504-5511 (2011).
22. Eppinger, B., Kray, J., Mock, B. & Mecklinger, A. Better or worse than expected? Aging, learning and the ERN. Neuropsychologia 46, 521-539 (2008). (Pubitemid 351186554)
23. Samanez-Larkin, G.R., Wagner, A.D. & Knutson, B. Expected value information improves financial risk taking across the adult life span. Soc. Cogn. Affect. Neurosci. 6, 207-217 (2011).
24. Guitart-Masip, M. et al. Go and no-go learning in reward and punishment: interactions between affect and effect. Neuroimage 62, 154-166 (2012).
25. Dickinson, A. & Balleine, B. The Role of Learning in the Operation of Motivational Systems (John Wiley & Sons, New York, 2002).
26. Dickinson, A., Smith, J. & Mirenowicz, J. Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. Behav. Neurosci. 114, 468-483 (2000). (Pubitemid 30490894)
27. Worthy, D.A., Gorlick, M.A., Pacheco, J.L., Schnyer, D.M. & Maddox, W.T. With age comes wisdom. Psychol. Sci. 22, 1375-1380 (2011).
28. de Wit, S. et al. Reliance on habits at the expense of goal-directed control following dopamine precursor depletion. Psychopharmacology (Berl.) 219, 621-631 (2012).
29. Wunderlich, K., Smittenaar, P. & Dolan, R.J. Dopamine enhances model-based over model-free choice behavior. Neuron 75, 418-424 (2012).
30. Gläscher, J., Daw, N., Dayan, P. & O'Doherty, J.P. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66, 585-595 (2010).
31. Jocham, G., Klein, T.A. & Ullsperger, M. Dopamine-mediated reinforcement learning signals in the striatum and ventromedial prefrontal cortex underlie value-based choices. J. Neurosci. 31, 1606-1613 (2011).
32. Shohamy, D. & Adcock, R.A. Dopamine and adaptive memory. Trends Cogn. Sci. 14, 464-472 (2010).
33. Nicola, S.M., Surmeier, D.J. & Malenka, R.C. Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. Annu. Rev. Neurosci. 23, 185-215 (2000). (Pubitemid 30350042)
34. Daw, N.D. & Gershman, S.J. Seymour, B., Dayan, P. & Dolan, R.J. Model-based influences on humans' choices and striatal prediction errors. Neuron 69, 1204-1215 (2011).
35. Simon, D.A. & Daw, N.D. Neural correlates of forward planning in a spatial decision task in humans. J. Neurosci. 31, 5526-5539 (2011).
36. Guitart-Masip, M. et al. Action controls dopaminergic enhancement of reward representations. Proc. Natl. Acad. Sci. USA 109, 7511-7516 (2012).
37. Choi, W.Y., Balsam, P.D. & Horvitz, J.C. Extended habit training reduces dopamine mediation of appetitive response expression. J. Neurosci. 25, 6729-6733 (2005). (Pubitemid 41023140)
38. Klein-Flügge, M.C., Hunt, L.T., Bach, D.R., Dolan, R.J. & Behrens, T.E.J. Dissociable reward and timing signals in human midbrain and ventral striatum. Neuron 72, 654-664 (2011).
39. Coxon, J.P., Van Impe, A., Wenderoth, N. & Swinnen, S.P. Aging and inhibitory control of action: cortico-subthalamic connection strength predicts stopping performance. J. Neurosci. 32, 8401-8412 (2012).
40. Forstmann, B.U. et al. Cortico-subthalamic white matter tract strength predicts interindividual efficacy in stopping a motor response. Neuroimage 60, 370-375 (2012).
41. Le Bihan, D. & Johansen-Berg, H. Diffusion MRI at 25: exploring brain tissue structure and function. Neuroimage 61, 324-341 (2012).
42. Draganski, B. et al. Regional specificity of MRI contrast parameter changes in normal ageing revealed by voxel-based quantification (VBQ). Neuroimage 55, 1423-1434 (2011).
43. Li, S.-C. & Sikström, S. Integrative neurocomputational perspectives on cognitive aging, neuromodulation, and representation. Neurosci. Biobehav. Rev. 26, 795-808 (2002). (Pubitemid 35430284)
44. Schönberg, T., Daw, N.D., Joel, D. & O'Doherty, J.P. Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J. Neurosci. 27, 12860-12867 (2007). (Pubitemid 350159584)
45. Huys, Q.J.M. et al. Disentangling the roles of approach, activation and valence in instrumental and Pavlovian responding. PLoS Comput. Biol. 7, e1002028 (2011).
46. Lutti, A., Hutton, C., Finsterbusch, J., Helms, G. & Weiskopf, N. Optimization and validation of methods for mapping of the radiofrequency transmit field at 3T. Magn. Reson. Med. 64, 229-238 (2010).
47. Reese, T.G., Heid, O., Weisskoff, R.M. & Wedeen, V.J. Reduction of eddy-current-induced distortion in diffusion MRI using a twice-refocused spin echo. Magn. Reson. Med. 49, 177-182 (2003). (Pubitemid 36042349)
48. Nagy, Z., Weiskopf, N., Alexander, D.C. & Deichmann, R. A method for improving the performance of gradient systems for diffusion-weighted MRI. Magn. Reson. Med. 58, 763-768 (2007). (Pubitemid 47556881)
49. Andersson, J.L.R., Skare, S. & Ashburner, J. How to correct susceptibility distortions in spin-echo echo-planar images: application to diffusion tensor imaging. Neuroimage 20, 870-888 (2003). (Pubitemid 37268110)
50. Ashburner, J. A fast diffeomorphic image registration algorithm. Neuroimage 38, 95-113 (2007). (Pubitemid 47440133)
51. Knutson, B. & Cooper, J.C. Functional magnetic resonance imaging of reward prediction. Curr. Opin. Neurol. 18, 411-417 (2005). (Pubitemid 41104804)
52. Brett, M., Anton, J.-L., Valabregue, R. & Poline, J.-B. Region of interest analysis using an SPM toolbox. Neuroimage 16, 1140-1141 (2002).
53. Forstmann, B.U. et al. The speed-accuracy tradeoff in the elderly brain: a structural model-based approach. J. Neurosci. 31, 17242-17249 (2011).
54. Schwarzkopf, D.S., de Haas, B. & Rees, G. Better ways to improve standards in brain-behavior correlation analysis. Front. Hum. Neurosci. 6, 200 (2012).