Adult age differences in frontostriatal representation of prediction error but not reward outcome

Cognitive, Affective and Behavioral Neuroscience

Volumn 14, Issue 2, 2014, Pages 672-682

  Samanez Larkin, Gregory R ^a   Worthy, Darrell A ^b   Mata, Rui ^c,d   McClure, Samuel M ^e   Knutson, Brian ^e  

^a YALE UNIVERSITY   (United States)

^b TEXAS A AND M UNIVERSITY   (United States)

^c UNIVERSITY OF BASEL   (Switzerland)

^d MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

^e STANFORD UNIVERSITY   (United States)

Author keywords

Aging; Decision making; Learning; Medial prefrontal cortex; Motivation; Reward; Ventral striatum

Indexed keywords

OXYGEN;

ADULT; AGED; AGING; BLOOD; CORPUS STRIATUM; DECISION MAKING; FEMALE; FRONTAL LOBE; HUMAN; IMAGE PROCESSING; LEARNING; MALE; MIDDLE AGED; MOTIVATION; NERVE TRACT; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PREDICTIVE VALUE; REWARD; TIME; VASCULARIZATION; VERY ELDERLY;

ADULT; AGED; AGED, 80 AND OVER; AGING; CORPUS STRIATUM; DECISION MAKING; FEMALE; FRONTAL LOBE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; MOTIVATION; NEURAL PATHWAYS; OXYGEN; PREDICTIVE VALUE OF TESTS; REWARD; TIME FACTORS;

EID: 84904389160     PISSN: 15307026     EISSN: None     Source Type: Journal    
DOI: 10.3758/s13415-014-0297-4     Document Type: Article

References (51)

1. Agarwal, S., Driscoll, J. C., Gabaix, X., & Laibson, D. I. (2009). The age of reason: Financial decisions over the life-cycle with implications for regulation. Brookings Papers on Economic Activity, 40, 51-117.
2. Aizenstein, H. J., Butters, M. A., Clark, K. A., Figurski, J. L., Stenger, V. A., Nebes, R. D.,. Carter, C. S. (2006). Prefrontal and striatal activation in elderly subjects during concurrent implicit and explicit sequence learning. Neurobiology of Aging, 27, 741-751. doi: 10.1016/j.neurobiolaging. 2005.03.017
3. Carstensen, L. L. (2006). The influence of a sense of time on human development. Science, 312, 1913-1915. doi: 10.1126/science.1127488
4. Chowdhury, R., Guitart-Masip, M., Lambert, C., Dayan, P., Huys, Q., Düzel, E., & Dolan, R. J. (2013). Dopamine restores reward prediction errors in old age. Nature Neuroscience, 32, 14193-14204. doi: 10.1038/nn.3364
5. Cox, K. M., Aizenstein, H. J., & Fiez, J. A. (2008). Striatal outcome processing in healthy aging. Cognitive, Affective, & Behavioral Neuroscience, 8, 304-317. doi: 10.3758/CABN.8.3.304
6. Cox, R. W. (1996). AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Computers and Biomedical Research, 29, 162-173.
7. D'Ardenne, K., McClure, S. M., Nystrom, L. E., & Cohen, J. D. (2008). BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science, 319, 1264-1267. doi: 10.1126/science.1150605
8. Eppinger, B., Hämmerer, D., & Li, S.-C. (2011). Neuromodulation of reward-based learning and decision making in human aging. Annals of the New York Academy of Sciences, 1235, 1-17. doi: 10.1111/j.1749-6632.2011.06230.x
9. Eppinger, B., Nystrom, L. E., & Cohen, J. D. (2012). Reduced sensitivity to immediate reward during decision-making in older than younger adults. PLoS ONE, 7, e36953. doi: 10.1371/journal.pone.0036953.g005
10. Eppinger, B., Schuck, N. W., Nystrom, L. E., & Cohen, J. D. (2013). Reduced striatal responses to reward prediction errors in older compared with younger adults. Journal of Neuroscience, 33, 9905-9912. doi: 10.1523/JNEUROSCI.2942-12.2013
11. Gilbert, R. J., Mitchell, M. R., Simon, N. W., Bañuelos, C., Setlow, B., & Bizon, J. L. (2011). Risk, reward, and decision-making in a rodent model of cognitive aging. Frontiers in Neuroscience, 5, 144. doi: 10.3389/fnins.2011.00144
12. Glover, G. H., & Law, C. S. (2001). Spiral-in/out BOLD fMRI for increased SNR and reduced susceptibility artifacts. Magnetic Resonance in Medicine, 46, 515-522.
13. Grady, C. L. (2008). Cognitive neuroscience of aging. Annals of the New York Academy of Sciences, 1124, 127-144. doi: 10.1196/annals.1440.009
14. Haber, S. N., & Knutson, B. (2010). The reward circuit: Linking primate anatomy and human imaging. Neuropsychopharmacology, 35, 4-26. doi: 10.1038/npp.2009.129
15. Hämmerer, D., & Eppinger, B. (2012). Dopaminergic and prefrontal contributions to reward-based learning and outcome monitoring during child development and aging. Developmental Psychology, 48, 862-874. doi: 10.1037/a0027342
16. Hollerman, J. R., & Schultz, W. (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nature Neuroscience, 1, 304-309. doi: 10.1038/1124
17. Hosseini, S. M. H., Rostami, M., Yomogida, Y., Takahashi, M., Tsukiura, T., & Kawashima, R. (2010). Aging and decision making under uncertainty: Behavioral and neural evidence for the preservation of decision making in the absence of learning in old age. NeuroImage, 52, 1514-1520. doi: 10.1016/j.neuroimage.2010.05.008
18. Knutson, B., Fong, G. W., Bennett, S. M., Adams, C. M., & Hommer, D. (2003). A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: Characterization with rapid event-related fMRI. NeuroImage, 18, 263-272.
19. Knutson, B., Samanez-Larkin, G. R., & Kuhnen, C. M. (2011). Gain and loss learning differentially contribute to life financial outcomes. PLoS ONE, 6, e24390. doi: 10.1371/journal.pone.0024390
20. Li, Y., Baldassi, M., Johnson, E. J., & Weber, E. U. (2013). Compensating cognitive capabilities, economic decisions, and aging. Psychology and Aging, 28, 595-613. doi: 10.1037/a0034172
21. Mata, R., Josef, A. K., Samanez-Larkin, G. R., & Hertwig, R. (2011). Age differences in risky choice: A meta-analysis. Annals of the New York Academy of Sciences, 1235, 18-29. doi: 10.1111/j.1749-6632.2011.06200.x
22. Mata, R., & Nunes, L. (2010). When less is enough: Cognitive aging, information search, and decision quality in consumer choice. Psychology and Aging, 25, 289-298. doi: 10.1037/a0017927
23. Mata, R., Pachur, T., von Helversen, B., Hertwig, R., Rieskamp, J., & Schooler, L. (2012). Ecological rationality: A framework for understanding and aiding the aging decision maker. Frontiers in Neuroscience, 6, 19. doi: 10.3389/fnins.2012.00019
24. Mata, R., Schooler, L., & Rieskamp, J. (2007). The aging decision maker: Cognitive aging and the adaptive selection of decision strategies. Psychology and Aging, 22, 796-810. doi: 10.1037/0882-7974.22.4.796
25. Mata, R., von Helversen, B., & Rieskamp, J. (2010). Learning to choose: Cognitive aging and strategy selection learning in decision making. Psychology and Aging, 25, 299-309. doi: 10.1037/a0018923
26. McClure, S. M., Berns, G. S., & Montague, P. R. (2003). Temporal prediction errors in a passive learning task activate human striatum. Neuron, 38, 339-346.
27. Mell, T., Wartenburger, I., Marschner, A., Villringer, A., Reischies, F. M., & Heekeren, H. R. (2009). Altered function of ventral striatum during reward-based decision making in old age. Frontiers in Human Neuroscience, 3, 34. doi: 10.3389/neuro.09.034.2009
28. Nashiro, K., Sakaki, M., & Mather, M. (2012). Age differences in brain activity during emotion processing: Reflections of age-related decline or increased emotion regulation? Gerontology, 58, 156-163. doi: 10.1159/000328465
29. O'Doherty, J. P. (2004). Reward representations and reward-related learning in the human brain: Insights from neuroimaging. Current Opinion in Neurobiology, 14, 769-776. doi: 10.1016/j.conb.2004.10.016
30. O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003). Temporal difference models and reward-related learning in the human brain. Neuron, 38, 329-337.
31. Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S. (2002). Activity in human ventral striatum locked to errors of reward prediction. Nature Neuroscience, 5, 97-98. doi: 10.1038/nn802
32. Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006). Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature, 442, 1042-1045. doi: 10.1038/nature05051
33. Reuter-Lorenz, P. A., & Lustig, C. (2005). Brain aging: Reorganizing discoveries about the aging mind. Current Opinion in Neurobiology, 15, 245-251.
34. Samanez-Larkin, G. R. (2013). Financial decision making and the aging brain. APS Observer, 26, 30-33.
35. Samanez-Larkin, G. R., & Carstensen, L. L. (2011). Socioemotional functioning and the aging brain. In J. Decety & J. T. Cacioppo (Eds.), The handbook of social neuroscience (pp. 507-521). Oxford, UK: Oxford University Press.
36. Samanez-Larkin, G. R., & D'Esposito, M. (2008). Group comparisons: Imaging the aging brain. Social Cognitive and Affective Neuroscience, 3, 290-297. doi: 10.1093/scan/nsn029
37. Samanez-Larkin, G. R., Gibbs, S. E. B., Khanna, K., Nielsen, L., Carstensen, L. L., & Knutson, B. (2007). Anticipation of monetary gain but not loss in healthy older adults. Nature Neuroscience, 10, 787-791. doi: 10.1038/nn1894
38. Samanez-Larkin, G. R., Hollon, N. G., Carstensen, L. L., & Knutson, B. (2008). Individual differences in insular sensitivity during loss anticipation predict avoidance learning. Psychological Science, 19, 320-323.
39. Samanez-Larkin, G. R., & Knutson, B. (2014). Reward processing and risky decision making in the aging brain. In V. F. Reyna & V. Zayas (Eds.), The neuroscience of risky decision making (pp. 123-142). Washington DC: American Psychological Association.
40. Samanez-Larkin, G. R., Kuhnen, C. M., Yoo, D. J., & Knutson, B. (2010). Variability in nucleus accumbens activity mediates age-related suboptimal financial risk taking. Journal of Neuroscience, 30, 1426-1434. doi: 10.1523/JNEUROSCI.4902-09.2010
41. Samanez-Larkin, G. R., Levens, S. M., Perry, L. M., Dougherty, R. F., & Knutson, B. (2012). Frontostriatal white matter integrity mediates adult age differences in probabilistic reward learning. Journal of Neuroscience, 32, 5333-5337. doi: 10.1523/JNEUROSCI.5756-11.2012
42. Samson, R. D., & Barnes, C. A. (2013). Impact of aging brain circuits on cognition. European Journal of Neuroscience, 37, 1903-1915. doi: 10.1111/ejn.12183
43. Schott, B. H., Niehaus, L., Wittmann, B. C., Schütze, H., Seidenbecher, C. I., Heinze, H.-J., & Düzel, E. (2007). Ageing and early-stage Parkinson's disease affect separable neural mechanisms of mesolimbic reward processing. Brain, 130, 2412-2424. doi: 10.1093/brain/awm147
44. Schönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007). Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. Journal of Neuroscience, 27, 12860-12867. doi: 10.1523/JNEUROSCI.2496-07.2007
45. Schultz, W. (2006). Behavioral theories and the neurophysiology of reward. Annual Review of Psychology, 57, 87-115. doi: 10.1146/annurev.psych.56. 091103.070229
46. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-1599.
47. Simon, N. W., Lasarge, C. L., Montgomery, K. S., Williams, M. T., Mendez, I. A., Setlow, B., & Bizon, J. L. (2010). Good things come to those who wait: Attenuated discounting of delayed rewards in aged Fischer 344 rats. Neurobiology of Aging, 31, 853-862. doi: 10.1016/j.neurobiolaging.2008.06.004
48. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning. Cambridge, MA: MIT Press.
49. Worthy, D. A., Gorlick, M. A., Pacheco, J. L., Schnyer, D. M., & Maddox, W. T. (2011). With age comes wisdom: Decision making in younger and older adults. Psychological Science, 22, 1375-1380. doi: 10.1177/ 0956797611420301
50. Worthy, D. A., & Maddox, W. T. (2012). Age-based differences in strategy use in choice tasks. Frontiers in Neuroscience, 5, 145. doi: 10.3389/fnins.2011.00145
51. Wu, C. C., Samanez-Larkin, G. R., Katovich, K., & Knutson, B. (2014). Affective traits link to reliable neural markers of incentive anticipation. NeuroImage, 84, 279-289. doi: 10.1016/j.neuroimage.2013.08.055