Dopaminergic and prefrontal contributions to reward-based learning and outcome monitoring during child development and aging

Developmental Psychology

Volumn 48, Issue 3, 2012, Pages 862-874

  Hämmerer, Dorothea ^a   Eppinger, Ben ^a  

^a MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

Author keywords

Decision making; Dopamine; Life span development; Reinforcement learning; Valence bias

Indexed keywords

AGING; CHILD; CHILD DEVELOPMENT; CLASSIFICATION; HUMAN; LEARNING; PHYSIOLOGY; PREFRONTAL CORTEX; REVIEW; REWARD;

AGING; CHILD; CHILD DEVELOPMENT; HUMANS; LEARNING; PREFRONTAL CORTEX; REWARD;

EID: 84865647080     PISSN: 00121649     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0027342     Document Type: Article

References (138)

1. Bäckman, L., Lindenberger, U., Li, S.-C., & Nyberg, L. (2010). Linking cognitive aging to alterations in dopamine neurotransmitter functioning: Recent data and future avenues. Neuroscience & Biobehavioral Reviews, 34, 670-677. doi:10.1016/j.neubiorev.2009.12.008
2. Bäckman, L., Nyberg, L., Lindenberger, U., Li, S.-C., & Farde, L. (2006). The correlative triad among aging, dopamine, and cognition: Current status and future prospects. Neuroscience & Biobehavioral Reviews, 30, 791-807. doi:10.1016/j.neubiorev.2006.06.005
3. Bannon, M. J., & Whitty, C. J. (1997). Age-related and regional differences in dopamine transporter mRNA expression in human midbrain. Neurology, 48, 969-977.
4. Baxter, M. G., & Murray, E. A. (2002). The amygdala and reward. Nature Reviews Neuroscience, 3, 563-573. doi:10.1038/nrn875
5. Bechara, A., Tranel, D., & Damasio, H. (2000). Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions. Brain, 123, 2189-2202. doi:10.1093/brain/123.11.2189
6. Belin, D., & Everitt, B. J. (2008). Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum. Neuron, 57, 432-441. doi:10.1016/j.neuron.2007.12.019
7. Bellebaum, C., Kobza, S., Thiele, S., & Daum, I. (2011). Processing of expected and unexpected monetary performance outcomes in healthy older subjects. Behavioral Neuroscience, 25, 241-251. doi:10.1037/a0022536
8. Berridge, K. C., & Robinson, T. E. (2003).Parsing reward. Trends in Neurosciences, 26, 507-513. doi:10.1016/S0166-2236(03)00233-9.
9. Blair, K., Marsh, A. A., Morton, J., Vythilingam, M., Jones, M., Mondillo, K.,... Blair, J. R. (2006). Choosing the lesser of two evils, the better of two goods: Specifying the roles of ventromedial prefrontal cortex and dorsal anterior cingulate in object choice. Journal of Neuroscience, 26, 11379-11386. doi:10.1523/JNEUROSCI.1640-06.2006
10. Botvinick, M. M. (2007). Conflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function. Cognitive, Affective, & Behavioral Neuroscience, 7, 356-366. doi:10.3758/CABN.7.4.356
11. Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychological Review, 108, 624-652. doi:10.1037/0033-295X.108.3.624
12. Bunge, S. A., Dudukovic, N. M., Thomason, M. E., Vaidya, C. J., & Gabrieli, J. D. (2002). Immature frontal lobe contributions to cognitive control in children: Evidence from fMRI. Neuron, 33, 301-311. doi: 10.1016/S0896-6273(01)00583-9.
13. Camille, N., Coricelli, G., Sallet, J., Pradat-Diehl, P., Duhamel, J. R., & Sirigu, A. (2004, May 21). The involvement of the orbitofrontal cortex in the experience of regret. Science, 304,1167-1170. doi:10.1126/science.1094550
14. Carstensen, L. L. (2006, June 30). The influence of a sense of time on human development. Science, 312, 1913-1915. doi:10.1126/science.1127488
15. Casey, B. J., Tottenham, N., Liston, C., & Durston, S. (2005). Imaging the developing brain: What have we learned about cognitive development? Trends in Cognitive Sciences, 9, 104-110. doi:10.1016/j.tics.2005.01.011
16. Cohen, J. R., Asarnow, R. F., Sabb, F. W., Bilder, F. W., Bookheimer, S. Y., Knowlton, B. J., & Poldrack, R. A. (2010). A unique adolescent response to reward prediction errors. Nature Neuroscience, 13, 669-671. doi:10.1038/nn.2558
17. Colby, J. B., Van Horn, J. D., & Sowell, E. R. (2011). Quantitative in vivo evidence for broad regional gradients in the timing of white matter maturation during adolescence. NeuroImage, 54, 25-31. http://dx.doi.org/10.1016/j.neuroimage.2010.08.014
18. Condé, H. (1992). Organization and physiology of the substantia nigra. Experimental Brain Research, 88, 233-248. doi:10.1007/BF02259099
19. Cox, K. M., Aizenstein, H. J., & Fiez, J. A. (2008). Striatal outcome processing in healthy aging. Cognitive, Affective, & Behavioral Neuroscience, 8, 304-317. doi:10.3758/CABN.8.3.304
20. Craik, F. I., & Bialystok, E. (2006). Cognition through the lifespan: Mechanisms of change. Trends in Cognitive Sciences, 10, 131-138. doi:10.1016/j.tics.2006.01.007
21. Crone, E. A., Jennings, J. R., & Van der Molen, M. W. (2004). Developmental change in feedback processing as reflected by phasic heart rate changes. Developmental Psychology, 40, 1228-1238. doi:10.1037/0012-1649.40.6.1228
22. Crone, E. A., Somsen, R. J., Zanolie, K., & Van der Molen, M. W. (2006). A heart rate analysis of developmental change in feedback processing and rule shifting from childhood to early adulthood. Journal of Experimental Child Psychology, 95, 99-116. doi:10.1016/j.jecp.2006.03.007
23. Crone, E. A., & Van der Molen, M. W. (2004). Developmental changes in real life decision making: Performance on a gambling task previously shown to depend on the ventromedial prefrontal cortex. Developmental Neuropsychology, 25, 251-279. doi:10.1207/s15326942dn2503_2
24. D'Ardenne, K., McClure, S. M., Nystrom, L. E., & Cohen, J. D. (2008, February 29). BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science, 319, 1264-1267. doi:10.1126/science.1151861
25. Denburg, N. L., Recknor, E. C., Bechara, A., & Tranel, D. (2006). Psychophysiological anticipation of positive outcomes promotes advantageous decision-making in normal older persons. International Journal of Psychophysiology, 61, 19-25. doi:10.1016/j.ijpsycho.2005.10.021
26. Denburg, N. L., Tranel, D., & Bechara, A. (2005). The ability to decide advantageously declines prematurely in some normal older persons. Neuropsychologia, 43, 1099-1106. doi:10.1016/j.neuropsychologia.2004.09.012
27. Diamond, A., Briand, L., Fossella, J., & Gehlbach, L. (2004). Genetic and neurochemical modulation of prefrontal cognitive functions in children. American Journal of Psychiatry, 161, 125-132. http://dx.doi.org/10.1176/appi.ajp.161.1.125.
28. Dolan, R. J. (2007). The human amygdala and orbital prefrontal cortex in behavioural regulation. Philosophical Transactions of the Royal Society Series B: Biological Sciences, 362,787-799. doi:10.1098/rstb.2007.2088
29. Dreher, J. C., Meyer-Lindenberg, A., Kohn, P., & Berman, K. F. (2008). Age-related changes in midbrain dopaminergic regulation of the human reward system. PNAS: Proceedings of the National Academy of Sciences of the United States of America, 105, 15106-15111. doi:10.1073/pnas.0802127105
30. Dunn, B. D., Dalgleish, T., & Lawrence, A. D. (2006). The somatic marker hypothesis: A critical evaluation. Neuroscience & Biobehavioral Reviews, 30, 239-271. doi:10.1016/j.neubiorev.2005.07.001
31. Eppinger, B., & Kray, J. (2011). To choose or to avoid: Age differences in learning from positive and negative feedback. Journal of Cognitive Neuroscience, 23, 41-52. doi:10.1162/jocn.2009.21364
32. Eppinger, B., Kray, J., Mecklinger, A., & John, O. (2007). Age differences in task switching and response monitoring: Evidence from ERPs. Biological Psychology, 75, 52-67. doi:10.1016/j.biopsycho.2006.12.001
33. Eppinger, B., Kray, J., Mock, B., & Mecklinger, A. (2008). Better or worse than expected? Aging, learning, and the ERN. Neuropsychologia, 46, 521-539. doi:10.1016/j.neuropsychologia.2007.09.001
34. Eppinger, B., Mock, B., & Kray, J. (2009). Developmental differences in learning and error processing: Evidence from ERPs. Psychophysiology, 46, 1043-1053. doi:10.1111/j.1469-8986.2009.00838.x
35. Fareri, D. S., Martin, L. N., & Delgado, M. R. (2008). Reward-related processing in the human brain: Developmental considerations. Development and Psychopathology, 20, 1191-1211. doi:10.1017/S0954579408000576
36. Fein, G., McGillivray, S., & Finn, P. (2007). Older adults make less advantageous decisions than younger adults: Cognitive and psychological correlates. Journal of the International Neuropsychology Society, 13, 480-489.
37. Fellows, L. K. (2006). Deciding how to decide: Ventromedial frontal lobe damage affects information acquisition in multi-attribute decision making. Brain, 129, 944-952. doi:10.1093/brain/awl017
38. Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003, March 21). Discrete coding of reward probability and uncertainty by dopamine neurons. Science, 299, 1898-1902. doi:10.1126/science.1077349
39. Frank, M. J., & Kong, L. (2008). Learning to avoid in older age. Psychology and Aging, 23, 392-398. doi:10.1037/0882-7974.23.2.392
40. Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004, December 10). By carrot or by stick: Cognitive reinforcement learning in parkinsonism. Science, 306, 1940-1943. doi:10.1126/science.1102941
41. Frith, U., & Frith, C. D. (2003). Development and neurophysiology of mentalizing. Philosophical Transactions of the Royal Society of London, Series B: Biological Sciences, 358, 459-473. doi:10.1098/rstb.2002.1218
42. Galvan, A., Hare, T. A., Parra, C. E., Penn, J., Voss, H., Glover, G.,&Casey, B. J. (2006). Earlier development of the accumbens relative to orbitofrontal cortex might underlie risk-taking behavior in adolescents. Journal of Neuroscience, 26, 6885-6892. doi:10.1523/JNEUROSCI.1062-06.2006
43. Gehring, W. J., & Willoughby, A. R. (2002, March 22). The medial frontal cortex and the rapid processing of monetary gains and losses. Science, 295, 2279-2282. http://dx.doi.org/10.1126/science.1066893
44. Gogtay, N., Giedd, J. N., Lusk, L., Hayashi, K. M., Greenstein, D., Vaituzis, A. C., & Thompson, P. M. (2004). Dynamic mapping of human cortical development during childhood through early adulthood. PNAS: Proceedings of the National Academy of Sciences of the United States of America, 101, 8174-8179. doi:10.1073/pnas.0402680101
45. Grabenhorst, F., & Rolls, E. (2011). Value, pleasure, and choice in the ventral prefrontal cortex. Trends in Cognitive Sciences, 15, 56-67. doi:10.1016/j.tics.2010.12.004
46. Haber, S. N., Kim, K. S., Mailly, P., & Calzavara, R. (2006). Rewardrelated cortical inputs define a large striatal region in primates that interface with associative cortical connections, providing a substrate for incentive-based learning. Journal of Neuroscience, 26, 8368-8376. doi:10.1523/JNEUROSCI.0271-06.2006
47. Haber, S. N., & Knutson, B. (2010). The reward circuit: Linking primate anatomy and human imaging. Neuropsychopharmacology, 35, 4-26. doi:10.1038/npp.2009.129
48. Haber, S. N., Lynd, E., Klein, C., & Groenewegen, H. J. (1990). Topographic organization of the ventral striatal efferent projections in the rhesus monkey: An anterograde tracing study. Journal of Comparative Neurology, 293, 282-298. doi:10.1002/cne.902930210
49. Hämmerer, D., Biele, G., Philiastides, M., Schroeder, S., Müller, V., & Li, S.-C. (2012). Life span differences in electrophysiological correlates of early monitoring and late evaluative processes of choice-outcome contingency: Differential roles of feedback-related negativity and feedbackrelated positivity. Manuscript in preparation.
50. Hämmerer, D., Li, S.-C., Müller, V., & Lindenberger, U. (2011). Life span differences in electrophysiological correlates of monitoring gains and losses during probabilistic reinforcement learning. Journal of Cognitive Neuroscience, 23, 579-592. doi:10.1162/jocn.2010.21475
51. Haycock, J. W., Becker, L., Ang, L., Furukawa, Y., Hornykiewicz, O., & Kish, S. J. (2003). Marked disparity between age-related changes in dopamine and other presynaptic dopaminergic markers in human striatum. Journal of Neurochemistry, 87, 574-585. doi:10.1046/j.1471-4159.2003.02017.x
52. Hedreen, J. C., & DeLong, M. R. (1991). Organization of striatopallidal, striatonigral, and nigrostriatal projections in the macaque. Journal of Comparative Neurology, 304, 569-595. doi:10.1002/cne.903040406
53. Herbert, M., B. Eppinger, B., & Kray, J. (2011). Younger but not older adults benefit from salient reward feedback during learning. Frontiers in Cognition, 2, 1-9.
54. Holroyd, C. B., & Coles, M. G. (2002). The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709. doi:10.1037/0033-295X.109.4.679
55. Holroyd, C. B., Hajcak, G., & Larsen, J. T. (2006). The good, the bad and the neutral: Electrophysiological responses to feedback stimuli. Brain Research, 1105, 93-101. http://dx.doi.org/10.1016/j.brainres.2005.12.015
56. Holroyd, C. B., Larsen, J. T., & Cohen, J. D. (2004). Context dependence of the event-related brain potential associated with reward and punishment. Psychophysiology, 41, 245-253. doi:10.1111/j.1469-8986.2004.00152.x
57. Hosseini, S. M. H., Rostami, M., Yomogida, Y., Takahashi, M., Tsukiura, T., & Kawashima, R. (2010). Aging and decision making under uncertainty: Behavioral and neural evidence for the preservation of decision making in the absence of learning in old age. NeuroImage, 52, 1514-1520. doi:10.1016/j.neuroimage.2010.05.008
58. Huizinga, M., & van der Molen, M. W. (2007). Age-group differences in set-switching and set-maintenance on the Wisconsin Card Sorting Task. Developmental Neuropsychology, 31, 193-215. doi:10.1080/87565640701190817
59. Inoue, M., Suhara, T., Sudo, Y., Okubo, Y., Yasuno, F., Kishimoto, T.,... Tanada, S. (2001). Age-related reduction of extrastriatal dopamine D2 receptor measured by PET. Life Sciences, 69, 1079-1084. doi:10.1016/S0024-3205(01)01205-X
60. Izquierdo, A., & Murray, E. A. (2007). Selective bilateral amygdala lesions in rhesus monkeys fail to disrupt object reversal learning. Journal of Neuroscience, 27, 1054-1062. doi:10.1523/JNEUROSCI.3616-06.2007
61. Jacobson, A., Green, E., & Murphy, C. (2010). Age-related functional changes in gustatory and reward processing regions: An fMRI study. NeuroImage, 53, 602-610. doi:/10.1016/j.neuroimage.2010.05.012
62. Joel, D., & Weiner, I. (1997). The connections of the primate subthalamic nucleus: Indirect pathways and the open-interconnected scheme of basal ganglia-thalamocortical circuitry. Brain Research Reviews, 23, 62-78. doi:10.1016/S0165-0173(96)00018-5
63. Kaasinen, V., Vilkman, H., Hietala, J., Någren, K., Helenius, H., Olsson, H.,... Rinne, J. (2000). Age-related dopamine D2/D3 receptor loss in extrastriatal regions of the human brain. Neurobiology of Aging, 21, 683-688. doi:10.1016/S0197-4580(00)00149-4
64. Kable, J. W., & Glimcher, P. W. (2007). The neural correlates of subjective value during intertemporal choice. Nature Neuroscience, 10, 1625-1633. doi:10.1038/nn2007
65. Kerns, J. G. (2006). Anterior cingulate and prefrontal cortex activity in an FMRI study of trial-to-trial adjustments on the Simon task. NeuroImage, 33, 399-405. doi:10.1016/j.neuroimage.2006.06.012
66. Kerr, A., & Zelazo, P. D. (2004). Development of "hot" cognitive function: The children's gambling task. Brain and Cognition, 55, 148-157. doi: 10.1016/S0278-2626(03)00275-6
67. Knutson, B., Taylor, J., Kaufman, M., Peterson, R., & Glover, G. (2005). Distributed neural representation of expected value. Journal of Neuroscience, 25, 4806-4812. doi:10.1523/JNEUROSCI.0642-05.2005
68. Kray, J., & Lindenberger, U. (2000). Adult age differences in task switching. Psychology and Aging, 15, 126-147. doi:10.1037/0882-7974.15.1.126
69. Kringelbach, M. L. (2005). The human orbitofrontal cortex: Linking reward to hedonic experience. Nature Reviews Neuroscience, 6, 691-702. doi:10.1038/nrn1747
70. Lewis, M. J. (1981). Age-related decline in brain stimulation reward: Rejuvenation by amphetamine. Experimental Aging Research, 7, 225-234. doi:10.1080/03610738108259806
71. Li, S.-C., Lindenberger, U., & Bäckman, L. (2010). Dopaminergic modulation of cognition across the life span. Neuroscience & Biobehavioral Reviews, 34, 625-630. doi:10.1016/j.neubiorev.2010.02.003
72. Li, S.-C., Lindenberger, U., & Sikström, S. (2001). Aging cognition: From neuromodulation to representation to cognition. Trends in Cognitive Sciences, 5, 479-486. doi:1016/S1364-6613(00)01769-1
73. Lynd-Balta, E., & Haber, S. N. (1994a). The organization of midbrain projections to the striatum in the primate: Sensorimotor-related striatum versus ventral striatum. Neuroscience, 59, 625-640. doi:10.1016/0306-4522(94)90182-1
74. Lynd-Balta, E., & Haber, S. N. (1994b). Primate striatonigral projections: A comparison of the sensorimotor-related striatum and the ventral striatum. Journal of Comparative Neurology, 345, 562-578. doi:10.1002/cne.903450407
75. Madsen, K. S., Baaré, W. F. C., Vestergaard, M., Skimminge, A., Ejersbo, L. R., Ramsøy, T. Z.,... Jernigan, T. L. (2010). Response inhibition is associated with white matter microstructure in children. Neuropsychologia, 48, 854-862. doi:10.1016/j.neuropsychologia.2009.11.001
76. Mata, R., Schooler, L. J., & Rieskamp, J. (2007). The aging decision maker: Cognitive aging and the adaptive selection of decision strategies. Psychology and Aging, 22, 796-810. doi:1037/0882-7974.22.4.796
77. Mata, R., von Helversen, B., & Rieskamp, J. (2010). Learning to choose: Cognitive aging and strategy selection learning in decision making. Psychology and Aging, 25, 299-309. doi:10.1037/a0018923
78. Mathewson, K. J., Dywan, J., Snyder, P. J., Tays, W. J., & Segalowitz, S. J. (2008). Aging and electrocortical response to error feedback during a spatial learning task. Psychophysiology, 45, 936-948. doi:10.1111/j.1469-8986.2008.00699.x
79. McClure, S. M., Ericson, K. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2007). Time discounting for primary rewards. Journal of Neuroscience, 27, 5796-5804. doi:10.1523/JNEUROSCI.4246-06.2007
80. Mell, T., Wartenburger, I., Marschner, A., Villringer, A., Reischies, F. M., & Heekeren, H. R. (2009). Altered function of ventral striatum during reward-based decision making in old age. Frontiers in Human Neuroscience, 3, 34. doi:10.3389/neuro.09.034.2009
81. Miller, E. K., & Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, 24, 167-202. doi: 10.1146/annurev.neuro.24.1.167
82. Miltner, W. H. R., Braun, C. H., & Coles, M. G. H. (1997). Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a "generic" neural system for error detection. Journal of Cognitive Neuroscience, 9, 788-798. doi:10.1162/jocn.1997.9.6.788
83. Mohr, P. N., Li, S.-C., & Heekeren, H. (2010). Neuroeconomics and aging: Neuromodulation of economic decision making in old age. Neuroscience & Biobehavioral Reviews, 34, 678-688. doi:10.1016/j.neubiorev.2009.05.010
84. Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004, October 14). Computational roles for dopamine in behavioural control. Nature, 431, 760-767. doi:10.1038/nature03015
85. Murray, E. A. (2007). The amygdala, reward and emotion. Trends in Cognitive Sciences, 11, 489-497. doi:10.1016/j.tics.2007.08.013
86. Nieuwenhuis, S., Yeung, N., Holroyd, C. B., Schurger, A., & Cohen, J. D. (2004). Sensitivity of electrophysiological activity from medial frontal cortex to utilitarian and performance feedback. Cerebral Cortex, 14, 741-747. doi:10.1093/cercor/bhh034
87. Niv, Y., & Schoenbaum, G. (2008). Dialogues on prediction errors. Trends in Cognitive Sciences, 12, 265-272. doi:10.1016/j.tics.2008.03.006
88. O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004, April 16). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science, 304, 452-454. doi:10.1126/science.1094285
89. Olson, E. A., Collins, P. F., Hooper, C. J., Muetzel, R., Lim, K. O., & Luciana, M. (2009). White matter integrity predicts delay discounting behavior in 9-to 23-year-olds: A diffusion tensor imaging study. Journal of Cognitive Neuroscience, 21, 1406-1421. doi:10.1162/jocn.2009.21107
90. Pachur, T., Mata, R., & Schooler, L. J. (2009). Cognitive aging and the adaptive use of recognition in decision making. Psychology and Aging, 24, 901-915. doi:10.1037/a0017211
91. Parent, A. (1990). Extrinsic connections of the basal ganglia. Trends in Neurosciences, 13, 254-258. doi:10.1016/0166-2236(90)90105-J
92. Parent, A., & Hazrati, L. N. (1995).Functional anatomy of the basal ganglia: I. The cortico-basal ganglia-thalamo-cortical loop. Brain Research Reviews, 20, 91-127. doi:10.1016/0165-0173(94)00007-C
93. Paxton, J. L., Barch, D. M., Racine, C. A., & Braver, T. S. (2008). Cognitive control, goal maintenance, and prefrontal function in healthy aging. Cerebral Cortex, 18, 1010-1028. doi:10.1093/cercor/bhm135
94. Philiastides, M. G., Biele, G., Vavatzanidis, N., Kazzer, P., & Heekeren, H. R. (2010). Temporal dynamics of prediction error processing during reward-based decision making. NeuroImage, 53, 221-232. doi:10.1016/j.neuroimage.2010.05.052
95. Polyn, S. M., & Kahana, M. J. (2008). Memory search and the neural representation of context. Trends in Cognitive Sciences, 12, 24-30. doi:10.1016/j.tics.2007.10.010
96. Rangel, A., Camerer, C., & Montague, P. R. (2008). A framework for studying the neurobiology of value-based decision making. Nature Reviews Neuroscience, 9, 545-556. doi:10.1038/nrn2357
97. Reeves, S., Bench, C., & Howard, R. (2002). Ageing and the nigrostriatal dopaminergic system. International Journal of Geriatric Psychiatry, 17, 359-370. doi:10.1002/gps.606
98. Ridderinkhof, K. R., Ullsperger, M., Crone, E. A., & Nieuwenhuis, S. (2004, October 15). The role of the medial frontal cortex in cognitive control. Science, 306, 443-447. doi:10.1126/science.1100301
99. Rinne, J. O., Lonnberg, P., & Marjamaki, P. (1990). Age-dependent decline in human brain dopamine D1 and D2 receptors. Brain Research, 508, 349-352. doi:10.1016/0006-8993(90)90423-9
100. Roesch, M. R., Calu, D. J., & Schoenbaum, G. (2007). Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nature Neuroscience, 10, 1615-1624. doi:10.1038/nn2013
101. Rushworth, M. F. S., & Behrens, T. E. (2008). Choice, uncertainty, and value in prefrontal and cingulate cortex. Nature Neuroscience, 11, 389-397. doi:10.1038/nn2066
102. Rushworth, M. F. S., Noonan, M. P., Boorman, E. D., Walton, M. E., & Behrens, T. E. (2011). Frontal cortex and reward-guided learning and decision-making. Neuron, 70, 1054-1069. doi:10.1016/j.neuron.2011.05.014
103. Rushworth, M. F. S., Walton, M. E., Kennerley, S. W., & Bannerman, D. M. (2004). Action sets and decisions in the medial frontal cortex. Trends in Cognitive Sciences, 8, 410-417. doi:10.1016/j.tics.2004.07.009
104. Samanez-Larkin, G. R., & Carstensen, L. L. (2011). Socioemotional functioning and the aging brain. In J. Decety & J. T. Cacioppo (Eds.), The Oxford handbook of social neuroscience (pp. 507-521). New York, NY: Oxford University Press.
105. Samanez-Larkin, G. R., Gibbs, S. E. B., Khanna, K., Nielsen, L., Carstensen, L. L., & Knutson, B. (2007). Anticipation of monetary gain but not loss in healthy older adults. Nature Neuroscience, 10, 787-791.
106. Samanez-Larkin, G. R., Kuhnen, C. M., Yoo, D. J., & Knutson, B. (2010). Variability in nucleus accumbens activity mediates age-related suboptimal financial risk taking. Journal of Neuroscience, 30, 1426-1434. doi:10.1523/JNEUROSCI.4902-09.2010
107. Samanez-Larkin, G. R., Wagner, A. D., & Knutson, B. (2011). Expected value information improves financial risk taking across the adult life span. Social, Cognitive, & Affective Neuroscience, 6, 207-217.
108. Schott, B. H., Niehaus, L., Wittmann, B. C., Schütze, H., Seidenbecher, C. I., Heinze, H. J., & Düzel, E (2007). Ageing and early-stage Parkinson's disease affect separable neural mechanisms of mesolimbic reward processing. Brain, 130, 2412-2424.
109. Schultz, W. (1998). Predictive reward signal of dopamine neurons. Journal of Neurophysiology, 80, 1-27.
110. Schultz, W. (2000). Multiple reward signals in the brain. Nature Reviews Neuroscience, 1, 199-207. doi:10.1038/35044563
111. Schultz, W. (2002). Getting formal with dopamine and reward. Neuron, 36, 241-263. doi:10.1016/S0896-6273(02)00967-4
112. Schultz, W. (2007). Behavioral dopamine signals. Trends in Neurosciences, 30, 203-210. doi:10.1016/j.tins.2007.03.007
113. Seeman, P., Bzowej, N. H., Guan, H. C., Bergeron, C., Becker, L. E., Reynolds, G. P.,... Watanabe, S (1987). Human brain dopamine receptors in children and aging adults. Synapse, 1, 399-404. doi:10.1002/syn.890010503
114. Selemon, L. D., & Goldman-Rakic, P. S. (1990). Topographic intermingling of striatonigral and striatopallidal neurons in the rhesus monkey. Journal of Comparative Neurology, 297, 359-376. doi:10.1002/cne.902970304
115. Severson, J. A., Marcusson, J., Winblad, B., & Finch, C. E. (1982). Age-correlated loss of dopaminergic binding sites in human basal ganglia. Journal of Neurochemistry, 39, 1623-1631. doi:10.1111/j.1471-4159.1982.tb07996.x
116. Simons, J. S., & Spiers, H. J. (2003). Prefrontal and medial temporal lobe interactions in long-term memory. Nature Reviews Neuroscience, 4, 637-648. doi:10.1038/nrn1178
117. Smith, A. D., & Bolam, J. P. (1990). The neural network of the basal ganglia as revealed by the study of synaptic connections of identified neurones. Trends in Neurosciences, 13, 259-265. doi:10.1016/0166-2236(90)90106-K
118. Somerville, L.H., & Casey, B. J. (2010). Developmental neurobiology of cognitive control and motivational systems. Current Opinion in Neurobiology, 20, 236-241. doi:10.1016/j.conb.2010.01.006
119. Sonnenschein, B., & Franklin, K. B. J. (2008). The rewarding efficacy of brain stimulation and its modulation by dopaminergic drugs in young adult and old BNF344F1 rats. Pharmacology Biochemistry and Behavior, 90, 735-741. doi:10.1016/j.pbb.2008.06.001
120. Sowell, E. R., Peterson, B. S., Thompson, P. M., Welcome, S. E., Henkenius, A. L., & Toga, A. W. (2003). Mapping cortical change across the human life span. Nature Neuroscience, 6, 309-315. doi:10.1038/nn1008
121. Spear, L. P. (2000). The adolescent brain and age-related behavioral manifestations. Neuroscience & Biobehavioral Reviews, 24, 417-463. doi:10.1016/S0149-7634(00)00014-2
122. Starns, J. J., & Ratcliff, R. (2010). The effects of aging on the speed-accuracy compromise: Boundary optimality in the diffusion model. Psychology and Aging, 25, 377-390. doi:10.1037/a0018022
123. Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005, March 11). Adaptive coding of reward value by dopamine neurons. Science, 307, 1642-1645. doi:10.1126/science.1105370
124. van Duijvenvoorde, A. C., Zanolie, K., Rombouts, S. A., Raijmakers, M. E., & Crone, E. A. (2008). Evaluating the negative or valuing the positive? Neural mechanisms supporting feedback-based learning across development. Journal of Neuroscience, 28, 9495-9503. doi:10.1523/JNEUROSCI.1485-08.2008
125. van Leijenhorst, L., Crone, E. A., & Bunge, S. A. (2006). Neural correlates of developmental differences in risk estimation and feedback processing. Neuropsychologia, 44, 2158-2170. doi:10.1016/j.neuropsychologia.2006.02.002
126. Verhaeghen, P., & Cerella, J. (2002). Aging, executive control, and attention: A review of meta-analyses. Neuroscience & Biobehavioral Reviews, 26, 849-857. doi:10.1016/S0149-7634(02)00071-4
127. Verhaeghen, P., & De Meersman, L. (1998). Aging and the Stroop effect: A meta-analysis. Psychology and Aging, 13, 120-126. doi:10.1037/0882-7974.13.1.120
128. Volkow, N. D., Logan, J., Fowler, J. S., Wang, G. J., Gur, R. C., Wong, C.,... Papass, N. (2000). Association between age-related decline in brain dopamine activity and impairment in frontal and cingulate metabolism. American Journal of Psychiatry, 157, 75-80.
129. Waelti, P., Dickinson, A., & Schultz, W. (2001, July 5). Dopamine responses comply with basic assumptions of formal learning theory. Nature, 412, 43-48. doi:10.1038/35083500
130. Walton, M. E., Devlin, J. T., & Rushworth, M. F. (2004). Interactions between decision making and performance monitoring within prefrontal cortex. Nature Neuroscience, 7, 1259-1265. doi:10.1038/nn1339
131. West, R. (2004). The effects of aging on controlled attention and conflict processing in the Stroop task. Journal of Cognitive Neuroscience, 16, 103-113. doi:10.1162/089892904322755593
132. West, R., & Alain, C. (2000). Age-related decline in inhibitory control contributes to the increased Stroop effect observed in older adults. Psychophysiology, 37, 179-189. doi:10.1111/1469-8986.3720179
133. West, R. L. (1996). An application of prefrontal cortex function theory to cognitive aging. Psychological Bulletin, 120, 272-292. doi:10.1037/0033-2909.120.2.272
134. Wise, R. A. (2002). Brain reward circuitry: Insights from unsensed incentives. Neuron, 36, 229-240. doi:10.1016/S0896-6273(02)00965-0
135. Wood, S., Busemeyer, J., Koling, A., Cox, C. R., & Davis, H. (2005). Older adults as adaptive decision makers: Evidence from the Iowa gambling task. Psychology and Aging, 20, 220-225. doi:10.1037/0882-7974.20.2.220
136. Wyvell, C. L., & Berridge, K. C. (2001). Incentive-sensitization by previous amphetamine exposure: Increased cue-triggered "wanting" for sucrose reward. Journal of Neuroscience, 21, 7831-7840.
137. Záborszky, L., & Cullinan, W. E. (1992). Projections from the nucelus accumbens to cholinergic neurons of the ventral pallidum: A correlated light and electron-microscopic double-immunolabeling study in rat. Brain Research, 570, 92-101. doi:10.1016/0006-8993(92)90568-T
138. Zamarian, L., Sinz, H., Bonatti, E., Gamboz, N., & Delazer, M. (2008). Normal aging affects decisions under ambiguity, but not decisions under risk. Neuropsychology, 22, 645-657. doi:10.1037/0894-4105.22.5.645