Life span differences in electrophysiological correlates of monitoring gains and losses during probabilistic reinforcement learning

Journal of Cognitive Neuroscience

Volumn 23, Issue 3, 2011, Pages 579-592

  Hämmerer, Dorothea ^a   Li, Shu Chen ^a   Müller, Viktor ^a   Lindenberger, Ulman ^a  

^a MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ADOLESCENT; ADULT; AGED; ARTICLE; CHILD; COGNITIVE DEVELOPMENT; CONTROLLED STUDY; ELECTROPHYSIOLOGY; FEMALE; HUMAN; LEARNING; LIFESPAN; MALE; NEGATIVE FEEDBACK; NEUROMODULATION; ONTOGENY; OUTCOME ASSESSMENT; PRIORITY JOURNAL; REINFORCEMENT; SCHOOL CHILD; SENSITIVITY ANALYSIS;

ADOLESCENT; ADULT; AGE FACTORS; AGED; AGING; ANALYSIS OF VARIANCE; BRAIN; BRAIN MAPPING; CHILD; CHOICE BEHAVIOR; ELECTROENCEPHALOGRAPHY; FEMALE; HUMANS; MALE; PROBABILITY LEARNING; REACTION TIME; REINFORCEMENT (PSYCHOLOGY);

EID: 78650319424     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn.2010.21475     Document Type: Article

References (91)

1. Aalto, S., Bruck, A., Laine, M., Nagren, K., & Rinne, J. O. (2005). Frontal and temporal dopamine release during working memory and attention tasks in healthy humans: A positron emission tomography study using the high-affinity dopamine D2 receptor ligand [11C]FLB 457. Journal of Neuroscience, 25, 2471-2477.
2. Andersen, S. L., Dumont, N. L., & Teicher, M. H. (1997). Developmental differences in dopamine synthesis inhibition by (+/-) -7OH-DPAT. Naunyn-Schmiedeberg's Archives of Pharmacology, 356, 173-181.
3. Babcock, R. L., & Salthouse, T. A. (1990). Effects of increased processing demands on age differences in working memory. Psychology and Aging, 5, 421-428.
4. Bäckman, L., Ginovart, N., Dixon, R. A., Wahlin, T. B., Wahlin, A., Halldin, C., et al. (2000). Age-related cognitive deficits mediated by changes in the striatal dopamine system. American Journal of Psychiatry, 157, 635-637.
5. Bäckman, L., Lindenberger, U., Li, S.-C., & Nyberg, L. (2010). Linking cognitive aging to alterations in dopamine neurotransmitter functioning: Recent data and future avenues. Neuroscience & Biobehavioral Reviews, 34, 670-677.
6. Bäckman, L., Nyberg, L., Lindenberger, U., Li, S.-C., & Farde, L. (2006). The correlative triad among aging, dopamine, and cognition: Current status and future prospects. Neuroscience & Biobehavioral Reviews, 30, 791-807.
7. Baltes, P. B. (1987). Theoretical propositions of life-span developmental psychology: On the dynamics between growth and decline. Developmental Psychology, 23, 611-626.
8. Benes, F. M. (2001). The development of prefrontal cortex: The maturation of neurotransmitter systems and their interactions. In C. A. Nelson & M. Luciana (Eds.), Handbook of developmental cognitive neuroscience (pp. 79-92). Cambridge, MA: MIT Press.
9. Brehmer, Y., Li, S. C., Müller, V., von Oertzen, T., & Lindenberger, U. (2007). Memory plasticity across the life span: Uncovering children's latent potential. Developmental Psychology, 43, 465-478.
10. Campbell, K. B., Courchesne, E., Picton, T. W., & Squires, K. C. (1979). Evoked potential correlates of human information processing. Biological Psychology, 8, 45-68.
11. Cohen, M. X. (2008). Neurocomputational mechanisms of reinforcement-guided learning in humans: A review. Cognitive, Affective, and Behavioral Neuroscience, 8, 113-125.
12. Crone, E. A., Jennings, J. R., & van der Molen, M. W. (2004). Developmental change in feedback processing as reflected by phasic heart rate changes. Developmental Psychology, 40, 1228-1238.
13. Crone, E. A., Somsen, R. J., van Beek, B., & van Der Molen, M. W. (2004). Heart rate and skin conductance analysis of antecedents and consequences of decision making. Psychophysiology, 41, 531-540.
14. Crone, E. A., Somsen, R. J., Zanolie, K., & van der Molen, M. W. (2006). A heart rate analysis of developmental change in feedback processing and rule shifting from childhood to early adulthood. Journal of Experimental Child Psychology, 95, 99-116.
15. Crone, E. A., van der Veen, F. M., van der Molen, M. W., Somsen, R. J., van Beek, B., & Jennings, J. R. (2003). Cardiac concomitants of feedback processing. Biological Psychology, 64, 143-156.
16. Delorme, A., & Makeig, S. (2004). EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods, 134, 9-21.
17. Diamond, A. (1996). Evidence for the importance of dopamine for prefrontal cortex functions early in life. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 351, 1483-1493.
18. Diamond, A. (2002). Normal development of prefrontal cortex from birth to young adulthood: Cognitive functions, anatomy, and biochemistry. In D. T. Stuss & R. T. Knight (Eds.), Principles of frontal lobe function (pp. 466-503). London, UK: Oxford University Press.
19. Diamond, A., Briand, L., Fossella, J., & Gehlbach, L. (2004). Genetic and neurochemical modulation of prefrontal cognitive functions in children. American Journal of Psychiatry, 161, 125-132.
20. Eppinger, B., Kray, J., Mecklinger, A., & John, O. (2007). Age differences in task switching and response monitoring: Evidence from ERPs. Biological Psychology, 75, 52-67.
21. Eppinger, B., Kray, J., Mock, B., & Mecklinger, A. (2008). Better or worse than expected? Aging, learning, and the ERN. Neuropsychologia, 46, 521-539.
22. Eppinger, B., Mock, B., & Kray, J. (2009). Developmental differences in learning and error processing: Evidence from ERPs. Psychophysiology, 46, 1043-1053.
23. Frank, M. J. (2005). Dynamic dopamine modulation in the basal ganglia: A neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. Journal of Cognitive Neuroscience, 17, 51-72.
24. Frank, M. J., & Kong, L. (2008). Learning to avoid in older age. Psychology and Aging, 23, 392-398.
25. Frank, M. J., Moustafa, A. A., Haughey, H. M., Curran, T., & Hutchison, K. E. (2007). Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning. Proceedings of the National Academy of Sciences, U.S.A., 104, 16311-16316.
26. Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004). By carrot or by stick: Cognitive reinforcement learning in parkinsonism. Science, 306, 1940-1943.
27. Frank, M. J., Woroch, B. S., & Curran, T. (2005). Error-related negativity predicts reinforcement learning and conflict biases. Neuron, 47, 495-501.
28. Galvan, A., Hare, T. A., Parra, C. E., Penn, J., Voss, H., Glover, G., et al. (2006). Earlier development of the accumbens relative to orbitofrontal cortex might underlie risk-taking behavior in adolescents. Journal of Neuroscience, 26, 6885-6892.
29. Gehring, W. J., & Willoughby, A. R. (2002). The medial frontal cortex and the rapid processing of monetary gains and losses. Science, 295, 2279-2282.
30. Hajcak, G., Holroyd, C. B., Moser, J. S., & Simons, R. F. (2005). Brain potentials associated with expected and unexpected good and bad outcomes. Psychophysiology, 42, 161-170.
31. Hajcak, G., Moser, J. S., Holroyd, C. B., & Simons, R. F. (2006). The feedback-related negativity reflects the binary evaluation of good versus bad outcomes. Biological Psychology, 71, 148-154.
32. Hajcak, G., Moser, J. S., Holroyd, C. B., & Simons, R. F. (2007). It's worse than you thought: The feedback negativity and violations of reward prediction in gambling tasks. Psychophysiology, 44, 905-912.
33. Hämmerer, D., Li, S.-C., Müller, V., & Lindenberger, U. (submitted). Response conflict monitoring across the lifespan: Assessing the contribution of cue utilization, response suppression, and motor preparation with eventrelated potentials.
34. Hämmerer, D., Li, S.-C., Völkle, M., Müller, V., & Lindenberger, U. (in preparation). The reliability of event-related potentials related to performance monitoring across the lifespan.
35. Holroyd, C. B., & Coles, M. G. (2002). The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709.
36. Holroyd, C. B., Hajcak, G., & Larsen, J. T. (2006). The good, the bad and the neutral: Electrophysiological responses to feedback stimuli. Brain Research, 1105, 93-101.
37. Holroyd, C. B., Larsen, J. T., & Cohen, J. D. (2004). Context dependence of the event-related brain potential associated with reward and punishment. Psychophysiology, 41, 245-253.
38. Holroyd, C. B., Nieuwenhuis, S., Yeung, N., & Cohen, J. D. (2003). Errors in reward prediction are reflected in the event-related brain potential. NeuroReport, 14, 2481-2484.
39. Holroyd, C. B., Yeung, N., Coles, M. G., & Cohen, J. D. (2005). A mechanism for error detection in speeded response time tasks. Journal of Experimental Psychology: General, 134, 163-191.
40. Horn, J. L. (1989). Models of intelligence. In R. L. Linn (Ed.), Intelligence: Measurement, theory, and public policy (pp. 29-73). Urbana, IL: University of Illinois Press.
41. Jonkman, L. M. (2006). The development of preparation, conflict monitoring and inhibition from early childhood to young adulthood: A Go/Nogo ERP study. Brain Research, 1097, 181-193.
42. Karlsson, S., Nyberg, L., Karlsson, P., Fischer, H., Thilers, P., MacDonald, S., et al. (2009). Modulation of striatal dopamine D1 binding by cognitive processing. Neuroimage, 48, 398-404.
43. Kennerley, S. W., Walton, M. E., Behrens, T. E., Buckley, M. J., & Rushworth, M. F. (2006). Optimal decision making and the anterior cingulate cortex. Nature Neuroscience, 9, 940-947.
44. Kray, J., Eber, J., & Karbach, J. (2008). Verbal self-instructions in task switching: A compensatory tool for action-control deficits in childhood and old age? Developmental Science, 11, 223-236.
45. Kray, J., & Lindenberger, U. (2000). Adult age differences in task switching. Psychology and Aging, 15, 126-144.
46. Lehrl, S. (1977). Mehrfachwahl-Wortschatz-Test B (MWT-B). Erlangen: Straube.
47. Li, S.-C., Hämmerer, D., Müller, V., Hommel, B., & Lindenberger, U. (2009). Lifespan development of stimulus-response conflict cost: Similarities and differences between maturation and senescence. Psychological Research, 73, 777-785.
48. Li, S.-C., Lindenberger, U., & Bäckman, L. (2010). Dopaminergic modulation of cognition across the lifespan. Neuroscience & Biobehavioral Reviews, 34, 625-630.
49. Li, S.-C., Lindenberger, U., Hommel, B., Aschersleben, G., Prinz, W., & Baltes, P. B. (2004). Transformations in the couplings among intellectual abilities and constituent cognitive processes across the life span. Psychological Science, 15, 155-163.
50. Li, S.-C., Lindenberger, U., Nyberg, L., Heekeren, H. R., & Bäckman, L. (2009). Dopaminergic modulation of cognition in human aging. In W. Jagust & M. D'Esposito (Eds.), Imaging the aging brain (pp. 71-92). New York: Oxford University Press.
51. Li, S.-C., Lindenberger, U., & Sikström, S. (2001). Aging cognition: From neuromodulation to representation to cognition. Trends in Cognitive Sciences, 5, 479-486.
52. Lindenberger, U. (2001). Lifespan theories of cognitive development. In N. J. Smelser & P. B. Baltes (Eds.), International encyclopedia of the social and behavioral sciences ( Vol. 13, pp. 8848-8854). Amsterdam: Elsevier.
53. Lindenberger, U., Mayr, U., & Kliegl, R. (1993). Speed and intelligence in old age. Psychology and Aging, 8, 207-220.
54. Liotti, M., Pliszka, S. R., Perez, R., Kothmann, D., & Woldorff, M. G. (2005). Abnormal brain activity related to performance monitoring and error detection in children with ADHD. Cortex, 41, 377-388.
55. Luciana, M., Conklin, H. M., Hooper, C. J., & Yarger, R. S. (2005). The development of nonverbal working memory and executive control processes in adolescents. Child Development, 76, 697-712.
56. Luna, B., & Sweeney, J. A. (2004). The emergence of collaborative brain function: FMRI studies of the development of response inhibition. Annals of the New York Academy of Sciences, 1021, 296-309.
57. Luu, P., Tucker, D. M., Derryberry, D., Reed, M., & Poulsen, C. (2003). Electrophysiological responses to errors and feedback in the process of action regulation. Psychological Science, 14, 47-53.
58. Marschner, A., Mell, T., Wartenburger, I., Villringer, A., Reischies, F. M., & Heekeren, H. R. (2005). Reward-based decision-making and aging. Brain Research Bulletin, 67, 382-390.
59. Mathewson, K. J., Dywan, J., Snyder, P. J., Tays, W. J., & Segalowitz, S. J. (2008). Aging and electrocortical response to error feedback during a spatial learning task. Psychophysiology, 45, 936-948.
60. Mell, T., Heekeren, H. R., Marschner, A., Wartenburger, I., Villringer, A., & Reischies, F. M. (2005). Effect of aging on stimulus-reward association learning. Neuropsychologia, 43, 554-563.
61. Miltner, W. H. R., Braun, C. H., & Coles, M. G. H. (1997). Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a "generic" neural system for error detection. Journal of Cognitive Neuroscience, 9, 788-798.
62. Müller, V., Brehmer, Y., von Oertzen, T., Li, S. C., & Lindenberger, U. (2008). Electrophysiological correlates of selective attention: A lifespan comparison. BMC Neuroscience, 9, 18.
63. Nagel, I. E., Chicherio, C., Li, S. C., von Oertzen, T., Sander, T., Villringer, A., et al. (2008). Human aging magnifies genetic effects on executive functioning and working memory. Frontiers in Human Neuroscience, 2, 1.
64. Nieuwenhuis, S., Holroyd, C. B., Mol, N., & Coles, M. G. (2004). Reinforcement-related brain potentials from medial frontal cortex: Origins and functional significance. Neuroscience & Biobehavioral Reviews, 28, 441-448.
65. Nieuwenhuis, S., Ridderinkhof, K. R., Talsma, D., Coles, M. G., Holroyd, C. B., Kok, A., et al. (2002). A computational account of altered error processing in older age: Dopamine and the error-related negativity. Cognitive, Affective, and Behavioral Neuroscience, 2, 19-36.
66. Nieuwenhuis, S., Yeung, N., Holroyd, C. B., Schurger, A., & Cohen, J. D. (2004). Sensitivity of electrophysiological activity from medial frontal cortex to utilitarian and performance feedback. Cerebral Cortex, 14, 741-747.
67. Oldfield, R. C. (1971). The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia, 9, 97-113.
68. Pietschmann, M., Simon, K., Endrass, T., & Kathmann, N. (2008). Changes of performance monitoring with learning in older and younger adults. Psychophysiology, 45, 559-568.
69. Pizzagalli, D. A., Evins, A. E., Schetter, E. C., Frank, M. J., Pajtas, P. E., Santesso, D. L., et al. (2008). Single dose of a dopamine agonist impairs reinforcement learning in humans: Behavioral evidence from a laboratory-based measure of reward responsiveness. Psychopharmacology, 196, 221-232.
70. Raz, N., Lindenberger, U., Rodrigue, K. M., Kennedy, K. M., Head, D., Williamson, A., et al. (2005). Regional brain changes in aging healthy adults: General trends, individual differences and modifiers. Cerebral Cortex, 15, 1676-1689.
71. Redgrave, P., Gurney, K., & Reynolds, J. (2008). What is reinforced by phasic dopamine signals? Brain Research Reviews, 58, 322-339.
72. Resnick, S. M., Pham, D. L., Kraut, M. A., Zonderman, A. B., & Davatzikos, C. (2003). Longitudinal magnetic resonance imaging studies of older adults: A shrinking brain. Journal of Neuroscience, 23, 3295-3301.
73. Ridderinkhof, K. R., Ullsperger, M., Crone, E. A., & Nieuwenhuis, S. (2004). The role of the medial frontal cortex in cognitive control. Science, 306, 443-447.
74. Rosenberg, D. R., & Lewis, D. A. (1994). Changes in the dopaminergic innervation of monkey prefrontal cortex during late postnatal development. A tyrosine hydroxylase immunohistochemical study. Biological Psychiatry, 36, 272-277.
75. Rushworth, M. F., & Behrens, T. E. (2008). Choice, uncertainty and value in prefrontal and cingulate cortex. Nature Neuroscience, 11, 3289-3397.
76. Santesso, D. L., Evins, A. E., Frank, M. J., Schetter, E. C., Boogdan, R., & Pizzagalli, D A. (2009). Single dose of a dopamine agonist impairs reinforcement learning in humans: Evidence from event-related potentials and computational modeling of striatal-cortical function. Human Brain Mapping, 30, 1963-1967.
77. Schultz, W. (2000). Multiple reward signals in the brain. Nature Reviews Neuroscience, 1, 199-207.
78. Schultz, W. (2002). Getting formal with dopamine and reward. Neuron, 36, 241-263.
79. Schultz, W. (2007). Behavioral dopamine signals. Trends in Neurosciences, 30, 203-210.
80. Shima, K., & Tanji, J. (1998). Role for cingulate motor area cells in voluntary movement selection based on reward. Science, 282, 1335-1338.
81. Shing, Y. L., Werkle-Bergner, M., Li, S. C., & Lindenberger, U. (2008). Associative and strategic components of episodic memory: A life-span dissociation. Journal of Experimental Psychology: General, 137, 495-513.
82. Sowell, E. R., Peterson, B. S., Thompson, P. M., Welcome, S. E., Henkenius, A. L., & Toga, A. W. (2003). Mapping cortical change across the human lifespan. Nature Neuroscience, 6, 309-315.
83. van Duijvenvoorde, A. C., Zanolie, K., Rombouts, S. A., Raijmakers, M. E., & Crone, E. A. (2008). Evaluating the negative or valuing the positive? Neural mechanisms supporting feedback-based learning across development. Journal of Neuroscience, 28, 9495-9503.
84. van Leijenhorst, L., Crone, E. A., & Bunge, S. A. (2006). Neural correlates of developmental differences in risk estimation and feedback processing. Neuropsychologia, 44, 2158-2170.
85. Volkow, N. D., Logan, J., Fowler, J. S., Wang, G. J., Gur, R. C., Wong, C., et al. (2000). Association between age-related decline in brain dopamine activity and impairment in frontal and cingulate metabolism. American Journal of Psychiatry, 157, 75-80.
86. Walton, M. E., Bannerman, D. M., & Rushworth, M. F. (2002). The role of rat medial frontal cortex in effort-based decision making. Journal of Neuroscience, 22, 10996-11003.
87. Walton, M. E., Croxson, P. L., Rushworth, M. F., & Bannerman, D. M. (2005). The mesocortical dopamine projection to anterior cingulate cortex plays no role in guiding effortrelated decisions. Behavioral Neuroscience, 119, 323-328.
88. Walton, M. E., Devlin, J. T., & Rushworth, M. F. (2004). Interactions between decision making and performance monitoring within prefrontal cortex. Nature Neuroscience, 7, 1259-1265.
89. Waszack, F., Li, S.-C., & Hommel, B. (2010). Development of attention networks: A cross-sectional study using a life span sample. Developmental Psychology, 46, 337-349.
90. Wechsler, D. (1981). Wechsler Adult Intelligence Scale-R. New York: Psychological Corporation.
91. Yeung, N., & Sanfey, A. G. (2004). Independent coding of reward magnitude and valence in the human brain. Journal of Neuroscience, 24, 6258-6264.