Developmental changes in the reward positivity: An electrophysiological trajectory of reward processing

Developmental Cognitive Neuroscience

Volumn 9, Issue , 2014, Pages 191-199

  Lukie, Carmen N ^a   Montazer Hojat, Somayyeh ^a   Holroyd, Clay B ^a  

^a UNIVERSITY OF VICTORIA   (Canada)

Author keywords

Anterior cingulate cortex; Cognitive control; Development; Dopamine; Reinforcement learning; Reward positivity

Indexed keywords

ADOLESCENT; ADULT; AGE DISTRIBUTION; ANTERIOR CINGULATE; ARTICLE; BRAIN DEPTH STIMULATION; BRAIN DEVELOPMENT; BRAIN FUNCTION; CHILD; COGNITION; CONTROLLED STUDY; DOPAMINERGIC SYSTEM; EVENT RELATED POTENTIAL; FEEDBACK SYSTEM; FEMALE; HUMAN; LATENT PERIOD; MALE; MESENCEPHALON; PRIORITY JOURNAL; REWARD; SCHOOL CHILD; TASK PERFORMANCE; YOUNG ADULT; BRAIN MAPPING; CHILD DEVELOPMENT; CINGULATE GYRUS; ELECTROENCEPHALOGRAPHY; EVOKED RESPONSE; GROWTH, DEVELOPMENT AND AGING; MAZE TEST; METABOLISM; PHYSIOLOGY; REINFORCEMENT;

DOPAMINE;

ADOLESCENT; BRAIN MAPPING; CHILD; CHILD DEVELOPMENT; COGNITION; DOPAMINE; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEEDBACK; FEMALE; GYRUS CINGULI; HUMANS; MALE; MAZE LEARNING; MESENCEPHALON; REINFORCEMENT (PSYCHOLOGY); REWARD; YOUNG ADULT;

EID: 84901664621     PISSN: 18789293     EISSN: 18789307     Source Type: Journal    
DOI: 10.1016/j.dcn.2014.04.003     Document Type: Article

References (63)

1. T.E. Baker, and C.B. Holroyd Which way do I go? Neural activation in response to feedback and spatial processing in a virtual T-maze Cereb. Cortex 19 2009 1708 1722 10.1093/cercor/bhn223
2. T.E. Baker, and C.B. Holroyd Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feedback error-related negativity and N200 Biol. Psychol. 87 2011 25 34 10.1016/j.biopsycho.2011.01.010
3. R.A. Barkley ADHD and the Nature of Self-Control 1997 Guilford Press New York, USA
4. A. Berger, G. Tzur, and M.I. Posner Infant brains detect arithmetic errors Proc. Natl. Acad. Sci. U.S.A. 103 2006 12649 12653 10.1073/pnas. 0605350103 (Pubitemid 44267313)
5. M.M. Botvinick, Y. Niv, and A.C. Barto Hierarchically organized behavior and its neural foundations: a reinforcement learning perspective Cognition 113 2009 262 280 10.1016/j.cognition.2008.08.011
6. B.J. Casey, S. Getz, and A. Galvan The adolescent brain Dev. Rev. 28 2008 62 77 10.1016/j.dr.2007.08.003
7. B.J. Casey, N. Tottenham, C. Liston, and S. Durston Imaging the developing brain: what have we learned about cognitive development? Trends Cogn. Sci. 9 2005 104 110 10.1016/j.tics.2005.01.011 (Pubitemid 40320471)
8. D. Coch, and M.M. Gullick Event-related potentials and development E.S. Kappenman, S.J. Luck, The Oxford Handbook of Event-Related Potential Components 2012 Oxford University Press New York 475 512 10.1093/oxfordhb/9780195374148. 001.0001
9. L. Cragg, A. Fox, K. Nation, C. Reid, and M. Anderson Neural correlates of successful and partial inhibitions in children: an ERP study Dev. Psychobiol. 51 2009 533 543 10.1002/dev.20391
10. E.A. Crone, J. Jennings, and M.W. Van der Molen Developmental change in feedback processing as reflected by phasic heart rate changes Dev. Psychol. 40 2004 1228 1238 10.1037/0012-1649.40.6.1228 (Pubitemid 39454169)
11. E.A. Crone, K. Zanolie, L. Van Leijenhorst, P.M. Westenberg, and S.A.R.B. Rombouts Neural mechanisms supporting flexible performance adjustment during development Cogn. Affect. Behav. Neurosci. 8 2008 165 177 10.3758/CABN.8.2.165
12. E. Donchin, and M.G.H. Coles Is the P300 component a manifestation of context updating? Behav. Brain Sci. 11 1988 357 427 10.1017/S0140525X00058027
13. J.L. Elman, E.A. Bates, M.H. Johnson, and A. Karmiloff-Smith Rethinking innateness: a connectionist perspective on development 1996 MIT Press Cambridge, MA, USA
14. B. Eppinger, B. Mock, and J. Kray Developmental differences in learning and error processing: evidence from ERPs Psychophysiology 46 2009 1043 1053 10.1111/j.1469-8986.2009.00838.x
15. D.R. Euston, A.J. Gruber, and B.L. McNaughton The role of medial prefrontal cortex in memory and decision making Neuron 76 2012 1057 1070
16. A.M. Fjell, K. Walhovd, T.T. Brown, J.M. Kuperman, Y. Chung, and D.J. Hagler et al. Multimodal imaging of the self-regulating developing brain Proc. Natl. Acad. Sci. U.S.A. 109 2012 19620 19625 10.1073/pnas.1208243109
17. S.B. Floresco Prefrontal dopamine and behavioral flexibility: shifting from an "inverted-U" toward a family of functions Front. Neurosci. 71 2013 1 12 10.3389/fnins.2013.00062
18. M.J. Frank, and D. Badre Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: computational analysis Cereb. Cortex 22 2012 509 526 10.1093/cercor/bhr114
19. J.M. Fuster Frontal lobe and cognitive development J. Neurocytol. 31 2002 373 385 (Pubitemid 36877383)
20. C.F. Geier Adolescent cognitive control and reward processing: implications for risk taking and substance use Horm. Behav. 64 2013 333 342 http://dx.doi.org/10.1016.j.yhbeh.2013.02.008
21. G. Gratton, M.G.H. Coles, and E. Donchin A new method for off-line removal of ocular artifact Electroencephalogr. Clin. Neurophysiol. 55 1983 468 484 10.1016/0013-4694(83)90135-9 (Pubitemid 13112654)
22. A. Hajihosseini, and C.B. Holroyd Frontal midline theta and N200 amplitude reflect complementary information about expectancy and outcome evaluation Psychophysiology 50 2013 550 562 10.1111/psyp.12040
23. D. Hämmerer, S. Li, V. Müller, and U. Lindenberger Life span differences in electrophysiological correlates of monitoring gains and losses during probabilistic reinforcement learning J. Cogn. Neurosci. 23 2011 579 592 10.1162/jocn.2010.21475
24. D. Hämmerer, and B. Eppinger Dopaminergic and prefrontal contributions to reward-based learning and outcome monitoring during child development and aging Dev. Psychol. 48 2012 862 874 10.1037/a0027342
25. J.W. Haycock, L. Becker, L. Ang, Y. Furukawa, O. Hornykiewicz, and S.J. Kish Marked disparity between age-related changes in dopamine and other presynaptic dopaminergic markers in human striatum J. Neurochem. 873 2003 574 585 10.1046/j.1471-4159.2003.02017.x (Pubitemid 37310624)
26. W. Hofmann, M. Friese, and F. Strack Impulse and self-control from a dual-systems perspective Perspect. Psychol. Sci. 4 2009 162 176 10.1111/j.1745-6924.2009.01116.x
27. C.B. Holroyd Theories of anterior cingulate cortex function: opportunity cost Behav. Brain Sci. 36 2013 693 694 10.1017/S0140525X13001052
28. C.B. Holroyd, T.E. Baker, K.A. Kerns, and U. Müller Electrophysiological evidence of atypical motivation and reward processing in children with attention-deficit hyperactivity disorder Neuropsychologia 46 2008 2234 2242 10.1016/j.neuropsychologia.2008.02.011
29. C.B. Holroyd, and M.H. Coles The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity Psychol. Rev. 109 2002 679 709 10.1037/0033-295X.109.4.679
30. C.B. Holroyd, and S.M. McClure Hierarchical control over effortful behavior by anterior cingulate cortex 2014 (submitted for publication)
31. C.B. Holroyd, K.L. Pakzad-Vaezi, and O.E. Krigolson The feedback correct-related positivity: sensitivity of the event-related brain potential to unexpected positive feedback Psychophysiology 45 2008 688 697 10.1111/j.1469-8986.2008.00668.x
32. C.B. Holroyd, and N. Yeung Motivation of extended behaviors by anterior cingulate cortex Trends Cogn. Sci. 16 2012 122 128 10.1016/j.tics.2011.12.008
33. M. Huizinga, C.V. Dolan, and M.W. van der Molen Age-related change in executive function: developmental trends and a latent variable analysis Neuropsychologia 44 2006 2017 2036 10.1016/j.neuropsychologia.2006.01.010 (Pubitemid 43993995)
34. H.H. Jasper The ten twenty electrode system of the international federation Electroencephalogr. Clin. Neurophysiol. 10 1958 371 375
35. S.J. Johnstone, C.B. Pleffer, R.J. Barry, A.R. Clarke, and J.L. Smith Development of inhibitory processing during the go/nogo task: a behavioral and event-related potential study of children and adults J. Psychophysiol. 19 2005 11 23 10.1027/0269-8803.19.1.11 (Pubitemid 40392691)
36. A.M.C. Kelly, A. Di Martino, L.Q. Uddin, Z. Shehzad, D.G. Gee, P.T. Reiss, and M.P. Milham et al. Development of anterior cingulate functional connectivity from late childhood to early adulthood Cereb. Cortex 19 2009 640 657 10.1093/cercor/bhn117
37. C. Kuhn, M. Johnson, A. Thomae, B. Luo, S.A. Simon, G. Zhou, and Q.D. Walker The emergence of gonadal hormone influences on dopaminergic function during puberty Horm. Behav. 58 2010 122 137 10.1016/j.yhbeh.2009.10.015
38. C. Lamm, P.D. Zelazo, and M.D. Lewis Neural correlates of cognitive control in childhood and adolescence: disentangling the contributions of age and executive function Neuropsychologia 44 2006 2139 2148 (Pubitemid 43993989)
39. M. Luciana, D. Wahlstrom, J.N. Porter, and P.F. Collins Dopaminergic modulation of incentive motivation in adolescence: age-related changes in signaling, individual differences, and implications for the development of self-regulation Dev. Psychol. 48 2012 844 861 10.1037/a0027432
40. S.J. Luck An Introduction to the Event-Related Potential Technique 2005 MIT Press Cambridge, MA
41. R.B. Mars, J. Sallet, M.F.S. Rushworth, and N. Yeung Neural Basis of Motivational and Cognitive Control 2011 MIT Press Cambridge, MA
42. X. Mai, T. Tardif, S. Doan, C. Liu, W. Gehring, and Y. Luo Brain activity elicited by positive and negative feedback in preschool-aged children PLoS ONE 6 2011 e18774 10.1371/journal.pone.0018774
43. E.K. Miller, and J.D. Cohen An integrative theory of prefrontal cortex function Annu. Rev. Neurosci. 24 2001 167 202 10.1146/annurev.neuro.24.1.167 (Pubitemid 32695227)
44. W.R. Miltner, C.H. Braun, and M.G.H. Coles Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a 'generic' neural system for error detection J. Cogn. Neurosci. 9 1997 788 798 10.1162/jocn.1997.9.6.788 (Pubitemid 28025194)
45. S. Nieuwenhuis, C.B. Holroyd, N. Mol, and M.G.H. Coles Reinforcement-related brain potentials from medial frontal cortex: origins and functional significance Neurosci. Biobehav. Rev. 28 2004 441 448 10.1016/j.neubiorev.2004.05.003 (Pubitemid 39077932)
46. Y. Niv Cost, benefit, tonic, phasic: what do response rates tell us about dopamine and motivation? Ann. N.Y. Acad. Sci. 1104 2007 357 376 10.1196/annals.1390.018 (Pubitemid 47092744)
47. S.J. Ordaz, W. Foran, K. Velanova, and B. Luna Longitudinal growth curves of brain function underlying inhibitory control through adolescence J. Neurosci. 33 2013 18109 18124 10.1523/JNeurosci.1741-13.2013
48. S.R. Quartz Learning and brain development: a neural constructivist perspective P.T. Quinlan, Connectionist Models of Development 2003 Psychology Press New York 279 310
49. K. Rubia Functional brain imaging across development Eur. Child Adolesc. Psychiatry 24 2012 2012 10.1007/s00787-012-0291-8
50. R. San Martin Event related potential studies of outcome processing and feedback-guided learning Front. Hum. Neurosci. 6 2012 304 321 10.3389/fnhum.2012.00304
51. D.L. Santesso, A. Dzyundzyak, and S.J. Segalowitz Age, sex and individual differences in punishment sensitivity: factors influencing the feedback-related negativity Psychophysiology 48 2011 1481 1489 10.1111/j.1469-8986.2011.01229.x
52. W. Schultz, P. Dayan, and P.R. Montague A neural substrate of prediction and reward Science 275 1997 1593 1599 (Pubitemid 27120526)
53. W. Schultz Updating dopamine reward signals Curr. Opin. Neurobiol. 23 2013 229 238 10.1016/j.conb.2012.11.012
54. S. Singh, A.G. Barto, and N. Chentanez Intrinsically motivated reinforcement learning Adv. Neural Inf. Process. Syst. 17 2005 1281 1288
55. L.P. Spear Adolescent neurodevelopment J. Adolesc. Health 52 2013 S7 S13
56. R.S. Sutton, and A.G. Barto Reinforcement Learning: An Introduction 1998 MIT Press Cambridge, MA
57. A. Umemoto, and C.B. Holroyd Task-specific effects of reward on task switching 2014 (submitted for publication)
58. W. van den Bos, M.X. Cohen, T. Kahnt, and E.A. Crone Striatum-medial prefrontal cortex connectivity predicts developmental changes in reinforcement learning Cereb. Cortex 22 2012 1247 1255 10.1093/cercor/bhr198
59. K. Velanova, M.E. Wheeler, and B. Luna Maturational changes in anterior cingulate and frontoparietal recruitment support the development of error processing and inhibitory control Cereb. Cortex 18 2008 2505 2522 10.1093/cercor/bhn012
60. D. Wahlstrom, P. Collins, T. White, and M. Luciana Developmental changes in dopamine neurotransmission in adolescence: behavioral implications and issues in assessment Brain. Cogn. 72 2010 146 159 10.1016/j.bandc.2009.10.013
61. M.M. Walsh, and J.R. Anderson Learning from experience: event-related potential correlates of reward processing, neural adaptation, and behavioral choice Neurosci. Biobehav. Rev. 36 2012 1870 1884 10.1016/j.neubiorev.2012.05. 008
62. F. Yi, H. Chen, X. Wang, H. Shi, J. Yi, X. Zhu, and S. Yao Amplitude and latency of feedback-related negativity: aging and sex differences Ageing 23 2012 963 969 10.1097/WNR.0b013e328359d1c4
63. T.M. Zottoli, and J. Grose-Fifer The feedback-related negativity (FRN) in adolescents Psychophysiology 49 2012 413 420 10.1111/j.1469-8986.2011.01312.x