Reinforcement-related brain potentials from medial frontal cortex: Origins and functional significance

Neuroscience and Biobehavioral Reviews

Volumn 28, Issue 4, 2004, Pages 441-448

  Nieuwenhuis, Sander ^a   Holroyd, Clay B ^b   Mol, Nisan ^a   Coles, Michael G H ^c  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

^b PRINCETON UNIVERSITY   (United States)

^c RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

Anterior cingulate cortex; ERP; Error related negativity; Feedback; Prediction error; Reward

Indexed keywords

BASAL GANGLION; BRAIN FUNCTION; CINGULATE GYRUS; DENDRITE; ELECTROPHYSIOLOGY; EVENT RELATED POTENTIAL; FEEDBACK SYSTEM; FRONTAL CORTEX; HUMAN; LEARNING; LOCOMOTION; MESENCEPHALON; MOTONEURON; NUCLEAR MAGNETIC RESONANCE IMAGING; PREDICTION; PRIORITY JOURNAL; PROBABILITY; PUNISHMENT; REVIEW; REWARD; STIMULUS RESPONSE; TASK PERFORMANCE;

EID: 4043101976     PISSN: 01497634     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neubiorev.2004.05.003     Document Type: Article

References (49)

1. Miltner W.H.R., Braun C.H., Coles M.G.H. Event-related brain potentials following incorrect feedback in a time-estimation task: evidence for a generic neural system for error detection. J Cogn Neurosci. 9:1997;788-798
2. Sutton S., Tueting P., Hammer M., Hakerem G. Evoked potentials and feedback. Otto D. Multidisciplinary perspectives in even-related brain potential research. Publication No. EPA-600/9-77-043. 1978;184-188 US Government Printing Office, Washington, DC
3. Campbell K.B., Courchesne E., Picton T.W., Squires K.C. Evoked potential correlates of human information processing. Biol Psychol. 8:1979;45-68
4. Johnston V.S. Stimuli with biological significance. Begleiter H. Evoked brain potentials and behavior. 1979;1-12 Plenum Press, New York
5. Ruchkin D.S., Sutton S., Munson R., Silver K., Macar F. P300 and feedback provided by the absence of the stimulus. Psychophysiology. 18:1981;271-282
6. Takasawa N., Takino R., Yamazaki K. Event-related potentials derived from feedback tones during motor learning. Jpn J Physiol Psychol Psychophysiol. 8:1990;95-101
7. Holroyd C.B., Larsen J.T., Cohen J.D. Context dependence of the event-related brain potential to reward and punishment. Psychophysiology. 41:2004;245-253
8. Holroyd C.B., Nieuwenhuis S., Mars R.B., Coles M.G.H. Anterior cingulate cortex, selection for action, and error processing. Posner M.I. Cognitive neuroscience of attention. 2004;Guilford Press, New York. in press
9. Yeung N., Botvinick M.M., Cohen J.D. The neural basis of error detection: conflict monitoring and the error-related negativity. Psychol Rev. 2004;. in press
10. Dehaene S., Posner M.I., Tucker D.M. Localization of a neural system for error detection and compensation. Psychol Sci. 5:1994;303-305
11. Holroyd C.B., Dien J., Coles M.G.H. Error-related scalp potentials elicited by hand and foot movements: evidence for an output-independent error-processing system in humans. Neurosci Lett. 242:1998;65-68
12. Holroyd C.B., Coles M.G.H. The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol Rev. 109:2002;679-709
13. Schultz W. Getting formal with dopamine and reward. Neuron. 36:2002;241-263
14. Barto A.G. Adaptive critics and the basal ganglia. Houk J., Davis J., Beiser D. Models of information processing in the basal ganglia. 1995;215-232 MIT Press, Cambridge, MA
15. Montague P.R., Dayan P., Sejnowski T.J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci. 16:1996;1936-1947
16. Holroyd C.B. A note on the oddball N200 and the feedback ERN. Ullsperger M., Falkenstein M. Errors, conflicts, and the brain: current opinions on performance monitoring. 2004;211-218 MPI of Cognitive Neuroscience, Leipzig
17. Van Veen V., Carter C.S. The timing of action-monitoring processes in the anterior cingulate cortex. J Cogn Neurosci. 14:2002;593-602
18. Gehring W.J., Willoughby A.R. The medial frontal cortex and the rapid processing of monetary gains and losses. Science. 295:2002;2279-2282
19. Yeung N., Sanfey A. Independent coding of magnitude and valence in the human brain. J Neurosci. 2004;. in press
20. Ruchsow M., Grothe J., Spitzer M., Kiefer M. Human anterior cingulate cortex is activated by negative feedback: evidence from event-related potentials in a guessing task. Neurosci Lett. 325:2002;203-206
21. Gehring W.J., Willoughby A.R. Medial prefrontal cortex and error potentials - reply to Holroyd, Coles, & Nieuwenhuis. Science. 296:2002;1610-1611
22. Holroyd C.B., Coles M.G.H., Nieuwenhuis S. Medial prefrontal cortex and error potentials. Science. 296:2002;1610-1611
23. Nieuwenhuis S., Yeung N., Holroyd C.B., Schurger A., Cohen J.D. Sensitivity of electrophysiological activity from medial frontal cortex to utilitarian and performance feedback. Cereb Cortex. 14:2004;741-747
24. Mars R.B., De Bruijn E.R.A., Hulstijn W., Miltner W.H.R., Coles M.G.H. What if I told you: 'You were wrong'? Brain potentials and behavioral adjustments elicited by performance feedback in a time-estimation task. Ullsperger M., Falkenstein M. Errors, conflicts, and the brain. Current opinions on performance monitoring. 2004;129-134 MPI of Cognitive Neuroscience, Leipzig
25. Nieuwenhuis S., Ridderinkhof K.R., Talsma D., Coles M.G.H., Holroyd C.B., Kok A., Van der Molen M.W. A computational account of altered error processing in older age: dopamine and the error-related negativity. Cogn Affect Behav Neurosci. 2:2002;19-36
26. Butterfield B., Mangels J.A. Neural correlates of error detection and correction in a semantic retrieval task. Brain Res Cogn Brain Res. 17:2003;793-817
27. Holroyd C.B., Nieuwenhuis S., Yeung N., Cohen J.D. Errors in reward prediction are reflected in the event-related brain potential. Neuroreport. 14:2003;2481-2484
28. Falkenstein M., Hoorman J., Christ S., Hohnsbein J. ERP components on reaction errors and their functional significance: a tutorial. Biol Psychol. 51:2000;87-107
29. Picard N., Strick P.L. Motor areas of the medial wall: a review of their location and functional activation. Cereb Cortex. 6:1996;342-353
30. Paus T. Primate anterior cingulate cortex: where motor control, drive, and cognition interface. Nat Rev Neurosci. 2:2001;417-424
31. Luu P., Tucker D.M., Derryberry D., Reed M., Poulsen C. Electrophysiological responses to errors and feedback in the process of action regulation. Psychol Sci. 14:2003;47-53
32. Niki H., Watanabe M. Prefrontal and cingulate unit activity during timing behavior in the monkey. Brain Res. 171:1979;213-224
33. Shima K., Tanji J. Role for cingulate motor area cells in voluntary movement selection based on reward. Science. 282:1998;1335-1338
34. Ito S., Stuphorn V., Brown J.W., Schall J.D. Performance monitoring by the anterior cingulate cortex during saccade countermanding. Science. 302:2003;120-122
35. Elliott R., Newman J.L., Longe O.A., Deakin J.F.W. Differential response patterns in the striatum and orbitofrontal cortex to financial reward in humans: a parametric functional magnetic resonance imaging study. J Neurosci. 23:2003;303-307
36. Knutson B., Westdorp A., Kaiser E., Hommer D. FMRI visualization of brain activity during a monetary incentive delay task. Neuroimage. 12:2000;20-27
37. O'Doherty J., Kringelbach M.L., Rolls E.T., Hornak J., Andrews C. Abstract reward and punishment representations in the human orbitofrontal cortex. Nat Neurosci. 4:2001;95-102
38. Delgado M.R., Locke H.M., Stenger V.A., Fiez J.A. Dorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations. Cogn Affect Behav Neurosci. 3:2003;27-38
39. Bush G., Vogt B.A., Holmes J., Dale A.M., Greve D., Jenike M.A., Rosen B.R. Dorsal anterior cingulate cortex: a role in reward-based decision making. Proc Natl Acad Sci USA. 99:2002;523-528
40. Ullsperger M., von Cramon D.Y. Error monitoring using external feedback: specific roles of the habenular complex, the reward system, and the cingulate motor area revealed by functional magnetic resonance imaging. J Neurosci. 23:2003;4308-4314
41. Monchi O., Petrides M., Petre V., Worsley K., Dagher A. Wisconsin card sorting revisited: distinct neural circuits participating in different stages of the task identified by event-related functional magnetic resonance imaging. J Neurosci. 21:2001;7733-7741
42. Holroyd C.B., Nieuwenhuis S., Yeung N., Nystrom L.E., Mars R.B., Coles M.G.H., Cohen J.D. Dorsal anterior cingulate cortex shows fMRI response to internal and external error signals. Nat Neurosci. 7:2004;497-498
43. Rainville P., Duncan G.H., Price D.D., Carrier B., Bushnell M.C. Pain affect encoded in human anterior cingulate but not somatosensory cortex. Science. 277:1997;968-971
44. De Bruijn E.R.A., Hulstijn W., Verkes R.J., Ruigt G.S.F., Sabbe B.G.C. Drug-induced stimulation and suppression of action monitoring in healthy volunteers. Psychopharmacology. 2004;. in press
45. Holroyd C.B., Yeung N. Alcohol and error processing. Trends Neurosci. 26:2003;402-404
46. Sutton R.S., Barto A.G. Reinforcement learning: an introduction. 1998;MIT Press, Cambridge, MA
47. Pailing P.E., Segalowitz S.J., Dywan J., Davies P.L. Error negativity and response control. Psychophysiology. 39:2002;198-206
48. Yeung N. Relating cognitive and affective theories of the error-related negativity. Ullsperger M., Falkenstein M. Errors, conflicts, and the brain: current opinions on performance monitoring. 2004;63-70 MPI of Cognitive Neuroscience, Leipzig
49. Damasio A.R. The somatic marker hypothesis and the possible functions of the prefrontal cortex. Phil Trans R Soc Lond B Biol Sci. 351:1996;1413-1420