Error-related negativity predicts reinforcement learning and conflict biases

Neuron

Volumn 47, Issue 4, 2005, Pages 495-501

  Frank, Michael J ^a   Woroch, Brion S ^a   Curran, Tim ^a  

^a UNIVERSITY OF COLORADO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; CONFLICT; DECISION MAKING; ERROR; FEMALE; HUMAN; LEARNING; MALE; NEGATIVE FEEDBACK; NORMAL HUMAN; POSITIVE FEEDBACK; PREDICTION; PRIORITY JOURNAL; REINFORCEMENT;

ADAPTATION, PHYSIOLOGICAL; ADOLESCENT; ADULT; BRAIN MAPPING; CEREBRAL CORTEX; COGNITION; DECISION MAKING; DOPAMINE; EVOKED POTENTIALS; FEMALE; HUMANS; LEARNING; MALE; NEUROPSYCHOLOGICAL TESTS; REACTION TIME; REINFORCEMENT (PSYCHOLOGY);

EID: 23744467723     PISSN: 08966273     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuron.2005.06.020     Document Type: Article

References (47)

1. K.Y. Abrams, S.K. Yune, S.J. Kim, H.J. Jeon, S.J. Han, J. Hwang, Y.H. Sung, K.J. Lee, and I.K. Lyoo Trait and state aspects of harm avoidance and its implication for treatment in major depressive disorder, dysthymic disorder, and depressive personality disorder Psychiatry Clin. Neurosci. 58 2004 240 248
2. A.T. Bates, P.F. Liddle, K.A. Kiehl, and E.T. Ngan State dependent changes in error monitoring in schizophrenia J. Psychiatr. Res. 38 2004 347 356
3. M.M. Botvinick, T.S. Braver, D.M. Barch, C.S. Carter, and J.D. Cohen Conflict monitoring and cognitive control Psychol. Rev. 108 2001 624 652
4. M.M. Botvinick, J.D. Cohen, and C.S. Carter Conflict monitoring and anterior cingulate cortex: an update Trends Cogn. Sci. 8 2004 539 546
5. J.W. Brown, and T.S. Braver Learned predictions of error likelihood in the anterior cingulate cortex Science 307 2005 1118 1121
6. N.D. Daw, S. Kakade, and P. Dayan Opponent interactions between serotonin and dopamine Neural Netw. 15 2002 603 616
7. J. Dien Issues in the application of the average reference: Review, critiques, and recommendations Behav. Res. Methods Instrum. Comput. 30 1998 34 43
8. F. Eblen, and A.M. Graybiel Highly restricted origin of prefrontal cortical inputs to striosomes in the macaque monkey J. Neurosci. 15 1995 5999 6013
9. A.J. Fallgatter, M.J. Herrmann, J. Roemmler, A.C. Ehlis, A. Wagener, A. Heidrich, G. Ortega, Y. Zeng, and K.P. Lesch Allelic variation of serotonin transporter function modulates the brain electrical response for error processing Neuropsychopharmacology 29 2004 1506 1511
10. M. Falkenstein, J. Hohnsbein, J. Hoormann, and L. Blanke Effects of cross-modal divided attention on late ERP components: II. error processing in choice reaction tasks Electroencephalogr. Clin. Neurophysiol. 78 1991 447 455
11. M. Falkenstein, I. Hielscher, P. Dziobek, J. Schwarzenau, and B. Hoormann Action monitoring, error detection, and the basal ganglia: an ERP study Neuroreport 12 2001 157 161
12. M.J. Frank Dynamic dopamine modulation in the basal ganglia: A neurocomputational account of cognitive deficits in medicated and non-medicated Parkinsonism J. Cogn. Neurosci. 17 2005 51 72
13. M.J. Frank, L.C. Seeberger, and R.C. OReilly By carrot or by stick: Cognitive reinforcement learning in Parkinsonism Science 306 2004 1940 1943
14. W.J. Gehring, and D.E. Fencsik Functions of the medial frontal cortex in the processing of conflict and errors J. Neurosci. 21 2001 9430 9437
15. W.J. Gehring, and A.R. Willoughby The medial frontal cortex and the rapid processing of monetary gains and losses Science 295 2002 2279 2281
16. W.J. Gehring, B. Goss, M.G.H. Coles, D.E. Meyer, and E. Donchin A neural system for error detection and compensation Psychol. Sci. 4 1993 385 390
17. G. Hacjak, N. McDonald, and R.F. Simons Error-related psychophysiology and negative affect Brain Cogn. 56 2004 189 197
18. C.B. Holroyd, and M.G.H. Coles The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity Psychol. Rev. 109 2002 679 709
19. C.B. Holroyd, P. Praamstra, E. Plat, and M.G. Coles Spared error-related potentials in mild to moderate Parkinsons disease Neuropsychologia 40 2002 2116 2124
20. C.B. Holroyd, S. Nieuwenhuis, N. Yeung, and J.D. Cohen Errors in reward prediction are reflected in the event-related brain potential Neuroreport 14 2003 2481 2484
21. T. Ito, J.T. Larsen, N.K. Smith, and J.T. Cacioppo Negative information weighs more heavily on the brain: the negativity bias in evaluative categorizations J. Pers. Soc. Psychol. 75 1998 887 900
22. D. Joel, and I. Weiner The connections of the dopaminergic system with the striatum in rats and primates: an analysis with respect to the functional and compartmental organization of the striatum Neuroscience 96 2000 451 474
23. M. Junghofer, T. Elbert, D.M. Tucker, and C. Braun The polar average reference effect: a bias in estimating the head surface integral in EEG recording Clin. Neurophysiol. 110 1999 1149 1155
24. P. Luu, P. Collins, and D.M. Tucker Mood, personality, and self-monitoring negative affect and emotionality in relation to frontal lobe mechanisms of error monitoring J. Exp. Psychol. Gen. 129 2000 43 60
25. P. Luu, D.M. Tucker, D. Derryberry, M. Reed, and C. Poulsen Electrophysiological responses to errors and feedback in the process of action regulation Psychol. Sci. 14 2003 47 53
26. S. McGowan, A.D. Lawrence, T. Sales, D. Quested, and P. Graby Presynaptic dopamine dysfunction in schizophrenia: a positron emission tomographic [18f]fluorodopa study Arch. Gen. Psychiatry 61 2004 134 142
27. W.H. Miltner, C.H. Baum, and M.G. Coles Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a generic neural system for error detection J. Cogn. Neurosci. 9 1997 788 798
28. F.M. Moresco, M. Dieci, A. Vita, C. Messa, C. Gobbo, L. Galli, G. Rizzo, A. Panzacchi, L. De Peri, G. Invernizzi, and F. Fazio In vivo serotonin 5HT(2A) receptor binding and personality traits in healthy subjects: a positron emission tomography study Neuroimage 17 2002 1470 1478
29. S. Nieuwenhuis, C.B. Holroyd, N. Mol, and M.G. Coles Reinforcement- related brain potentials from medial frontal cortex: origins and functional significance Neurosci. Biobehav. Rev. 28 2004 441 448
30. S. Nieuwenhuis, H.A. Slagter, N.J. von Geusau, D.J. Heslenfeld, and C.B. Holroyd Knowing good from bad: Differential activation of human cortical areas by positive and negative outcomes Eur. J. Neurosci. 21 2005 3161 3168
31. C. Nocjar, B.L. Roth, and E.A. Pehek Localization of 5-HT(2A) receptors on dopamine cells in subnuclei of the midbrain A10 cell group Neuroscience 111 2002 163 176
32. O'Reilly, R.C., and Frank, M.J. (2005). Making working memory work: A computational model of learning in the frontal cortex and basal ganglia. Neural Computat., in press.
33. P.E. Pailing, and S.J. Segalowitz The effects of uncertainty in error monitoring on associated ERPs Brain Cogn. 56 2004 215 233
34. T. Paus, L. Koski, Z. Caramanos, and C. Westbury Regional differences in the effects of task difficulty and motor output on blood flow response in the human anterior cingulate cortex: A review of 107 PET activation studies Neuroreport 9 1998 R37 R47
35. T.W. Picton, O.G. Lins, and M. Scherg The recording and analysis of event-related potentials F. Boller J. Grafman Handbook of Neuropsychology, Volume 10 1995 Elsevier Amsterdam 373
36. T. Satoh, S. Nakai, T. Sato, and M. Kimura Correlated coding of motivation and outcome of decision by dopamine neurons J. Neurosci. 23 2003 9913 9923
37. W. Schultz Getting formal with dopamine and reward Neuron 36 2002 241 263
38. R. Srinivasan, P.L. Nunez, D.M. Tucker, R.B. Silberstein, and P.J. Cadusch Spatial sampling and filtering of EEG with spline laplacians to estimate cortical potentials Brain Topogr. 8 1996 355 366
39. D.M. Tucker Spatial sampling of head electrical fields: The geodesic sensor net Electroencephalogr. Clin. Neurophysiol. 87 1993 154 163
40. D.M. Tucker, P. Luu, G. Frishkoff, J. Quiring, and C. Poulsen Frontolimbic response to negative feedback in clinical depression J. Abnorm. Psychol. 112 2003 667 678
41. V. van Veen, C.B. Holroyd, J.D. Cohen, V.A. Stenger, and C.S. Carter Errors without conflict: implications for performance monitoring theories of anterior cingulate cortex Brain Cogn. 56 2004 267 276
42. R. Ventura, A. Alcaro, L. Madolesi, and S. Puglisi-Allegra In vivo evidence that genetic background controls impulse-dependent dopamine release induced by amphetamine in the nucleus accumbens J. Neurochem. 89 2004 494 502
43. Q. Wu, M.E. Reith, Q.D. Walker, C.M. Kuhn, F.I. Caroll, and P.A. Garris Concurrent autoreceptor-mediated control of dopamine release and uptake during neurotransmission: an in vivo voltammetric study J. Neurosci. 22 2002 6272 6281
44. A. Yasuda, A. Sato, K. Miyawaki, H. Kumano, and T. Kuboki Error-related negativity reflects detection of negative reward prediction error Neuroreport 15 2004 2561 2565
45. N. Yeung, and A.G. Sanfey Independent coding of reward magnitude and valence in the human brain J. Neurosci. 24 2004 6258 6282
46. N. Yeung, M.M. Botvinick, and J.D. Cohen The neural basis of error detection: conflict monitoring and the error-related negativity Psychol. Rev. 111 2004 931 959
47. P.J. Zirnheld, C.A. Carroll, P.D. Kieffaber, B.F. Odonnell, A. Shekhar, and W.P. Hetrick Haloperidol impairs learning and error-related negativity in humans J. Cogn. Neurosci. 16 2004 1098 1112