Event-related potential studies of outcome processing and feedback-guided learning

Frontiers in Human Neuroscience

Volumn , Issue OCTOBER 2012, 2012, Pages 1-40

  San Martín, René ^a,b  

^a DUKE UNIVERSITY   (United States)

^b UNIVERSIDAD DIEGO PORTALES   (Chile)

Author keywords

Anterior cingulate cortex; Dopamine; Economics rewards; Feedback related negativity; Locus coeruleus norepinephrine system; P3; Reinforcement learning; Reward system

Indexed keywords

EID: 84868090467     PISSN: 16625161     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnhum.2012.00304     Document Type: Article

References (192)

1. Aarts, E., Roelofs, A., and Van Turennout, M. (2008). Anticipatory activity in anterior cingulate cortex can be independent of conflict and error likelihood. The Journal ofneuroscience: the official journal of the Society for Neuroscience 28, 4671-4678.
2. Adcock, R.A., Thangavel, A., Whitfield-Gabrieli, S., Knutson, B., and Gabrieli, J.D. (2006). Reward-motivated learning: mesolimbic activation precedes memory formation. Neuron 50, 507-517.
3. Akkal, D., Bioulac, B., Audin, J., and Burbaud, P. (2002). Comparison of neuronal activity in the rostral supplementary and cingulate motor areas during a task with cognitive and motor demands. The European journal of neuroscience 15, 887-904.
4. Alexander, W.H., and Brown, J.W. (2011). Medial prefrontal cortex as an action-outcome predictor. Nature neuroscience 14,1338-1344.
5. Alexinsky, T., Aston-Jones, G., Rajkowski, J., and Revay, R.S. (1990). Physiological correlates of adaptive behavior in a visual discrimination task in monkeys. Society for Neuroscience Abstracts 16,164.
6. Amiez, C., Joseph, J.P., and Procyk, E. (2005). Anterior cingulate error-related activity is modulated by predicted reward. The European journal of neuroscience 21, 3447-3452.
7. Aston-Jones, G., Rajkowski, J., and Cohen, J. (1999). Role of locus coeruleus in attention and behavioral flexibility. Biological psychiatry 46,1309-1320.
8. Aston-Jones, G., Rajkowski, J., Kubiak, P., and Alexinsky, T. (1994). Locus coeruleus neurons in monkey are selectively activated by attended cues in a vigilance task. The Journal of neuroscience: the official journal of the Society for Neuroscience 14, 4467-4480.
9. Aston-Jones, G., Segal, M., and Bloom, F.E. (1980). Brain aminergic axons exhibit marked variability in conduction velocity. Brain Res 195, 215-222.
10. Barber, A.D., and Carter, C.S. (2005). Cognitive control involved in overcoming prepotent response tendencies and switching between tasks. Cereb Cortex 15, 899-912.
11. Barto, A.G. (1995). Adaptive critics and the basal ganglia., in Models of information processing in the basal ganglia, eds. J. Houk, J. Davis & D. Beiser. (Cambridge, MA.: MIT Press.), 215-232.
12. Bellebaum, C., and Daum, I. (2008). Learning-related changes in reward expectancy are reflected in the feedback-related negativity. The European journal of neuroscience 27,1823-1835.
13. Bellebaum, C., Polezzi, D., and Daum, I. (2010). It is less than you expected: the feedback-related negativity reflects violations of reward magnitude expectations. Neuropsychologia 48, 3343-3350.
14. Berridge, C.W., and Waterhouse, B.D. (2003). The locus coeruleus-noradrenergic system: modulation of behavioral state and state-dependent cognitive processes. Brain Res Brain Res Rev 42, 33-84.
15. Birbaumer, N., Elbert, T., Canavan, A.G., and Rockstroh, B. (1990). Slow potentials of the cerebral cortex and behavior. Physiol Rev 70,1-41.
16. Botvinick, M.M. (2007). Conflict monitoring and decision making: reconciling two perspectives on anterior cingulate function. Cognitive, affective & behavioral neuroscience 7, 356-366.
17. Botvinick, M.M., Braver, T.S., Barch, D.M., Carter, C.S., and Cohen, J.D. (2001). Conflict monitoring and cognitive control. Psychol Rev 108, 624-652.
18. Botvinick, M.M., Cohen, J.D., and Carter, C.S. (2004). Conflict monitoring and anterior cingulate cortex: an update. Trends in cognitive sciences 8, 539-546.
19. Bouret, S., and Sara, S.J. (2004). Reward expectation, orientation of attention and locus coeruleus-medial frontal cortex interplay during learning. The European journal of neuroscience 20, 791-802.
20. Bouret, S., and Sara, S.J. (2005). Network reset: a simplified overarching theory of locus coeruleus noradrenaline function. Trends in neurosciences 28, 574-582.
21. Breiter, H.C., Aharon, I., Kahneman, D., Dale, A., and Shizgal, P. (2001). Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 30, 619-639.
22. Bush, G., Luu, P., and Posner, M.I. (2000). Cognitive and emotional influences in anterior cingulate cortex. Trends in cognitive sciences 4, 215-222.
23. Bush, G., Vogt, B.A., Holmes, J., Dale, A.M., Greve, D., Jenike, M.A., and Rosen, B.R. (2002). Dorsal anterior cingulate cortex: a role in reward-based decision making. Proceedings of the National Academy of Sciences of the United States of America 99, 523-528.
24. Campanella, S., Delle-Vigne, D., Kornreich, C., and Verbanck, P. (2011). Greater sensitivity of the P300 component to bimodal stimulation in an event-related potentials oddball task. Clinical neurophysiology: official journal of the International Federation of Clinical Neurophysiology.
25. Campbell, K.B., Courchesne, E., Picton, T.W., and Squires, K.C. (1979). Evoked potential correlates of human information processing. Biol Psychol 8, 45-68.
26. Carlson, J.M., Foti, D., Mujica-Parodi, L.R., Harmon-Jones, E., and Hajcak, G. (2011). Ventral striatal and medial prefrontal BOLD activation is correlated with reward-related electrocortical activity: a combined ERP and fMRI study. NeuroImage 57,1608-1616.
27. Carter, C.S., Braver, T.S., Barch, D.M., Botvinick, M.M., Noll, D., and Cohen, J.D. (1998). Anterior cingulate cortex, error detection, and the online monitoring of performance. Science 280, 747-749.
28. Chase, H.W., Swainson, R., Durham, L., Benham, L., and Cools, R. (2011). Feedback-related negativity codes prediction error but not behavioral adjustment during probabilistic reversal learning. Journal of cognitive neuroscience 23, 936-946.
29. Cohen, M.X., Elger, C.E., and Ranganath, C. (2007). Reward expectation modulates feedback-related negativity and EEG spectra. Neuroimage 35, 968-978.
30. Cohen, M.X., and Ranganath, C. (2007). Reinforcement learning signals predict future decisions. The Journal of neuroscience: the official journal of the Society for Neuroscience 27, 371-378.
31. Cohen, M.X., Wilmes, K., and Van De Vijver, I. (2011). Cortical electrophysiological network dynamics of feedback learning. Trends in cognitive sciences.
32. Coricelli, G., Critchley, H.D., Joffily, M., O'doherty, J.P., Sirigu, A., and Dolan, R.J. (2005). Regret and its avoidance: a neuroimaging study of choice behavior. Nature neuroscience 8,1255-1262.
33. Courchesne, E., Hillyard, S.A., and Courchesne, R.Y. (1977). P3 waves to the discrimination of targets in homogeneous and heterogeneous stimulus sequences. Psychophysiology 14, 590-597.
34. Courchesne, E., Hillyard, S.A., and Galambos, R. (1975). Stimulus novelty, task relevance and the visual evoked potential in man. Electroencephalography and clinical neurophysiology 39,131-143.
35. Daw, N.D., Niv, Y., and Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature neuroscience 8,1704-1711.
36. Dayan, P., and Yu, A.J. (2006). Phasic norepinephrine: a neural interrupt signal for unexpected events. Network 17, 335-350.
37. De Martino, B., Kumaran, D., Seymour, B., and Dolan, R.J. (2006). Frames, biases, and rational decision-making in the human brain. Science 313, 684-687.
38. Delgado, M.R., Li, J., Schiller, D., and Phelps, E.A. (2008). The role of the striatum in aversive learning and aversive prediction errors. Philosophical transactions of the Royal Society of London. Series B, Biological sciences 363, 3787-3800.
39. Delgado, M.R., Locke, H.M., Stenger, V.A., and Fiez, J.A. (2003). Dorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations. Cognitive, affective & behavioral neuroscience 3, 27-38.
40. Delgado, M.R., Nystrom, L.E., Fissell, C., Noll, D.C., and Fiez, J.A. (2000). Tracking the hemodynamic responses to reward and punishment in the striatum. Journal of neurophysiology 84, 3072-3077.
41. Desmedt, J.E., Debecker, J., and Manil, J. (1965). [Demonstration of a cerebral electric sign associated with the detection by the subject of a tactile sensorial stimulus. The analysis of cerebral evoked potentials derived from the scalp with the aid of numerical ordinates]. Bull Acad R Med Belg 5, 887-936.
42. Devauges, V., and Sara, S.J. (1990). Activation of the noradrenergic system facilitates an attentional shift in the rat. Behavioural brain research 39,19-28.
43. Donamayor, N., Marco-Pallares, J., Heldmann, M., Schoenfeld, M.A., and Munte, T.F. (2011). Temporal dynamics of reward processing revealed by magnetoencephalography. Hum Brain Mapp 32, 2228-2240.
44. Donchin, E. (1981). Surprise!...Surprise? Psychophysiology 18, 493-513.
45. Donchin, E., and Coles, M.G.H. (1988). Is the P300 component a manifestation of context updating? Behavioral and Brain Sciences 11, 357-374.
46. Duncan-Johnson, C.C., and Donchin, E. (1977). On quantifying surprise: the variation of event-related potentials with subjective probability. Psychophysiology 14, 456-467.
47. Elliott, R., Newman, J.L., Longe, O.A., and Deakin, J.F. (2003). Differential response patterns in the striatum and orbitofrontal cortex to financial reward in humans: a parametric functional magnetic resonance imaging study. The Journal of neuroscience: the official journal of the Society for Neuroscience 23, 303-307.
48. Eppinger, B., Kray, J., Mock, B., and Mecklinger, A. (2008). Better or worse than expected? Aging, learning, and the ERN. Neuropsychologia 46, 521-539.
49. Eppinger, B., Mock, B., and Kray, J. (2009). Developmental differences in learning and error processing: evidence from ERPs. Psychophysiology 46,1043-1053.
50. Everitt, B.J., Hutcheson, D.M., Ersche, K.D., Pelloux, Y., Dalley, J.W., and Robbins, T.W. (2007). The orbital prefrontal cortex and drug addiction in laboratory animals and humans. Annals of the New York Academy of Sciences 1121, 576-597.
51. Falkenstein, M., Hohnsbein, J., Hoormann, J., and Blanke, L. (1991). Effects of crossmodal divided attention on late ERP components. II. Error processing in choice reaction tasks. Electroencephalography and clinical neurophysiology 78, 447-455.
52. Fein, G., and Chang, M. (2008). Smaller feedback ERN amplitudes during the BART are associated with a greater family history density of alcohol problems in treatment-naive alcoholics. Drug and alcohol dependence 92,141-148.
53. Foote, S.L., Bloom, F.E., and Aston-Jones, G. (1983). Nucleus locus ceruleus: new evidence of anatomical and physiological specificity. Physiol Rev 63, 844-914.
54. Foote, S.L., and Morrison, J.H. (1987). Extrathalamic modulation of cortical function. Annual review of neuroscience 10, 67-95.
55. Foti, D., and Hajcak, G. (2009). Depression and reduced sensitivity to non-rewards versus rewards: Evidence from event-related potentials. Biol Psychol 81,1-8.
56. Foti, D., Weinberg, A., Dien, J., and Hajcak, G. (2011). Event-related potential activity in the basal ganglia differentiates rewards from nonrewards: temporospatial principal components analysis and source localization of the feedback negativity. Hum Brain Mapp 32, 2207-2216.
57. Frank, M.J., Woroch, B.S., and Curran, T. (2005). Error-related negativity predicts reinforcement learning and conflict biases. Neuron 47, 495-501.
58. Franken, I.H., Van Den Berg, I., and Van Strien, J.W. (2010). Individual differences in alcohol drinking frequency are associated with electrophysiological responses to unexpected nonrewards. Alcoholism, clinical and experimental research 34, 702-707.
59. Fridberg, D.J., Queller, S., Ahn, W.Y., Kim, W., Bishara, A.J., Busemeyer, J.R., Porrino, L., and Stout, J.C. (2010). Cognitive Mechanisms Underlying Risky Decision-Making in Chronic Cannabis Users. J Math Psychol 54, 28-38.
60. Friedman, D., Cycowicz, Y.M., and Gaeta, H. (2001). The novelty P3: an event-related brain potential (ERP) sign of the brains evaluation of novelty. Neuroscience and biobehavioral reviews 25, 355-373.
61. Gehring, W.J., Goss, B., Coles, M.G.H., Meyer, D.E., and Donchin, E. (1993). A neural system of error detection and compensation. Psychological Science 4, 385-390.
62. Gehring, W.J., and Willoughby, A.R. (2002). The medial frontal cortex and the rapid processing of monetary gains and losses. Science 295, 2279-2282.
63. Gentsch, A., Ullsperger, P., and Ullsperger, M. (2009). Dissociable medial frontal negativities from a common monitoring system for self- and externally caused failure of goal achievement. NeuroImage 47, 2023-2030.
64. Gold, J.M., Waltz, J.A., Prentice, K.J., Morris, S.E., and Heerey, E.A. (2008). Reward processing in schizophrenia: a deficit in the representation of value. Schizophr Bull 34, 835-847.
65. Goudriaan, A.E., Oosterlaan, J., De Beurs, E., and Van Den Brink, W. (2006). Psychophysiological determinants and concomitants of deficient decision making in pathological gamblers. Drug and alcohol dependence 84, 231-239.
66. Goyer, J.P., Woldorff, M.G., and Huettel, S.A. (2008). Rapid electrophysiological brain responses are influenced by both valence and magnitude of monetary rewards. Journal of cognitive neuroscience 20, 2058-2069.
67. Gu, R., Lei, Z., Broster, L., Wu, T., Jiang, Y., and Luo, Y.J. (2011a). Beyond valence and magnitude: a flexible evaluative coding system in the brain. Neuropsychologia 49, 3891-3897.
68. Gu, R., Wu, T., Jiang, Y., and Luo, Y.J. (2011b). Woulda, coulda, shoulda: The evaluation and the impact of the alternative outcome. Psychophysiology.
69. Hajcak, G., Holroyd, C.B., Moser, J.S., and Simons, R.F. (2005). Brain potentials associated with expected and unexpected good and bad outcomes. Psychophysiology 42,161-170.
70. Hajcak, G., Moser, J.S., Holroyd, C.B., and Simons, R.F. (2006). The feedback-related negativity reflects the binary evaluation of good versus bad outcomes. Biol Psychol 71,148-154.
71. Hajcak, G., Moser, J.S., Holroyd, C.B., and Simons, R.F. (2007). It's worse than you thought: the feedback negativity and violations of reward prediction in gambling tasks. Psychophysiology 44, 905-912.
72. Halgren, E., Baudena, P., Clarke, J.M., Heit, G., Marinkovic, K., Devaux, B., Vignal, J.P., and Biraben, A. (1995). Intracerebral potentials to rare target and distractor auditory and visual stimuli. II. Medial, lateral and posterior temporal lobe. Electroencephalography and clinical neurophysiology 94, 229-250.
73. Halgren, E., Squires, N.K., Wilson, C.L., Rohrbaugh, J.W., Babb, T.L., and Crandall, P.H. (1980). Endogenous potentials generated in the human hippocampal formation and amygdala by infrequent events. Science 210, 803-805.
74. Hayden, B.Y., Heilbronner, S.R., Pearson, J.M., and Platt, M.L. (2011). Surprise signals in anterior cingulate cortex: neuronal encoding of unsigned reward prediction errors driving adjustment in behavior. The Journal of neuroscience: the official journal of the Society for Neuroscience 31, 4178-4187.
75. Hebb, D.O. (1949). The organization of behavior. Wiley and Sons.
76. Hewig, J., Trippe, R., Hecht, H., Coles, M.G., Holroyd, C.B., and Miltner, W.H. (2007). Decision-making in Blackjack: an electrophysiological analysis. Cerebral Cortex 17, 865-877.
77. Holroyd, C.B., and Coles, M.G.H. (2002). The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review 109, 679-709.
78. Holroyd, C.B., Krigolson, O.E., Baker, R., Lee, S., and Gibson, J. (2009). When is an error not a prediction error? An electrophysiological investigation. Cognitive, affective & behavioral neuroscience 9, 59-70.
79. Holroyd, C.B., Krigolson, O.E., and Lee, S. (2011). Reward positivity elicited by predictive cues. Neuroreport 22, 249-252.
80. Holroyd, C.B., Larsen, J.T., and Cohen, J.D. (2004a). Context dependence of the event-related brain potential associated with reward and punishment. Psychophysiology 41, 245-253.
81. Holroyd, C.B., Nieuwenhuis, S., Yeung, N., and Cohen, J.D. (2003). Errors in reward prediction are reflected in the event-related brain potential. Neuroreport 14, 2481-2484.
82. Holroyd, C.B., Nieuwenhuis, S., Yeung, N., Nystrom, L., Mars, R.B., Coles, M.G., and Cohen, J.D. (2004b). Dorsal anterior cingulate cortex shows fMRI response to internal and external error signals. Nature neuroscience 7, 497-498.
83. Holroyd, C.B., Pakzad-Vaezi, K.L., and Krigolson, O.E. (2008). The feedback correct-related positivity: sensitivity of the event-related brain potential to unexpected positive feedback. Psychophysiology 45, 688-697.
84. Horst, R.L., Johnson, R., Jr., and Donchin, E. (1980). Event-related brain potentials and subjective probability in a learning task. Memory & cognition 8, 476-488.
85. Huettel, S.A., Stowe, C.J., Gordon, E.M., Warner, B.T., and Platt, M.L. (2006). Neural signatures of economic preferences for risk and ambiguity. Neuron 49, 765-775.
86. Ito, S., Stuphorn, V., Brown, J.W., and Schall, J.D. (2003). Performance monitoring by the anterior cingulate cortex during saccade countermanding. Science 302, 120-122.
87. Joel, D., Niv, Y., and Ruppin, E. (2002). Actor-critic models of the basal ganglia: new anatomical and computational perspectives. Neural networks: the official journal of the International Neural Network Society 15, 535-547.
88. Johnson, R., Jr., and Donchin, E. (1980). P300 and stimulus categorization: Two plus one is not so different from one plus one. Psychophysiology 17,167-178.
89. Johnston, V.S., Miller, D.R., and Burleson, M.H. (1986). Multiple P3s to emotional stimuli and their theoretical significance. Psychophysiology 23, 684-694.
90. Kable, J.W., and Glimcher, P.W. (2007). The neural correlates of subjective value during intertemporal choice. Nature neuroscience 10,1625-1633.
91. Kaga, K., Harrison, J.B., Butcher, L.L., Woolf, N.J., and Buchwald, J.S. (1992). Cat P300 and cholinergic septohippocampal neurons: depth recordings, lesions, and choline acetyltransferase immunohistochemistry. Neurosci Res 13, 53-71.
92. Keil, A., Bradley, M.M., Hauk, O., Rockstroh, B., Elbert, T., and Lang, P.J. (2002). Large-scale neural correlates of affective picture processing. Psychophysiology 39, 641-649.
93. Kennerley, S.W., Walton, M.E., Behrens, T.E., Buckley, M.J., and Rushworth, M.F. (2006). Optimal decision making and the anterior cingulate cortex. Nature neuroscience 9, 940-947.
94. Kerns, J.G., Cohen, J.D., Macdonald, A.W., 3rd, Cho, R.Y., Stenger, V.A., and Carter, C.S. (2004). Anterior cingulate conflict monitoring and adjustments in control. Science 303,1023-1026.
95. Kiehl, K.A., Liddle, P.F., and Hopfinger, J.B. (2000). Error processing and the rostral anterior cingulate: an event-related fMRI study. Psychophysiology 37, 216-223.
96. Kim, H., Shimojo, S., and O'doherty, J.P. (2006). Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol 4, e233.
97. Kiss, I., Dashieff, R.M., and Lordeon, P. (1989). A parieto-occipital generator for P300: evidence from human intracranial recordings. The International journal of neuroscience 49,133-139.
98. Knight, R.T., and Scabini, D. (1998). Anatomic bases of event-related potentials and their relationship to novelty detection in humans. J Clin Neurophysiol 15, 3-13.
99. Knutson, B., Adams, C.M., Fong, G.W., and Hommer, D. (2001). Anticipation of increasing monetary reward selectively recruits nucleus accumbens. The Journal of neuroscience: the official journal of the Society for Neuroscience 21, RC159.
100. Kramer, U.M., Buttner, S., Roth, G., and Munte, T.F. (2008). Trait aggressiveness modulates neurophysiological correlates of laboratory-induced reactive aggression in humans. Journal of cognitive neuroscience 20,1464-1477.
101. Kreussel, L., Hewig, J., Kretschmer, N., Hecht, H., Coles, M.G., and Miltner, W.H. (2012). The influence of the magnitude, probability, and valence of potential wins and losses on the amplitude of the feedback negativity. Psychophysiology 49, 207-219.
102. Kuhnen, C.M., and Knutson, B. (2005). The neural basis of financial risk taking. Neuron 47, 763-770.
103. Levitt, P., Rakic, P., and Goldman-Rakic, P. (1984). Region-specific distribution of catecholamine afferents in primate cerebral cortex: a fluorescence histochemical analysis. J Comp Neurol 227, 23-36.
104. Luck, S. (2005). An Introduction To The Event-Related Potential Technique. MIT Press.
105. Luque, D., Lopez, F.J., Marco-Pallares, J., Camara, E., and Rodriguez-Fornells, A. (2012). Feedback-related Brain Potential Activity Complies with Basic Assumptions of Associative Learning Theory. Journal of cognitive neuroscience.
106. Lutzenberger, W., Elbert, T., and Rockstroh, B. (1987). A brief tutorial on the implications of volume conduction for the interpretation of the EEG. Journal of Psychophysiology 1, 81-89.
107. Luu, P., Tucker, D.M., Derryberry, D., Reed, M., and Poulsen, C. (2003). Electrophysiological responses to errors and feedback in the process of action regulation. Psychological science: a journal of the American Psychological Society/APS 14, 47-53.
108. Marco-Pallares, J., Cucurell, D., Munte, T.F., Strien, N., and Rodriguez-Fornells, A. (2011). On the number of trials needed for a stable feedback-related negativity. Psychophysiology 48, 852-860.
109. Mars, R.B., De Brujin, E.R.A., Hulstijn, W., and Miltner, W.H.R. (2004). What if I told you: "You were wrong"? Brain potentials and behavioral adjustments elicited by feedback in a time-estimation task, in Errors, Conflict, and the Brain. Current Opinions on Performance Monitoring eds. M. Ullsperger & M. Falkenstein. (Leipzig: MPI of Cognitive Neuroscience), 129-134.
110. Matsumoto, M., and Hikosaka, O. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837-841.
111. Mccarthy, G., Wood, C.C., Williamson, P.D., and Spencer, D.D. (1989). Task-dependent field potentials in human hippocampal formation. The Journal of neuroscience: the official journal of the Society for Neuroscience 9, 4253-4268.
112. Mcclure, S.M., Berns, G.S., and Montague, P.R. (2003). Temporal prediction errors in a passive learning task activate human striatum. Neuron 38, 339-346.
113. Metereau, E., and Dreher, J.C. (2012). Cerebral Correlates of Salient Prediction Error for Different Rewards and Punishments. Cereb Cortex.
114. Miltner, W.H., Lemke, U., Weiss, T., Holroyd, C., Scheffers, M.K., and Coles, M.G. (2003). Implementation of error-processing in the human anterior cingulate cortex: a source analysis of the magnetic equivalent of the error-related negativity. Biol Psychol 64,157-166.
115. Miltner, W.H.R., Braun, C.H., and Coles, M.G.H. (1997). Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a "generic" neural system for error detection. Journal of cognitive neuroscience 9.
116. Monchi, O., Petrides, M., Petre, V., Worsley, K., and Dagher, A. (2001). Wisconsin Card Sorting revisited: distinct neural circuits participating in different stages of the task identified by event-related functional magnetic resonance imaging. The Journal of neuroscience: the official journal of the Society for Neuroscience 21,7733-7741.
117. Montague, P.R., Dayan, P., and Sejnowski, T.J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. The Journal of neuroscience: the official journal of the Society for Neuroscience 16, 1936-1947.
118. Morris, S.E., Heerey, E.A., Gold, J.M., and Holroyd, C.B. (2008). Learning-related changes in brain activity following errors and performance feedback in schizophrenia. Schizophrenia research 99, 274-285.
119. Morrison, J.H., and Foote, S.L. (1986). Noradrenergic and serotoninergic innervation of cortical, thalamic, and tectal visual structures in Old and New World monkeys. JComp Neurol 243,117-138.
120. Muller, S.V., Moller, J., Rodriguez-Fornells, A., and Munte, T.F. (2005). Brain potentials related to self-generated and external information used for performance monitoring. Clinical neurophysiology: official journal of the International Federation of Clinical Neurophysiology 116, 63-74.
121. Mullette-Gillman, O.A., Detwiler, J.M., Winecoff, A., Dobbins, I., and Huettel, S.A. (2011). Infrequent, task-irrelevant monetary gains and losses engage dorsolateral and ventrolateral prefrontal cortex. Brain Res 1395, 53-61.
122. Murphy, T.I., and Segalowitz, S.J. (2004). Eliminating the P300 rebound in short oddball paradigms. International journal of psychophysiology: official journal of the International Organization of Psychophysiology 53, 233-238.
123. Nakamura, K., Roesch, M.R., and Olson, C.R. (2005). Neuronal activity in macaque SEF and ACC during performance of tasks involving conflict. Journal of neurophysiology 93, 884-908.
124. Nieuwenhuis, S. (2011). Learning, the P3, and the locus coeruleus-norepinephrine system, in Neural Basis of Motivational and Cognitive Control, eds. R. Mars, J. Sallet, M.F. Rushworth & N. Yeung. (Cambridge: MIT Press), 209-222.
125. Nieuwenhuis, S., Aston-Jones, G., and Cohen, J.D. (2005a). Decision making, the P3, and the locus coeruleus-norepinephrine system. Psychological bulletin 131, 510-532.
126. Nieuwenhuis, S., Holroyd, C.B., Mol, N., and Coles, M.G. (2004a). Reinforcement-related brain potentials from medial frontal cortex: origins and functional significance. Neuroscience and biobehavioral reviews 28, 441-448.
127. Nieuwenhuis, S., Ridderinkhof, K.R., Talsma, D., Coles, M.G., Holroyd, C.B., Kok, A., and Van Der Molen, M.W. (2002). A computational account of altered error processing in older age: dopamine and the error-related negativity. Cognitive, affective & behavioral neuroscience 2,19-36.
128. Nieuwenhuis, S., Slagter, H.A., Von Geusau, N.J., Heslenfeld, D.J., and Holroyd, C.B. (2005b). Knowing good from bad: differential activation of human cortical areas by positive and negative outcomes. The European journal of neuroscience 21, 3161-3168.
129. Nieuwenhuis, S., Yeung, N., Holroyd, C.B., Schurger, A., and Cohen, J.D. (2004b). Sensitivity of electrophysiological activity from medial frontal cortex to utilitarian and performance feedback. Cereb Cortex 14, 741-747.
130. Niki, H., and Watanabe, M. (1979). Prefrontal and cingulate unit activity during timing behavior in the monkey. Brain Res 171, 213-224.
131. O'doherty, J., Critchley, H., Deichmann, R., and Dolan, R.J. (2003a). Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. The Journal of neuroscience: the official journal of the Society for Neuroscience 23, 7931-7939.
132. Odoherty, J.P., Dayan, P., Friston, K., Critchley, H., and Dolan, R.J. (2003b). Temporal difference models and reward-related learning in the human brain. Neuron 38, 329-337.
133. Oliveira, F.T., Mcdonald, J.J., and Goodman, D. (2007). Performance monitoring in the anterior cingulate is not all error related: expectancy deviation and the representation of action-outcome associations. Journal of cognitive neuroscience 19,1994-2004.
134. Onoda, K., Abe, S., and Yamaguchi, S. (2010). Feedback-related negativity is correlated with unplanned impulsivity. Neuroreport 21, 736-739.
135. Paller, K.A., Mccarthy, G., Roessler, E., Allison, T., and Wood, C.C. (1992). Potentials evoked in human and monkey medial temporal lobe during auditory and visual oddball paradigms. Electroencephalography and clinical neurophysiology 84, 269-279.
136. Park, S.Q., Kahnt, T., Beck, A., Cohen, M.X., Dolan, R.J., Wrase, J., and Heinz, A. (2010). Prefrontal cortex fails to learn from reward prediction errors in alcohol dependence. TheJournal of neuroscience: the official journal of the Society for Neuroscience 30, 7749-7753.
137. Paulus, M.P., Feinstein, J.S., Simmons, A., and Stein, M.B. (2004). Anterior cingulated activation in high trait anxious subjects is related to altered error processing during decision making. Biological psychiatry 55,1179-1187.
138. Paus, T. (2001). Primate anterior cingulate cortex: where motor control, drive and cognition interface. Nature reviews. Neuroscience 2, 417-424.
139. Pfabigan, D.M., Alexopoulos, J., Bauer, H., and Sailer, U. (2011). Manipulation of feedback expectancy and valence induces negative and positive reward prediction error signals manifest in event-related brain potentials. Psychophysiology 48, 656-664.
140. Picton, T.W., Hillyard, S.A., and Galambos, R. (1976). Habituation and attention in the auditory system, in Handbook of sensory physiology: Vol. V/3. Auditory system, clinical and special topics., eds. W.D. Keidel & W.D. Neff. (Berlin: Springer-Verlag).
141. Pineda, J.A. (1995). Are neurotransmitter systems of subcortical origin relevant to the electrogenesis of cortical ERPs? Electroencephalography and clinical neurophysiology. Supplement 44,143-150.
142. Polezzi, D., Sartori, G., Rumiati, R., Vidotto, G., and Daum, I. (2010). Brain correlates of risky decision-making. NeuroImage 49,1886-1894.
143. Potts, G.F., Martin, L.E., Burton, P., and Montague, P.R. (2006). When things are better or worse than expected: the medial frontal cortex and the allocation of processing resources. Journal of cognitive neuroscience 18,1112-1119.
144. Pritchard, W.S. (1981). Psychophysiology of P300. Psychological bulletin 89, 506-540.
145. Rasmussen, K., Morilak, D.A., and Jacobs, B.L. (1986). Single unit activity of locus coeruleus neurons in the freely moving cat. I. During naturalistic behaviors and in response to simple and complex stimuli. Brain Res 371, 324-334.
146. Reuter, J., Raedler, T., Rose, M., Hand, I., Glascher, J., and Buchel, C. (2005). Pathological gambling is linked to reduced activation of the mesolimbic reward system. Nature neuroscience 8,147-148.
147. Ribas-Fernandes, J.J., Niv, Y., and Botvinick, M.M. (2011). Neural correlates of Hierarchical Reinforcement Learning, in Neural Basis of Motivational and Cognitive Control, eds. R. Mars, J. Sallet, M.F. Rushworth & N. Yeung. (Cambridge, MA: MIT Press).
148. Ridderinkhof, K.R., Ullsperger, M., Crone, E.A., and Nieuwenhuis, S. (2004). The role of the medial frontal cortex in cognitive control. Science 306, 443-447.
149. Rogers, R.D., Ramnani, N., Mackay, C., Wilson, J.L., Jezzard, P., Carter, C.S., and Smith, S.M. (2004). Distinct portions of anterior cingulate cortex and medial prefrontal cortex are activated by reward processing in separable phases of decision-making cognition. Biological psychiatry 55, 594-602.
150. Ruchsow, M., Grothe, J., Spitzer, M., and Kiefer, M. (2002). Human anterior cingulate cortex is activated by negative feedback: evidence from event-related potentials in a guessing task. Neuroscience letters 325, 203-206.
151. Rushworth, M.F., Walton, M.E., Kennerley, S.W., and Bannerman, D.M. (2004). Action sets and decisions in the medial frontal cortex. Trends in cognitive sciences 8, 410-417.
152. San Martin, R., Manes, F., Hurtado, E., Isla, P., and Ibanez, A. (2010). Size and probability of rewards modulate the feedback error-related negativity associated with wins but not losses in a monetarily rewarded gambling task. NeuroImage 51,1194-1204.
153. Sato, A., Yasuda, A., Ohira, H., Miyawaki, K., Nishikawa, M., Kumano, H., and Kuboki, T. (2005). Effects of value and reward magnitude on feedback negativity and P300. Neuroreport 16, 407-411.
154. Scheffers, M.K., Coles, M.G., Bernstein, P., Gehring, W.J., and Donchin, E. (1996). Event-related brain potentials and error-related processing: an analysis of incorrect responses to go and no-go stimuli. Psychophysiology 33, 42-53.
155. Schultz, W. (2002). Getting formal with dopamine and reward. Neuron 36, 241-263.
156. Schultz, W., Dayan, P., and Montague, L.M. (1997). A Neural Substrate of Prediction and Reward. Science.
157. Schultz, W., and Dickinson, A. (2000). Neuronal coding of prediction errors. Annual review of neuroscience 23, 473-500.
158. Servan-Schreiber, D., Printz, H., and Cohen, J.D. (1990). A network model of catecholamine effects: gain, signal-to-noise ratio, and behavior. Science 249, 892-895.
159. Shima, K., and Tanji, J. (1998). Role for cingulate motor area cells in voluntary movement selection based on reward. Science 282,1335-1338.
160. Shiv, B., Loewenstein, G., and Bechara, A. (2005). The dark side of emotion in decision-making: when individuals with decreased emotional reactions make more advantageous decisions. Brain research. Cognitive brain research 23, 85-92.
161. Smillie, L.D., Cooper, A.J., and Pickering, A.D. (2011). Individual differences in reward-prediction-error: extraversion and feedback-related negativity. Social cognitive and affective neuroscience 6, 646-652.
162. Smith, D.V., Hayden, B.Y., Truong, T.K., Song, A.W., Platt, M.L., and Huettel, S.A. (2010). Distinct value signals in anterior and posterior ventromedial prefrontal cortex. The Journal of neuroscience: the official journal of the Society for Neuroscience 30, 2490-2495.
163. Smith, M.E., Halgren, E., Sokolik, M., Baudena, P., Musolino, A., Liegeois-Chauvel, C., and Chauvel, P. (1990). The intracranial topography of the P3 event-related potential elicited during auditory oddball. Electroencephalography and clinical neurophysiology 76, 235-248.
164. Soltani, M., and Knight, R.T. (2000). Neural origins of the P300. Crit Rev Neurobiol 14, 199-224.
165. Squires, K.C., Hillyard, S.A., and Lindsay, P.H. (1973). Cortical potentials evoked by confirming and disconfirming feedback following an auditory discrimination. Perception & Psychophysics 13, 25-31.
166. Squires, N.K., Squires, K.C., and Hillyard, S.A. (1975). Two varieties of long-latency positive waves evoked by unpredictable auditory stimuli in man. Electroencephalography and clinical neurophysiology 38, 387-401.
167. Sutton, R.S., and Barto, A.G. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
168. Sutton, S., Braren, M., Zubin, J., and John, E.R. (1965). Evoked-potential correlates of stimulus uncertainty. Science 150,1187-1188.
169. Tobler, P.N., Fiorillo, C.D., and Schultz, W. (2005). Adaptive coding of reward value by dopamine neurons. Science 307,1642-1645.
170. Towey, J., Rist, F., Hakerem, G., Ruchkin, D.S., and Sutton, S. (1980). N250 latency and decision time. Bulletin of the Psychonomic Society 15.
171. Toyomaki, A., and Murohashi, H. (2005). The ERPs to feedback indicating monetary loss and gain on the game of modified "rock-paper-scissors". International Congress Series 1278, 381-384.
172. Tsujimoto, T., Shimazu, H., and Isomura, Y. (2006). Direct recording of theta oscillations in primate prefrontal and anterior cingulate cortices. Journal of neurophysiology 95, 2987-3000.
173. Ullsperger, M., and Von Cramon, D.Y. (2003). Error monitoring using external feedback: specific roles of the habenular complex, the reward system, and the cingulate motor area revealed by functional magnetic resonance imaging. The Journal of neuroscience: the official journal of the Society for Neuroscience 23, 4308-4314.
174. Van Schie, H.T., Mars, R.B., Coles, M.G., and Bekkering, H. (2004). Modulation of activity in medial frontal and motor cortices during error observation. Nature neuroscience 7, 549-554.
175. Venkatraman, V., Payne, J.W., Bettman, J.R., Luce, M.F., and Huettel, S.A. (2009). Separate neural mechanisms underlie choices and strategic preferences in risky decision making. Neuron 62, 593-602.
176. Verleger, R., Heide, W., Butt, C., and Kompf, D. (1994). Reduction of P3b in patients with temporo-parietal lesions. Brain research. Cognitive brain research 2, 103-116.
177. Walsh, M.M., and Anderson, J.R. (2011). Modulation of the feedback-related negativity by instruction and experience. Proceedings of the National Academy of Sciences of the United States of America 108,19048-19053.
178. Walton, M.E., Devlin, J.T., and Rushworth, M.F. (2004). Interactions between decision making and performance monitoring within prefrontal cortex. Nature neuroscience 7,1259-1265.
179. Wang, C., Ulbert, I., Schomer, D.L., Marinkovic, K., and Halgren, E. (2005). Responses of human anterior cingulate cortex microdomains to error detection, conflict monitoring, stimulus-response mapping, familiarity, and orienting. The Journal of neuroscience: the official journal of the Society for Neuroscience 25, 604-613.
180. Wessel, J.R., and Ullsperger, M. (2011). Selection of independent components representing event-related brain potentials: a data-driven approach for greater objectivity. NeuroImage 54, 2105-2115.
181. Williams, Z.M., Bush, G., Rauch, S.L., Cosgrove, G.R., and Eskandar, E.N. (2004). Human anterior cingulate neurons and the integration of monetary reward with motor responses. Nature neuroscience 7,1370-1375.
182. Wu, Y., and Zhou, X. (2009). The P300 and reward valence, magnitude, and expectancy in outcome evaluation. Brain Res 1286,114-122.
183. Xu, Q., Shen, Q., Chen, P., Ma, Q., Sun, D., and Pan, Y. (2011). How an uncertain cue modulates subsequent monetary outcome evaluation: An ERP study. Neuroscience letters 505, 200-204.
184. Yamaguchi, S., and Knight, R.T. (1992). Effects of temporal-parietal lesions on the somatosensory P3 to lower limb stimulation. Electroencephalography and clinical neurophysiology 84,139-148.
185. Yeung, N., Botvinick, M.M., and Cohen, J.D. (2004). The Neural Basis of Error Detection: Conflict Monitoring and the Error-Related Negativity. Psychological Review 111, 931-959.
186. Yeung, N., Holroyd, C.B., and Cohen, J.D. (2005). ERP correlates of feedback and reward processing in the presence and absence of response choice. Cerebral Cortex 15, 535-544.
187. Yeung, N., and Sanfey, A.G. (2004). Independent coding of reward magnitude and valence in the human brain. The Journal of neuroscience: the official journal of the Society for Neuroscience 24, 6258-6264.
188. Yingling, C.D., and Hosobuchi, Y. (1984). A subcortical correlate of P300 in man. Electroencephalography and clinical neurophysiology 59, 72-76.
189. Yu, A.J., and Dayan, P. (2005). Uncertainty, neuromodulation, and attention. Neuron 46, 681-692.
190. Yu, R., Zhou, W., and Zhou, X. (2011). Rapid processing of both reward probability and reward uncertainty in the human anterior cingulate cortex. PloS one 6, e29633.
191. Yu, R., and Zhou, X. (2009). To bet or not to bet? The error negativity or error-related negativity associated with risk-taking choices. Journal of cognitive neuroscience 21, 684-696.
192. Zhou, Z., Yu, R., and Zhou, X. (2010). To do or not to do? Action enlarges the FRN and P300 effects in outcome evaluation. Neuropsychologia 48, 3606-3613.