Rapid processing of both reward probability and reward uncertainty in the human anterior cingulate cortex

PLoS ONE

Volumn 6, Issue 12, 2011, Pages

  Yu, Rongjun ^a,b   Zhou, Wu ^c   Zhou, Xiaolin ^b,d  

^a SOUTH CHINA NORMAL UNIVERSITY   (China)

^b PEKING UNIVERSITY   (China)

^c UNIVERSITY OF MISSISSIPPI MEDICAL CENTER   (United States)

^d Peking University   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ANTERIOR CINGULATE; ARTICLE; ASSOCIATION; BRAIN FUNCTION; DECISION MAKING; ELECTROENCEPHALOGRAPHY; EVENT RELATED POTENTIAL; FEEDBACK SYSTEM; FEMALE; HUMAN; HUMAN EXPERIMENT; INFORMATION PROCESSING; MALE; NORMAL HUMAN; PREDICTION; PROBABILITY; QUANTITATIVE ANALYSIS; RESPONSE TIME; REWARD; TASK PERFORMANCE; UNCERTAINTY; VOLUNTEER; CINGULATE GYRUS; PHYSIOLOGY;

ADULT; FEMALE; GYRUS CINGULI; HUMANS; MALE; PROBABILITY; REWARD; UNCERTAINTY;

EID: 84455192489     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0029633     Document Type: Article

References (49)

1. Levy H, Markowitz HM, (1979) Approximating expected utility by a function of mean and variance. American Economic Review 69: 308-317.
2. Real LA, (1991) Animal choice behavior and the evolution of cognitive architecture. Science 253: 980-986.
3. Schultz W, Dayan P, Montague PR, (1997) A neural substrate of prediction and reward. Science 275: 1593-1599.
4. Fiorillo CD, Tobler PN, Schultz W, (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299: 1898-1902.
5. Tobler PN, O'Doherty JP, Dolan RJ, Schultz W, (2007) Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J Neurophysiol 97: 1621-1632.
6. Aron AR, Shohamy D, Clark J, Myers C, Gluck MA, et al. (2004) Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. J Neurophysiol 92: 1144-1152.
7. Dreher JC, Kohn P, Berman KF, (2006) Neural coding of distinct statistical properties of reward information in humans. Cereb Cortex 16: 561-573.
8. Gehring WJ, Willoughby AR, (2002) The medial frontal cortex and the rapid processing of monetary gains and losses. Science 295: 2279-2282.
9. van Veen V, Holroyd CB, Cohen JD, Stenger VA, Carter CS, (2004) Errors without conflict: implications for performance monitoring theories of anterior cingulate cortex. Brain Cogn 56: 267-276.
10. Miltner WHR, Braun CH, Coles MGH, (1997) Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a "generic" neural system for error detection. J Cogn Neurosci pp. 788-798.
11. Rolls ET, McCabe C, Redoute J, (2008) Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cerebral Cortex 18: 652-663.
12. Jessup RK, Busemeyer JR, Brown JW, (2010) Error effects in anterior cingulate cortex reverse when error likelihood is high. J Neurosci 30: 3467-3472.
13. Behrens TE, Woolrich MW, Walton ME, Rushworth MF, (2007) Learning the value of information in an uncertain world. Nat Neurosci 10: 1214-1221.
14. Preuschoff K, Bossaerts P, Quartz SR, (2006) Neural differentiation of expected reward and risk in human subcortical structures. Neuron 51: 381-390.
15. Critchley HD, Mathias CJ, Dolan RJ, (2001) Neural activity in the human brain relating to uncertainty and arousal during anticipation. Neuron 29: 537-545.
16. Preuschoff K, Quartz SR, Bossaerts P, (2008) Human insula activation reflects risk prediction errors as well as risk. J Neurosci 28: 2745-2752.
17. Donkers FC, Nieuwenhuis S, van Boxtel GJ, (2005) Mediofrontal negativities in the absence of responding. Brain Res Cogn Brain Res 25: 777-787.
18. Luu P, Tucker DM, Derryberry D, Reed M, Poulsen C, (2003) Electrophysiological responses to errors and feedback in the process of action regulation. Psychol Sci 14: 47-53.
19. Zhou Z, Yu R, Zhou X, (2010) To do or not to do? Action enlarges the FRN and P300 effects in outcome evaluation. Neuropsychologia 48: 3606-3613.
20. Yu RJ, Zhou XL, (2009) To Bet or Not to Bet? The Error Negativity or Error-related Negativity Associated with Risk-taking Choices. Journal of Cognitive Neuroscience 21: 684-696.
21. Hajcak G, Moser JS, Holroyd CB, Simons RF, (2006) The feedback-related negativity reflects the binary evaluation of good versus bad outcomes. Biological Psychology 71: 148-154.
22. Holroyd CB, Nieuwenhuis S, Yeung N, Cohen JD, (2003) Errors in reward prediction are reflected in the event-related brain potential. Neuroreport 14: 2481-2484.
23. Scherg M, Berg P, (1990) BESA-Brain electric source analysis handbook. Munich Max-Planck Institue for Psychiatry.
24. Yasuda A, Sato A, Miyawaki K, Kumano H, Kuboki T, (2004) Error-related negativity reflects detection of negative reward prediction error. Neuroreport 15: 2561-2565.
25. Cohen MX, Elger CE, Ranganath C, (2007) Reward expectation modulates feedback-related negativity and EEG spectra. Neuroimage 35: 968-978.
26. Hajcak G, Holroyd CB, Moser JS, Simons RF, (2005) Brain potentials associated with expected and unexpected good and bad outcomes. Psychophysiology 42: 161-170.
27. Frank MJ, Seeberger LC, O'Reilly R C, (2004) By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306: 1940-1943.
28. Frank MJ, Woroch BS, Curran T, (2005) Error-related negativity predicts reinforcement learning and conflict biases. Neuron 47: 495-501.
29. Holroyd CB, Coles MGH, (2002) The neutral basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review 109: 679-709.
30. Nieuwenhuis S, Holroyd CB, Mol N, Coles MG, (2004) Reinforcement-related brain potentials from medial frontal cortex: origins and functional significance. Neurosci Biobehav Rev 28: 441-448.
31. Bellebaum C, Polezzi D, Daum I, (2010) It is less than you expected: the feedback-related negativity reflects violations of reward magnitude expectations. Neuropsychologia 48: 3343-3350.
32. Bellebaum C, Daum I, (2008) Learning-related changes in reward expectancy are reflected in the feedback-related negativity. Eur J Neurosci 27: 1823-1835.
33. Holroyd CB, Hajcak G, Larsen JT, (2006) The good, the bad and the neutral: electrophysiological responses to feedback stimuli. Brain Res 1105: 93-101.
34. Oliveira FT, McDonald JJ, Goodman D, (2007) Performance monitoring in the anterior cingulate is not all error related: expectancy deviation and the representation of action-outcome associations. J Cogn Neurosci 19: 1994-2004.
35. Wu Y, Zhou X, (2009) The P300 and reward valence, magnitude, and expectancy in outcome evaluation. Brain Res 1286: 114-122.
36. Matsumoto M, Matsumoto K, Abe H, Tanaka K, (2007) Medial prefrontal cell activity signaling prediction errors of action values. Nat Neurosci 10: 647-656.
37. Williams ZM, Bush G, Rauch SL, Cosgrove GR, Eskandar EN, (2004) Human anterior cingulate neurons and the integration of monetary reward with motor responses. Nat Neurosci 7: 1370-1375.
38. Sallet J, Quilodran R, Rothe M, Vezoli J, Joseph JP, et al. (2007) Expectations, gains, and losses in the anterior cingulate cortex. Cogn Affect Behav Neurosci 7: 327-336.
39. Marco-Pallares J, Cucurell D, Munte TF, Strien N, Rodriguez-Fornells A, (2010) On the number of trials needed for a stable feedback-related negativity. Psychophysiology.
40. Moser JS, Simons RF, (2009) The neural consequences of flip-flopping: the feedback-related negativity and salience of reward prediction. Psychophysiology 46: 313-320.
41. Yeung N, Holroyd CB, Cohen JD, (2005) ERP correlates of feedback and reward processing in the presence and absence of response choice. Cereb Cortex 15: 535-544.
42. Miltner WHR, Braun CH, Coles MGH, (1997) Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a "generic" neural system for error detection. Journal of Cognitive Neuroscience 9: 788-798.
43. Potts GF, Martin LE, Burton P, Montague PR, (2006) When things are better or worse than expected: the medial frontal cortex and the allocation of processing resources. J Cogn Neurosci 18: 1112-1119.
44. Martin LE, Potts GF, Burton PC, Montague PR, (2009) Electrophysiological and hemodynamic responses to reward prediction violation. Neuroreport 20: 1140-1143.
45. Carlson JM, Foti D, Mujica-Parodi LR, Harmon-Jones E, Hajcak G, (2011) Ventral striatal and medial prefrontal BOLD activation is correlated with reward-related electrocortical activity: a combined ERP and fMRI study. Neuroimage 57: 1608-1616.
46. Han MH, Cao JL, Covington HE, Friedman AK, Wilkinson MB, et al. (2010) Mesolimbic Dopamine Neurons in the Brain Reward Circuit Mediate Susceptibility to Social Defeat and Antidepressant Action. Journal of Neuroscience 30: 16453-16458.
47. Holroyd CB, Pakzad-Vaezi KL, Krigolson OE, (2008) The feedback correct-related positivity: Sensitivity of the event-related brain potential to unexpected positive feedback. Psychophysiology 45: 688-697.
48. Donkers FCL, van Boxtel GJM, Nieuwenhuis S, (2005) Mediofrontal negativities in the absence of responding. Cognitive Brain Research 25: 777-787.
49. Holroyd CB, Krigolson OE, Seung L, (2011) Reward positivity elicited by predictive cues. Neuroreport 22: 249-252.