Competition between learned reward and error outcome predictions in anterior cingulate cortex

NeuroImage

Volumn 49, Issue 4, 2010, Pages 3210-3218

  Alexander, William H ^a   Brown, Joshua W ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BRAIN FUNCTION; CINGULATE GYRUS; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; MALE; MATHEMATICAL ANALYSIS; MATHEMATICAL MODEL; MEASUREMENT ERROR; MENTAL FUNCTION; MENTAL TASK; PREDICTION; PRIORITY JOURNAL; REWARD;

ADULT; BRAIN MAPPING; DECISION MAKING; FEMALE; GYRUS CINGULI; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; REINFORCEMENT (PSYCHOLOGY); REWARD; TASK PERFORMANCE AND ANALYSIS; YOUNG ADULT;

EID: 73749085418     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2009.11.065     Document Type: Article

References (47)

1. Aarts E., Roelofs A., et al. Anticipatory activity in anterior cingulate cortex can be independent of conflict and error likelihood. J. Neurosci. 28 18 (2008) 4671-4678
2. Amador N., Schlag-Rey M., et al. Reward-predicting and reward-detecting neuronal activity in the primate supplementary eye field. J. Neurophysiol. 84 4 (2000) 2166-2170
3. Amiez C., Joseph J.P., et al. Anterior cingulate error-related activity is modulated by predicted reward. Eur. J. Neurosci. 21 12 (2005) 3447-3452
4. Amiez C., Joseph J.P., et al. Reward encoding in the monkey anterior cingulate cortex. Cereb. Cortex 16 7 (2006) 1040-1055
5. Beckmann M., Johansen-Berg H., et al. Connectivity-based parcellation of human cingulate cortex and its relation to functional specialization. J. Neurosci. 29 4 (2009) 1175-1190
6. Behrens T.E., Woolrich M.W., et al. Learning the value of information in an uncertain world. Nat. Neurosci. 10 9 (2007) 1214-1221
7. Berns G.S., Capra C.M., et al. Nonlinear neurobiological probability weighting functions for aversive outcomes. NeuroImage 39 4 (2008) 2047-2057
8. Botvinick M.M., Nystrom L., et al. Conflict monitoring versus selection-for-action in anterior cingulate cortex. Nature 402 6758 (1999) 179-181
9. Botvinick M.M., Braver T.S., et al. Conflict monitoring and cognitive control. Psychol. Rev. 108 (2001) 624-652
10. Brett, M., Anton, J.-L., et al., (2002). Region of interest analysis using an SPM toolbox. 8th International Conference on Functional Mapping of the Human Brain, Sendai, Japan.
11. Brown J., and Braver T.S. Risk prediction and aversion by anterior cingulate cortex. Cogn. Affect. Behav. Neurosci. 7 4 (2007) 266-277
12. Brown J.W., and Braver T.S. Learned predictions of error likelihood in the anterior cingulate cortex. Science 307 5712 (2005) 1118-1121
13. Brown J.W., and Braver T.S. A computational model of risk, conflict, and individual difference effects in the anterior cingulate cortex. Brain Res. 1202 (2008) 99-108
14. Burock M.A., Buckner R.L., Woldorff M.G., Rosen B.R., and Dale A.M. Randomized event-related experimental designs allow for extremely rapid presentation rates using functional MRI. NeuroReport 9 (1998) 3735-3739
15. Bush G., Luu P., et al. Cognitive and emotional influences in anterior cingulate cortex. Trends Cogn. Sci. 4 6 (2000) 215-222
16. Carter C.S., Braver T.S., et al. Anterior cingulate cortex, error detection, and the online monitoring of performance. Science 280 (1998) 747-749
17. Croxson P.L., Walton M.E., et al. Effort-based cost-benefit valuation and the human brain. J. Neurosci. 29 14 (2009) 4531-4541
18. Elliott R., Friston K.J., et al. Dissociable neural responses in human reward systems. J. Neurosci. 20 (2000) 6159-6165
19. Fan J., Hof P.R., et al. The functional integration of the anterior cingulate cortex during conflict processing. Cereb. Cortex 18 4 (2008) 796-805
20. Friston K.J., Harrison L., et al. Dynamic causal modelling. NeuroImage 19 4 (2003) 1273-1302
21. Fujiwara J., Tobler P.N., et al. Segregated and integrated coding of reward and punishment in the cingulate cortex. J. Neurophysiol. 101 6 (2009) 3284-3293
22. Gehring W.J., Coles M.G.H., et al. The error-related negativity: an event-related potential accompanying errors. Psychophysiology 27 (1990) S34
23. Gemba H., Sasaki K., et al. Error' potentials in limbic cortex (anterior cingulate area 24) of monkeys during motor learning. Neurosci. Lett. 70 2 (1986) 223-227
24. Hohnsbein J., Falkenstein M., et al. Error processing in visual and auditory choice reaction tasks. J. Psychophysiol. 3 (1989) 32
25. Holroyd C.B., and Coles M.G. The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psych. Rev. 109 4 (2002) 679-709
26. Ito S., Stuphorn V., et al. Performance monitoring by anterior cingulate cortex during saccade countermanding. Science 302 (2003) 120-122
27. Kennerley S.W., Walton M.E., et al. Optimal decision making and the anterior cingulate cortex. Nat. Neurosci. 9 7 (2006) 940-947
28. Kennerley S.W., Dahmubed A.F., et al. Neurons in the frontal lobe encode the value of multiple decision variables. J. Cogn. Neurosci. 21 6 (2009) 1162-1178
29. Knutson B., Taylor J., et al. Distributed neural representation of expected value. J. Neurosci. 25 19 (2005) 4806-4812
30. Kouneiher F., Charron S., et al. Motivation and cognitive control in the human prefrontal cortex. Nat. Neurosci. 12 7 (2009) 939-945
31. MacDonald A.W., Cohen J.D., et al. Dissociating the role of the dorsolateral prefrontal cortex and anterior cingulate cortex in cognitive control. Science 288 (2000) 1835-1838
32. Magno E., Foxe J.J., et al. The anterior cingulate and error avoidance. J. Neurosci. 26 18 (2006) 4769-4773
33. Matsumoto K., Suzuki W., et al. Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science 301 5630 (2003) 229-232
34. Nieuwenhuis S., Schweizer T., et al. Error-likelihood prediction in the medial frontal cortex: A critical evaluation. Cereb. Cortex 17 (2007) 1570-1581
35. Penny W.D., Stephan K.E., et al. Comparing dynamic causal models. NeuroImage 22 3 (2004) 1157-1172
36. Picard N., and Strick P.L. Motor areas of the medial wall: a review of their location and functional activation. Cereb. Cortex 6 3 (1996) 342-353
37. Procyk E., Tanaka Y.L., et al. Anterior ingulate activity during routine and non-routine sequential behaviors in macaques. Nat. Neurosci. 3 5 (2000) 502-508
38. Riba J., Kramer U.M., et al. Dopamine agonist increases risk taking but blunts reward-related brain activity. PLoS ONE 3 6 (2008) e2479
39. Roelofs A., van Turennout M., et al. Anterior cingulate cortex activity can be independent of response conflict in Stroop-like tasks. Proc. Natl. Acad. Sci. U. S. A. 103 37 (2006) 13884-13889
40. Rolls E.T., McCabe C., et al. Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cereb. Cortex 18 3 (2008) 652-663
41. Seymour B., O Doherty J., et al. Temporal difference models describe higher-order learning in humans. Nature 429 (2004) 664-667
42. Shidara M., and Richmond B.J. Anterior cingulate: single neuronal signals related to degree of reward expectancy. Science 296 5573 (2002) 1709-1711
43. Smith A.P., Stephan K.E., et al. Task and content modulate amygdala-hippocampal connectivity in emotional retrieval. Neuron 49 4 (2006) 631-638
44. Sohn M.H., Albert M.V., et al. Anticipation of conflict monitoring in the anterior cingulate cortex and the prefrontal cortex. Proc. Natl. Acad. Sci. U. S. A. 104 25 (2007) 10330-10334
45. Weber E., Blais A., et al. A domain-specific risk-attitude scale: measuring risk perceptions and risk behaviors. J. Behav. Decis. Mak. 15 (2002) 263-290
46. Yechiam E., Busemeyer J.R., et al. Using cognitive models to map relations between neuropsychological disorders and human decision-making deficits. Psychol. Sci. 16 12 (2005) 973-978
47. Yeung N., Cohen J.D., et al. The neural basis of error detection: conflict monitoring and the error-related negativity. Psychol. Rev. 111 4 (2004) 931-959