Value and prediction error estimation account for volatility effects in ACC: A model-based fMRI study

Cortex

Volumn 49, Issue 6, 2013, Pages 1627-1635

  Silvetti, Massimo ^a,b   Seurinck, Ruth ^a,b   Verguts, Tom ^a,b  

^a GHENT UNIVERSITY   (Belgium)

^b GHENT UNIVERSITY HOSPITAL   (Belgium)

Author keywords

ACC; Prediction error; Reinforcement learning; Reward; Volatility

Indexed keywords

ANTERIOR CINGULATE; ARTICLE; COMPUTER SIMULATION; CONTROLLED STUDY; FUNCTIONAL MAGNETIC RESONANCE IMAGING; PREDICTION; PREDICTION ERROR; REWARD;

ADULT; ALGORITHMS; BRAIN MAPPING; COMPUTER SIMULATION; CUES; ENVIRONMENT; FEMALE; GYRUS CINGULI; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; MODELS, NEUROLOGICAL; NOREPINEPHRINE; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REACTION TIME; REWARD; YOUNG ADULT;

EID: 84878910819     PISSN: 00109452     EISSN: 19738102     Source Type: Journal    
DOI: 10.1016/j.cortex.2012.05.008     Document Type: Article

References (34)

1. Alexander W.H., Brown J.W. Medial prefrontal cortex as an action-outcome predictor. Nature Neuroscience 2011, 14(10):1338-1344.
2. Amiez C., Joseph J.P., Procyk E. Reward encoding in the monkey anterior cingulate cortex. Cerebral Cortex 2006, 16(7):1040-1055.
3. Aston-Jones G., Cohen J.D. An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance. Annual Review of Neuroscience 2005, 28:403-450.
4. Behrens T.E., Woolrich M.W., Walton M.E., Rushworth M.F. Learning the value of information in an uncertain world. Nature Neuroscience 2007, 10(9):1214-1221.
5. Berridge C.W., Waterhouse B.D. The locus coeruleus-noradrenergic system: Modulation of behavioral state and state-dependent cognitive processes. Brain Research. Brain Research Reviews 2003, 42(1):33-84.
6. Botvinick M., Braver T.S., Barch D.M., Carter C.S., Cohen J.D. Conflict monitoring and cognitive control. Psychological Review 2001, 108(3):624-652.
7. Brett M., Anton J., Valabregue R., Poline J. Region of interest analysis using an SPM toolbox. NeuroImage; Presented at the 8th International Conference on Functional Mapping of the Human Brain; 2002 2002, [abstract].
8. Brown J.W., Braver T.S. Learned predictions of error likelihood in the anterior cingulate cortex. Science 2005, 307(5712):1118-1121.
9. Critchley H.D., Tang J., Glaser D., Butterworth B., Dolan R.J. Anterior cingulate activity during error and autonomic response. NeuroImage 2005, 27(4):885-895.
10. D'Ardenne K., McClure S.M., Nystrom L.E., Cohen J.D. BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 2008, 319(5867):1264-1267.
11. Devinsky O., Morrell M.J., Vogt B.A. Contributions of anterior cingulate cortex to behaviour. Brain 1995, 118(Pt 1):279-306.
12. Dolan R.J. Emotion, cognition, and behavior. Science 2002, 298(5596):1191-1194.
13. Doricchi F., Macci E., Silvetti M., Macaluso E. Neural correlates of the spatial and expectancy components of endogenous and stimulus-driven orienting of attention in the Posner task. Cerebral Cortex 2010, 20(7):1574-1585.
14. Jepma M., Nieuwenhuis S. Pupil diameter predicts changes in the exploration-exploitation tradeoff: Evidence for the adaptive gain theory. Journal of Cognitive Neuroscience 2011, 23(7):1587-1596.
15. Jessup R.K., Busemeyer J.R., Brown J.W. Error effects in anterior cingulate cortex reverse when error likelihood is high. Journal of Neuroscience 2010, 30(9):3467-3472.
16. Kennerley S.W., Behrens T.E., Wallis J.D. Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nature Neuroscience 2011, 14(12):1581-1589.
17. Knutson B., Westdorp A., Kaiser E., Hommer D. FMRI visualization of brain activity during a monetary incentive delay task. NeuroImage 2000, 12(1):20-27.
18. Matsumoto K., Suzuki W., Tanaka K. Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science 2003, 301(5630):229-232.
19. Matsumoto M., Matsumoto K., Abe H., Tanaka K. Medial prefrontal cell activity signaling prediction errors of action values. Nature Neuroscience 2007, 10(5):647-656.
20. Nichols T., Brett M., Andersson J., Wager T., Poline J.B. Valid conjunction inference with the minimum statistic. NeuroImage 2005, 25(3):653-660.
21. Nunez Castellar E., Kuhn S., Fias W., Notebaert W. Outcome expectancy and not accuracy determines posterror slowing: ERP support. Cognitive, Affective & Behavioral Neuroscience 2010, 10(2):270-278.
22. Oliveira F.T., McDonald J.J., Goodman D. Performance monitoring in the anterior cingulate is not all error related: Expectancy deviation and the representation of action-outcome associations. Journal of Cognitive Neuroscience 2007, 19(12):1994-2004.
23. Preuschoff K., Quartz S.R., Bossaerts P. Human insula activation reflects risk prediction errors as well as risk. Journal of Neuroscience 2008, 28(11):2745-2752.
24. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: Variation in the effectiveness of reinforcement and nonreinforcement. Classical Conditioning II: Current Research and Theory 1972, 64-99. Appleton-Century-Crofts, New York. A.H. Black, W.F. Prokasy (Eds.).
25. Ridderinkhof K.R., Ullsperger M., Crone E.A., Nieuwenhuis S. The role of the medial frontal cortex in cognitive control. Science 2004, 306(5695):443-447.
26. Rushworth M.F., Behrens T.E. Choice, uncertainty and value in prefrontal and cingulate cortex. Nature Neuroscience 2008, 11(4):389-397.
27. Schoenbaum G., Roesch M.R., Stalnaker T.A., Takahashi Y.K. A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nature Reviews Neuroscience 2009, 10(12):885-892.
28. Silvetti M., Seurinck R., Verguts T. Value and prediction error in the medial frontal cortex: Integrating the single-unit and systems levels of analysis. Frontiers in Human Neuroscience 2011, 5(75).
29. Singer T., Critchley H.D., Preuschoff K. A common role of insula in feelings, empathy and uncertainty. Trends in Cognitive Sciences 2009, 13(8):334-340.
30. Summerfield C., Koechlin E. A neural representation of prior information during perceptual inference. Neuron 2008, 59(2):336-347.
31. Sutton R.S., Barto A.G. Reinforcement Learning: An Introduction 1998, MIT Press, Cambridge (MA).
32. Verguts T., Notebaert W. Adaptation by binding: A learning account of cognitive control. Trends in Cognitive Sciences 2009, 13(6):252-257.
33. Williams S.M., Goldman-Rakic P.S. Widespread origin of the primate mesofrontal dopamine system. Cerebral Cortex 1998, 8(4):321-345.
34. Yu A.J., Dayan P. Uncertainty, neuromodulation, and attention. Neuron 2005, 46(4):681-692.