Contrasting reward signals in the orbitofrontal cortex and anterior cingulate cortex

Annals of the New York Academy of Sciences

Volumn 1239, Issue 1, 2011, Pages 33-42

  Wallis, Jonathan D ^a   Kennerley, Steven W ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Anterior cingulate cortex; Decision making; Neurophysiology; Orbitofrontal cortex; Prediction error; Reward

Indexed keywords

ANTERIOR CINGULATE; ARTICLE; BRAIN DAMAGE; BRAIN NERVE CELL; DECISION MAKING; ERROR; EXPECTATION; HUMAN; NONHUMAN; ORBITAL CORTEX; PREDICTION; PREDICTION ERROR; PREFRONTAL CORTEX; REWARD; STIMULUS RESPONSE; TASK PERFORMANCE;

EID: 83155161102     PISSN: 00778923     EISSN: 17496632     Source Type: Book Series    
DOI: 10.1111/j.1749-6632.2011.06277.x     Document Type: Article

References (43)

1. Knutson, B. et al. 2005. Distributed neural representation of expected value. J. Neurosci. 25: 4806-4812.
2. Knutson, B. et al. 2003. A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI. Neuroimage 18: 263-272.
3. Kable, J.W. & P.W. Glimcher. 2007. The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 10: 1625-1633.
4. McClure, S.M. et al. 2004. Separate neural systems value immediate and delayed monetary rewards. Science 306: 503-507.
5. Brown, J.W. & T.S. Braver. 2005. Learned predictions of error likelihood in the anterior cingulate cortex. Science 307: 1118-1121.
6. King-Casas, B. et al. 2005. Getting to know you: reputation and trust in a two-person economic exchange. Science 308: 78-83.
7. Rilling, J. et al. 2002. A neural basis for social cooperation. Neuron 35: 395-405.
8. Padoa-Schioppa, C. & J.A. Assad. 2006. Neurons in the orbitofrontal cortex encode economic value. Nature 441: 223-226.
9. Padoa-Schioppa, C. & J.A. Assad. 2008. The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat. Neurosci. 11: 95-102.
10. Wallis, J.D. & E.K. Miller. 2003. Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. Eur. J. Neurosci. 18: 2069-2081.
11. Tremblay, L. & W. Schultz. 1999. Relative reward preference in primate orbitofrontal cortex. Nature 398: 704-708.
12. Schoenbaum, G., A.A. Chiba & M. Gallagher. 1998. Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat. Neurosci. 1: 155-159.
13. Amiez, C., J.P. Joseph & E. Procyk. 2005. Anterior cingulate error-related activity is modulated by predicted reward. Eur. J. Neurosci. 21: 3447-3452.
14. Sallet, J. et al. 2007. Expectations, gains, and losses in the anterior cingulate cortex. Cogn. Affect Behav. Neurosci. 7: 327-336.
15. Shima, K. & J. Tanji. 1998. Role for cingulate motor area cells in voluntary movement selection based on reward. Science 282: 1335-1338.
16. Williams, Z.M. et al. 2004. Human anterior cingulate neurons and the integration of monetary reward with motor responses. Nat. Neurosci. 7: 1370-1375.
17. Bechara, A. et al. 1994. Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50: 7-15.
18. Fellows, L.K. 2006. Deciding how to decide: ventromedial frontal lobe damage affects information acquisition in multi-attribute decision making. Brain 129: 944-952.
19. Izquierdo, A., R.K. Suda & E.A. Murray. 2004. Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J. Neurosci. 24: 7540-7548.
20. Baxter, M.G. et al. 2000. Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. J. Neurosci. 20: 4311-4319.
21. Burke, K.A. et al. 2008. The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards. Nature 454: 340-344.
22. Kennerley, S.W. et al. 2006. Optimal decision making and the anterior cingulate cortex. Nat. Neurosci. 9: 940-947.
23. Rudebeck, P.H. et al. 2006. A role for the macaque anterior cingulate gyrus in social valuation. Science 313: 1310-1312.
24. Walton, M.E., D.M. Bannerman & M.F. Rushworth. 2002. The role of rat medial frontal cortex in effort-based decision making. J. Neurosci. 22: 10996-11003.
25. Walton, M.E. et al. 2003. Functional specialization within medial frontal cortex of the anterior cingulate for evaluating effort-related decisions. J. Neurosci. 23: 6475-6479.
26. Hadland, K.A. et al. 2003. The anterior cingulate and reward-guided selection of actions. J. Neurophysiol. 89: 1161-1164.
27. Fellows, L.K. & M.J. Farah. 2007. The role of ventromedial prefrontal cortex in decision making: judgment under uncertainty or judgment per se? Cereb. Cortex 17: 2669-2674.
28. Bechara, A. et al. 1998. Dissociation of working memory from decision making within the human prefrontal cortex. J. Neurosci. 18: 428-437.
29. Kennerley, S.W. et al. 2009. Neurons in the frontal lobe encode the value of multiple decision variables. J. Cogn. Neurosci. 21: 1162-1178.
30. Kennerley, S.W., T.E. Behrens & J.D. Wallis. Double dissociation of value computations in orbitofrontal cortex and anterior cingulate cortex. Nat. Neurosci. In press.
31. Wallis, J. D. Cross-species studies of orbitofrontal function. Nat Neurosci. In press.
32. Histed, M.H., A. Pasupathy & E.K. Miller. 2009. Learning substrates in the primate prefrontal cortex and striatum: sustained activity related to successful actions. Neuron 63: 244-253.
33. Padoa-Schioppa, C. 2007. Orbitofrontal cortex and the computation of economic value. Ann. N .Y. Acad. Sci. 1121: 232-253.
34. Padoa-Schioppa, C. 2009. Range-adapting representation of economic value in the orbitofrontal cortex. J. Neurosci. 29: 14004-14014.
35. Schultz, W. 1998. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80: 1-27.
36. Sutton, R.S. & A.G. Barto. 1998. Reinforcement Learning: An Introduction (Adaptive Computation and Machine Learning). MIT Press. Cambridge .
37. Matsumoto, M. & O. Hikosaka. 2007. Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447: 1111-1115.
38. Hayden, B.Y. et al. 2011. Surprise signals in anterior cingulate cortex: neuronal encoding of unsigned reward prediction errors driving adjustment in behavior. J. Neurosci 31: 4178-4187.
39. Hayden, B.Y., J.M. Pearson & M.L. Platt. 2009. Fictive reward signals in the anterior cingulate cortex. Science 324: 948-950.
40. Gehring, W.J. et al. 1993. A neural system for error detection compensation. Psychol. Sci. 4: 385-390.
41. Holroyd, C.B. & M.G. Coles. 2002. The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol. Rev. 109: 679-709.
42. Alexander, W.H. & J.W. Brown. 2011. Medial prefrontal cortex as an action-outcome predictor. Nat. Neurosci. 14: 1338-1344.
43. Montague, P.R. & G.S. Berns. 2002. Neural economics and the biological substrates of valuation. Neuron 36: 265-284.