Valuation and decision-making in frontal cortex: One or many serial or parallel systems?

Current Opinion in Neurobiology

Volumn 22, Issue 6, 2012, Pages 946-955

  Rushworth, Matthew F S ^a,b   Kolling, Nils ^a   Sallet, Jérôme ^a   Mars, Rogier B ^a,b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; APPETITE; DECISION MAKING; FRONTAL LOBE; HUMAN; PHYSIOLOGY; PSYCHOLOGICAL MODEL; REVIEW; REWARD;

ANIMALS; APPETITIVE BEHAVIOR; CHOICE BEHAVIOR; DECISION MAKING; FRONTAL LOBE; HUMANS; MODELS, PSYCHOLOGICAL; REWARD;

EID: 84878178249     PISSN: 09594388     EISSN: 18736882     Source Type: Journal    
DOI: 10.1016/j.conb.2012.04.011     Document Type: Review

References (52)

1. Padoa-Schioppa C. Neurobiology of economic choice: a good-based model. Annu Rev Neurosci 2011, 34:333-359.
2. Walton M.E., Behrens T.E., Buckley M.J., Rudebeck P.H., Rushworth M.F. Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 2010, 65:927-939.
3. Padoa-Schioppa C. Range-adapting representation of economic value in the orbitofrontal cortex. J Neurosci 2009, 29:14004-14014.
4. Kobayashi S., Pinto de Carvalho O., Schultz W. Adaptation of reward sensitivity in orbitofrontal neurons. J Neurosci 2010, 30:534-544.
5. Kennerley S.W., Behrens T.E., Wallis J.D. Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nat Neurosci 2011, 14:1581-1589.
6. Rushworth M.F., Noonan M.P., Boorman E.D., Walton M.E., Behrens T.E. Frontal cortex and reward-guided learning and decision-making. Neuron 2011, 70:1054-1069.
7. Milad M.R., Rauch S.L. Obsessive-compulsive disorder: beyond segregated cortico-striatal pathways. Trends Cogn Sci 2012, 16:43-51.
8. Morrison S.E., Salzman C.D. The convergence of information about rewarding and aversive stimuli in single neurons. J Neurosci 2009, 29:11471-11483.
9. Plassmann H., O'Doherty J.P., Rangel A. Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision making. J Neurosci 2010, 30:10799-10808.
10. Noonan M.P., Walton M.E., Behrens T.E., Sallet J., Buckley M.J., Rushworth M.F. Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc Natl Acad Sci U S A 2010, 107:20547-20552.
11. Noonan M., Kolling N., Walton M., Rushworth M. Re-evaluating the role of orbitofrontal cortex in reward and reinforcement. Eur J Neurosci 2012, 35:997-1010.
12. Noonan M.P., Mars R.B., Rushworth M.F. Distinct roles of three frontal cortical areas in reward-guided behavior. J Neurosci 2011, 31:14399-14412.
13. Rudebeck P.H., Murray E.A. Dissociable effects of subtotal lesions within the macaque orbital prefrontal cortex on reward-guided behavior. J Neurosci 2011, 31:10569-10578.
14. Bouret S., Richmond B.J. Ventromedial and orbital prefrontal neurons differentially encode internally and externally driven motivational values in monkeys. J Neurosci 2010, 30:8591-8601.
15. Lebreton M., Jorge S., Michel V., Thirion B., Pessiglione M. An automatic valuation system in the human brain: evidence from functional neuroimaging. Neuron 2009, 64:431-439.
16. Smith D.V., Hayden B.Y., Truong T.K., Song A.W., Platt M.L., Huettel S.A. Distinct value signals in anterior and posterior ventromedial prefrontal cortex. J Neurosci 2010, 30:2490-2495.
17. Litt A., Plassmann H., Shiv B., Rangel A. Dissociating valuation and saliency signals during decision-making. Cereb Cortex 2011, 21:95-102.
18. Gershman S.J., Pesaran B., Daw N.D. Human reinforcement learning subdivides structured action spaces by learning effector-specific values. J Neurosci 2009, 29:13524-13531.
19. Palminteri S., Boraud T., Lafargue G., Dubois B., Pessiglione M. Brain hemispheres selectively track the expected value of contralateral options. J Neurosci 2009, 29:13465-13472.
20. Basten U., Biele G., Heekeren H.R., Fiebach C.J. How the brain integrates costs and benefits during decision making. Proc Natl Acad Sci U S A 2010, 107:21767-21772.
21. Philiastides M.G., Biele G., Heekeren H.R. A mechanistic account of value computation in the human brain. Proc Natl Acad Sci U S A 2010, 107:9430-9435.
22. Hare T.A., Schultz W., Camerer C.F., O'Doherty J.P., Rangel A. Transformation of stimulus value signals into motor commands during simple choice. Proc Natl Acad Sci U S A 2011, 108:18120-18125.
23. Gold J.I., Shadlen M.N. The neural basis of decision making. Annu Rev Neurosci 2007, 30:535-574.
24. Boorman E.D., Behrens T.E., Woolrich M.W., Rushworth M.F. How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 2009, 62:733-743.
25. Lim S.L., O'Doherty J.P., Rangel A. The decision value computations in the vmPFC and striatum use a relative value code that is guided by visual attention. J Neurosci 2011, 31:13214-13223.
26. Wunderlich K., Rangel A., O'Doherty J. Economic choices can be made using only stimulus values. Proc Natl Acad Sci U S A 2010, 107:15005-15010.
27. Krajbich I., Armel C., Rangel A. Visual fixations and the computation and comparison of value in simple choice. Nat Neurosci 2010, 13:1292-1298.
28. Hunt L.T., Kolling N., Soltani A., Woolrich M.W., Rushworth M.F., Behrens T.E. Mechanisms underlying cortical activity during value-guided choice. Nat Neurosci 2012, 15:470-476.
29. Wang X.J. Probabilistic decision making by slow reverberation in cortical circuits. Neuron 2002, 36:955-968.
30. Kable J.W., Glimcher P.W. The neurobiology of decision: consensus and controversy. Neuron 2009, 63:733-745.
31. Cai X., Padoa-Schioppa C. Neuronal encoding of subjective value in dorsal and ventral anterior cingulate cortex. J Neurosci 2012, 32:3791-3808.
32. Rudebeck P.H., Behrens T.E., Kennerley S.W., Baxter M.G., Buckley M.J., Walton M.E., Rushworth M.F. Frontal cortex subregions play distinct roles in choices between actions and stimuli. J Neurosci 2008, 28:13775-13785.
33. Camille N., Tsuchida A., Fellows L.K. Double dissociation of stimulus-value and action-value learning in humans with orbitofrontal or anterior cingulate cortex damage. J Neurosci 2011, 31:15048-15052.
34. Wunderlich K., Dayan P., Dolan R.J. Mapping value based planning and extensively trained choice in the human brain. Nat Neurosci 2012, 15:786-791.
35. Daw N.D., Gershman S.J., Seymour B., Dayan P., Dolan R.J. Model-based influences on humans' choices and striatal prediction errors. Neuron 2011, 69:1204-1215.
36. Behrens T.E., Hunt L.T., Rushworth M.F. The computation of social behavior. Science 2009, 324:1160-1164.
37. Freidin E., Kacelnik A. Rational choice, context dependence, and the value of information in European Starlings (Sturnus vulgaris). Science 2011, 334:1000-1002.
38. Kolling N., Behrens T.E., Mars R.B., Rushworth M.F. Neural mechanisms of foraging. Science 2012, 336:95-98.
39. Hayden B.Y., Pearson J.M., Platt M.L. Neuronal basis of sequential foraging decisions in a patchy environment. Nat Neurosci 2011, 14:933-939.
40. Hayden B.Y., Heilbronner S.R., Pearson J.M., Platt M.L. Surprise signals in anterior cingulate cortex: neuronal encoding of unsigned reward prediction errors driving adjustment in behavior. J Neurosci 2011, 31:4178-4187.
41. Hayden B.Y., Platt M.L. Neurons in anterior cingulate cortex multiplex information about reward and action. J Neurosci 2010, 30:3339-3346.
42. Rothe M., Quilodran R., Sallet J., Procyk E. Coordination of high gamma activity in anterior cingulate and lateral prefrontal cortical areas during adaptation. J Neurosci 2011, 31:11110-11117.
43. Boorman E.D., Behrens T.E., Rushworth M.F. Counterfactual choice and learning in a neural network centered on human lateral frontopolar cortex. PLoS Biol 2011, 9:e1001093.
44. Hayden B.Y., Pearson J.M., Platt M.L. Fictive reward signals in the anterior cingulate cortex. Science 2009, 324:948-950.
45. Charron S., Koechlin E. Divided representation of concurrent goals in the human frontal lobes. Science 2010, 328:360-363.
46. Mars R.B., Jbabdi S., Sallet J., O'Reilly J.X., Croxson P.L., Olivier E., Noonan M.P., Bergmann C., Mitchell A.S., Baxter M.G., et al. Diffusion-weighted imaging tractography-based parcellation of the human parietal cortex and comparison with human and macaque resting-state functional connectivity. J Neurosci 2011, 31:4087-4100.
47. Abe H., Lee D. Distributed coding of actual and hypothetical outcomes in the orbital and dorsolateral prefrontal cortex. Neuron 2011, 70:731-741.
48. Tsujimoto S., Genovesio A., Wise S.P. Evaluating self-generated decisions in frontal pole cortex of monkeys. Nat Neurosci 2010, 13:120-126.
49. Wise S.P. Forward frontal fields: phylogeny and fundamental function. Trends Neurosci 2008, 31:599-608.
50. Bernacchia A., Seo H., Lee D., Wang X.J. A reservoir of time constants for memory traces in cortical neurons. Nat Neurosci 2011, 14:366-372.
51. Bryden D.W., Johnson E.E., Tobia S.C., Kashtelyan V., Roesch M.R. Attention for learning signals in anterior cingulate cortex. J Neurosci 2011, 31:18266-18274.
52. Alexander W.H., Brown J.W. Medial prefrontal cortex as an action-outcome predictor. Nat Neurosci 2011, 14:1338-1344.