Reward value comparison via mutual inhibition in ventromedial prefrontal cortex

Neuron

Volumn 82, Issue 6, 2014, Pages 1357-1366

  Strait, Caleb E ^a   Blanchard, Tommy C ^a   Hayden, Benjamin Y ^a  

^a UNIVERSITY OF ROCHESTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; DECISION MAKING; EYE TRACKING; MALE; MUTUAL INHIBITION; NERVE CELL INHIBITION; NONHUMAN; PRIORITY JOURNAL; REWARD; RHESUS MONKEY; SIGNAL TRANSDUCTION; TASK PERFORMANCE; VENTROMEDIAL PREFRONTAL CORTEX;

ANIMALS; CHOICE BEHAVIOR; MACACA MULATTA; MALE; NEURAL INHIBITION; PHOTIC STIMULATION; PREFRONTAL CORTEX; RANDOM ALLOCATION; REWARD;

EID: 84902465118     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2014.04.032     Document Type: Article

References (79)

1. Andrews-Hanna J.R., Reidler J.S., Sepulcre J., Poulin R., Buckner R.L. Functional-anatomic fractionation of the brain's default network. Neuron 2010, 65:550-562.
2. Basten U., Biele G., Heekeren H.R., Fiebach C.J. How the brain integrates costs and benefits during decision making. Proc. Natl. Acad. Sci. USA 2010, 107:21767-21772.
3. Blanchard T.C., Hayden B.Y. Neurons in dorsal anterior cingulate cortex signal postdecisional variables in a foraging task. J.Neurosci. 2014, 34:646-655.
4. Boorman E.D., Behrens T.E., Woolrich M.W., Rushworth M.F. How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 2009, 62:733-743.
5. Boorman E.D., Rushworth M.F., Behrens T.E. Ventromedial prefrontal and anterior cingulate cortex adopt choice and default reference frames during sequential multi-alternative choice. J.Neurosci. 2013, 33:2242-2253.
6. Bouret S., Richmond B.J. Ventromedial and orbital prefrontal neurons differentially encode internally and externally driven motivational values in monkeys. J.Neurosci. 2010, 30:8591-8601.
7. Brainard D.H. The Psychophysics Toolbox. Spat. Vis. 1997, 10:433-436.
8. Britten K.H., Newsome W.T., Shadlen M.N., Celebrini S., Movshon J.A. A relationship between behavioral choice and the visual responses of neurons in macaque MT. Vis. Neurosci. 1996, 13:87-100.
9. Cai X., Padoa-Schioppa C. Neuronal encoding of subjective value in dorsal and ventral anterior cingulate cortex. J.Neurosci. 2012, 32:3791-3808.
10. Cai X., Kim S., Lee D. Heterogeneous coding of temporally discounted values in the dorsal and ventral striatum during intertemporal choice. Neuron 2011, 69:170-182.
11. Camille N., Griffiths C.A., Vo K., Fellows L.K., Kable J.W. Ventromedial frontal lobe damage disrupts value maximization in humans. J.Neurosci. 2011, 31:7527-7532.
12. Carmichael S.T., Price J.L. Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J.Comp. Neurol. 1995, 363:615-641.
13. Cisek P. Making decisions through a distributed consensus. Curr. Opin. Neurobiol. 2012, 22:927-936.
14. Cornelissen F.W., Peters E.M., Palmer J. The Eyelink Toolbox: eye tracking with MATLAB and the Psychophysics Toolbox. Behav. Res. Methods Instrum. Comput. 2002, 34:613-617.
15. Feierstein C.E., Quirk M.C., Uchida N., Sosulski D.L., Mainen Z.F. Representation of spatial goals in rat orbitofrontal cortex. Neuron 2006, 51:495-507.
16. Fellows L.K. Deciding how to decide: ventromedial frontal lobe damage affects information acquisition in multi-attribute decision making. Brain. 2006, 129:944-952.
17. FitzGerald T.H., Seymour B., Dolan R.J. The role of human orbitofrontal cortex in value comparison for incommensurable objects. J.Neurosci. 2009, 29:8388-8395.
18. Genovesio A., Tsujimoto S., Navarra G., Falcone R., Wise S.P. Autonomous encoding of irrelevant goals and outcomes by prefrontal cortex neurons. J.Neurosci. 2014, 34:1970-1978.
19. Glimcher P.W. Decisions, Uncertainty, and the Brain: the Science of Neuroeconomics 2003, MIT Press, Cambridge, Mass.
20. Hayden B.Y., Platt M.L. Neurons in anterior cingulate cortex multiplex information about reward and action. J.Neurosci. 2010, 30:3339-3346.
21. Hayden B.Y., Parikh P.C., Deaner R.O., Platt M.L. Economic principles motivating social attention in humans. Proc. Biol. Sci. 2007, 274:1751-1756.
22. Hayden B.Y., Nair A.C., McCoy A.N., Platt M.L. Posterior cingulate cortex mediates outcome-contingent allocation of behavior. Neuron 2008, 60:19-25.
23. Hayden B.Y., Pearson J.M., Platt M.L. Fictive reward signals in the anterior cingulate cortex. Science 2009, 324:948-950.
24. Hayden B.Y., Heilbronner S.R., Platt M.L. Ambiguity aversion in rhesus macaques. Front. Neurosci. 2010, 4:166.
25. Hayden B.Y., Heilbronner S.R., Pearson J.M., Platt M.L. Surprise signals in anterior cingulate cortex: neuronal encoding of unsigned reward prediction errors driving adjustment in behavior. J.Neurosci. 2011, 31:4178-4187.
26. Hayden B.Y., Pearson J.M., Platt M.L. Neuronal basis of sequential foraging decisions in a patchy environment. Nat. Neurosci. 2011, 14:933-939.
27. Heilbronner S.R., Hayden B.Y. Contextual factors explain risk-seeking preferences in rhesus monkeys. Front. Neurosci. 2013, 7:7.
28. Heilbronner S.R., Hayden B.Y., Platt M.L. Decision salience signals in posterior cingulate cortex. Front. Neurosci. 2011, 5:55.
29. Hosokawa T., Kennerley S.W., Sloan J., Wallis J.D. Single-neuron mechanisms underlying cost-benefit analysis in frontal cortex. J.Neurosci. 2013, 33:17385-17397.
30. Hunt L.T., Kolling N., Soltani A., Woolrich M.W., Rushworth M.F., Behrens T.E. Mechanisms underlying cortical activity during value-guided choice. Nature Neurosci. 2012, 15:470-476.
31. Hunt L.T., Woolrich M.W., Rushworth M.F., Behrens T.E. Trial-type dependent frames of reference for value comparison. PLoS Comput. Biol. 2013, 9:e1003225.
32. Hussar C.R., Pasternak T. Memory-guided sensory comparisons in the prefrontal cortex: contribution of putative pyramidal cells and interneurons. J.Neurosci. 2012, 32:2747-2761.
33. Jocham G., Hunt L.T., Near J., Behrens T.E. A mechanism for value-guided choice based on the excitation-inhibition balance in prefrontal cortex. Nat. Neurosci. 2012, 15:960-961.
34. Kacelnik A., Vasconcelos M., Monteiro T., Aw J. Darwin's "tug-of-war" vs. starlings' "horse-racing": how adaptations for sequential encounters drive simultaneous choice. Behav. Ecol. Sociobiol. 2011, 65:547-558.
35. Kahneman D., Tversky A. Choices, Values, and Frames 2000, Cambridge University Press, Cambridge.
36. Kahnt T., Heinzle J., Park S.Q., Haynes J.D. Decoding the formation of reward predictions across learning. J.Neurosci. 2011, 31:14624-14630.
37. Kennerley S.W., Behrens T.E., Wallis J.D. Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nat. Neurosci. 2011, 14:1581-1589.
38. Leathers M.L., Olson C.R. In monkeys making value-based decisions, LIP neurons encode cue salience and not action value. Science 2012, 338:132-135.
39. Levy D.J., Glimcher P.W. The root of all value: a neural common currency for choice. Curr. Opin. Neurobiol. 2012, 22:1027-1038.
40. Lim S.L., O'Doherty J.P., Rangel A. The decision value computations in the vmPFC and striatum use a relative value code that is guided by visual attention. J.Neurosci. 2011, 31:13214-13223.
41. Louie K., Grattan L.E., Glimcher P.W. Reward value-based gain control: divisive normalization in parietal cortex. J.Neurosci. 2011, 31:10627-10639.
42. Luk C.H., Wallis J.D. Dynamic encoding of responses and outcomes by neurons in medial prefrontal cortex. J.Neurosci. 2009, 29:7526-7539.
43. Machens C.K., Romo R., Brody C.D. Flexible control of mutual inhibition: a neural model of two-interval discrimination. Science 2005, 307:1121-1124.
44. McCoy A.N., Platt M.L. Risk-sensitive neurons in macaque posterior cingulate cortex. Nat. Neurosci. 2005, 8:1220-1227.
45. Monosov I.E., Hikosaka O. Regionally distinct processing of rewards and punishments by the primate ventromedial prefrontal cortex. J.Neurosci. 2012, 32:10318-10330.
46. Monosov I.E., Hikosaka O. Selective and graded coding of reward uncertainty by neurons in the primate anterodorsal septal region. Nat. Neurosci. 2013, 16:756-762.
47. Montague P.R., Berns G.S. Neural economics and the biological substrates of valuation. Neuron 2002, 36:265-284.
48. Nienborg H., Cumming B.G. Decision-related activity in sensory neurons reflects more than a neuron's causal effect. Nature 2009, 459:89-92.
49. Noonan M.P., Walton M.E., Behrens T.E., Sallet J., Buckley M.J., Rushworth M.F. Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc. Natl. Acad. Sci. USA 2010, 107:20547-20552.
50. O'Neill M., Schultz W. Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron 2010, 68:789-800.
51. Ogawa M., van der Meer M.A., Esber G.R., Cerri D.H., Stalnaker T.A., Schoenbaum G. Risk-responsive orbitofrontal neurons track acquired salience. Neuron 2013, 77:251-258.
52. Ongür D., Price J.L. The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb. Cortex 2000, 10:206-219.
53. Padoa-Schioppa C. Range-adapting representation of economic value in the orbitofrontal cortex. J.Neurosci. 2009, 29:14004-14014.
54. Padoa-Schioppa C. Neurobiology of economic choice: a good-based model. Annu. Rev. Neurosci. 2011, 34:333-359.
55. Padoa-Schioppa C. Neuronal origins of choice variability in economic decisions. Neuron 2013, 80:1322-1336.
56. Padoa-Schioppa C., Assad J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 2006, 441:223-226.
57. Philiastides M.G., Biele G., Heekeren H.R. A mechanistic account of value computation in the human brain. Proc. Natl. Acad. Sci. USA 2010, 107:9430-9435.
58. Rabin M. Risk aversion and expected-utility theory: A calibration theorem. Econometrica 2000, 68:1281-1292.
59. Raichle M.E., Gusnard D.A. Intrinsic brain activity sets the stage for expression of motivated behavior. J.Comp. Neurol. 2005, 493:167-176.
60. Rangel A., Clithero J.A. Value normalization in decision making: theory and evidence. Curr. Opin. Neurobiol. 2012, 22:970-981.
61. Rangel A., Camerer C., Montague P.R. A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 2008, 9:545-556.
62. Rich E.L., Wallis J.D. Medial-lateral organization of the orbitofrontal cortex. J.Cogn. Neurosci. 2014, 1-16.
63. Roesch M.R., Taylor A.R., Schoenbaum G. Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 2006, 51:509-520.
64. Romo R., Hernández A., Zainos A., Lemus L., Brody C.D. Neuronal correlates of decision-making in secondary somatosensory cortex. Nat. Neurosci. 2002, 5:1217-1225.
65. Rushworth M.F., Noonan M.P., Boorman E.D., Walton M.E., Behrens T.E. Frontal cortex and reward-guided learning and decision-making. Neuron 2011, 70:1054-1069.
66. Schoenbaum G., Roesch M.R., Stalnaker T.A., Takahashi Y.K. A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat. Rev. Neurosci. 2009, 10:885-892.
67. Seo H., Lee D. Behavioral and neural changes after gains and losses of conditioned reinforcers. J.Neurosci 2009, 29:3627-3641.
68. Shenhav A., Botvinick M.M., Cohen J.D. The expected value of control: an integrative theory of anterior cingulate cortex function. Neuron 2013, 79:217-240.
69. Smith D.V., Hayden B.Y., Truong T.K., Song A.W., Platt M.L., Huettel S.A. Distinct value signals in anterior and posterior ventromedial prefrontal cortex. J.Neurosci. 2010, 30:2490-2495.
70. So N., Stuphorn V. Supplementary eye field encodes reward prediction error. J.Neurosci. 2012, 32:2950-2963.
71. Strait C.E., Hayden B.Y. Preference patterns for skewed gambles in rhesus monkeys. Biol. Lett. 2013, 9:20130902.
72. Sugrue L.P., Corrado G.S., Newsome W.T. Choosing the greater of two goods: neural currencies for valuation and decision making. Nat. Rev. Neurosci. 2005, 6:363-375.
73. Vogt B.A. Cingulate neurobiology and disease 2009, Oxford University Press, Oxford, New York.
74. Vogt B.A., Pandya D.N. Cingulate cortex of the rhesus monkey: II. Cortical afferents. J.Comp. Neurol. 1987, 262:271-289.
75. Walton M.E., Behrens T.E., Buckley M.J., Rudebeck P.H., Rushworth M.F. Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 2010, 65:927-939.
76. Wang X.J. Decision making in recurrent neuronal circuits. Neuron 2008, 60:215-234.
77. Watson K.K., Platt M.L. Social signals in primate orbitofrontal cortex. Curr. Biol. 2012, 22:2268-2273.
78. Wilson R.C., Takahashi Y.K., Schoenbaum G., Niv Y. Orbitofrontal cortex as a cognitive map of task space. Neuron 2014, 81:267-279.
79. Yamada, H., Tymula, A., Louie, K., and Glimcher, P.W. (2013). Thirst-dependent risk preferences in monkeys identify a primitive form of wealth. Proceedings of the National Academy of Sciences.