Orbitofrontal cortex uses distinct codes for different choice attributes in decisions motivated by curiosity

Neuron

Volumn 85, Issue 3, 2015, Pages 602-614

  Blanchard, Tommy C ^a   Hayden, Benjamin Y ^a   Bromberg Martin, Ethan S ^b  

^a UNIVERSITY OF ROCHESTER   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION; ATTENTION; BRAIN NERVE CELL; CONTROLLED STUDY; CURIOSITY; DECISION MAKING; GAMBLING; HAPLORHINI; INFORMATION SEEKING; MOTIVATION; NEUROTRANSMISSION; NONHUMAN; ORBITAL CORTEX; REWARD; TASK PERFORMANCE; THINKING; VISUAL STIMULATION; ANIMAL; BRAIN MAPPING; EXPLORATORY BEHAVIOR; FRONTAL LOBE; PHYSIOLOGY; PROCEDURES; RANDOMIZATION;

ANIMALS; BRAIN MAPPING; CHOICE BEHAVIOR; DECISION MAKING; EXPLORATORY BEHAVIOR; FRONTAL LOBE; HAPLORHINI; MOTIVATION; RANDOM ALLOCATION; REWARD;

EID: 84922147919     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2014.12.050     Document Type: Article

References (43)

1. Blanchard T.C., Hayden B.Y. Neurons in dorsal anterior cingulate cortex signal postdecisional variables in a foraging task. J.Neurosci. 2014, 34:646-655.
2. Bouret S., Richmond B.J. Ventromedial and orbital prefrontal neurons differentially encode internally and externally driven motivational values in monkeys. J.Neurosci. 2010, 30:8591-8601.
3. Bromberg-Martin E.S., Hikosaka O. Midbrain dopamine neurons signal preference for advance information about upcoming rewards. Neuron 2009, 63:119-126.
4. Bromberg-Martin E.S., Hikosaka O. Lateral habenula neurons signal errors in the prediction of reward information. Nat. Neurosci. 2011, 14:1209-1216.
5. Cai X., Padoa-Schioppa C. Neuronal encoding of subjective value in dorsal and ventral anterior cingulate cortex. J.Neurosci. 2012, 32:3791-3808.
6. Critchley H.D., Rolls E.T. Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. J.Neurophysiol. 1996, 75:1673-1686.
7. Deaner R.O., Khera A.V., Platt M.L. Monkeys pay per view: adaptive valuation of social images by rhesus macaques. Curr. Biol. 2005, 15:543-548.
8. Esber G.R., Haselgrove M. Reconciling the influence of predictiveness and uncertainty on stimulus salience: a model of attention in associative learning. Proc. Biol. Sci. 2011, 278:2553-2561.
9. Gottlieb J., Oudeyer P.-Y., Lopes M., Baranes A. Information-seeking, curiosity, and attention: computational and neural mechanisms. Trends Cogn. Sci. 2013, 17:585-593.
10. Gruber M.J., Gelman B.D., Ranganath C. States of curiosity modulate hippocampus-dependent learning via the dopaminergic circuit. Neuron 2014, 84:486-496.
11. Kang M.J., Hsu M., Krajbich I.M., Loewenstein G., McClure S.M., Wang J.T., Camerer C.F. The wick in the candle of learning: epistemic curiosity activates reward circuitry and enhances memory. Psychol. Sci. 2009, 20:963-973.
12. Kennerley S.W., Dahmubed A.F., Lara A.H., Wallis J.D. Neurons in the frontal lobe encode the value of multiple decision variables. J.Cogn. Neurosci. 2009, 21:1162-1178.
13. Kepecs A., Uchida N., Zariwala H.A., Mainen Z.F. Neural correlates, computation and behavioural impact of decision confidence. Nature 2008, 455:227-231.
14. Lak A., Stauffer W.R., Schultz W. Dopamine prediction error responses integrate subjective value from different reward dimensions. Proc. Natl. Acad. Sci. USA 2014, 111:2343-2348.
15. Levy D.J., Glimcher P.W. The root of all value: a neural common currency for choice. Curr. Opin. Neurobiol. 2012, 22:1027-1038.
16. Loewenstein G. The psychology of curiosity: a review and reinterpretation. Psychol. Bull. 1994, 116:75-98.
17. McDannald M.A., Takahashi Y.K., Lopatina N., Pietras B.W., Jones J.L., Schoenbaum G. Model-based learning and the contribution of the orbitofrontal cortex to the model-free world. Eur. J. Neurosci. 2012, 35:991-996.
18. Montague P.R., Berns G.S. Neural economics and the biological substrates of valuation. Neuron 2002, 36:265-284.
19. Morrison S.E., Salzman C.D. The convergence of information about rewarding and aversive stimuli in single neurons. J.Neurosci. 2009, 29:11471-11483.
20. Noonan M.P., Walton M.E., Behrens T.E.J., Sallet J., Buckley M.J., Rushworth M.F.S. Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc. Natl. Acad. Sci. USA 2010, 107:20547-20552.
21. O'Neill M., Schultz W. Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron 2010, 68:789-800.
22. Ogawa M., van der Meer M.A.A., Esber G.R., Cerri D.H., Stalnaker T.A., Schoenbaum G. Risk-responsive orbitofrontal neurons track acquired salience. Neuron 2013, 77:251-258.
23. Padoa-Schioppa C. Neurobiology of economic choice: a good-based model. Annu. Rev. Neurosci. 2011, 34:333-359.
24. Padoa-Schioppa C., Assad J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 2006, 441:223-226.
25. Perkins C.C. The stimulus conditions which follow learned responses. Psychol. Rev. 1955, 62:341-348.
26. Phillips K.A., Subiaul F., Sherwood C.C. Curious monkeys have increased gray matter density in the precuneus. Neurosci. Lett. 2012, 518:172-175.
27. Pritchard T.C., Schwartz G.J., Scott T.R. Taste in the medial orbitofrontal cortex of the macaque. Ann. N Y Acad. Sci. 2007, 1121:121-135.
28. Raghuraman A.P., Padoa-Schioppa C. Integration of multiple determinants in the neuronal computation of economic values. J.Neurosci. 2014, 34:11583-11603.
29. Roesch M.R., Olson C.R. Neuronal activity in primate orbitofrontal cortex reflects the value of time. J.Neurophysiol. 2005, 94:2457-2471.
30. Roesch M.R., Taylor A.R., Schoenbaum G. Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 2006, 51:509-520.
31. Rudebeck P.H., Murray E.A. Dissociable effects of subtotal lesions within the macaque orbital prefrontal cortex on reward-guided behavior. J.Neurosci. 2011, 31:10569-10578.
32. Rudebeck P.H., Mitz A.R., Chacko R.V., Murray E.A. Effects of amygdala lesions on reward-value coding in orbital and medial prefrontal cortex. Neuron 2013, 80:1519-1531.
33. Rushworth M.F.S., Noonan M.P., Boorman E.D., Walton M.E., Behrens T.E. Frontal cortex and reward-guided learning and decision-making. Neuron 2011, 70:1054-1069.
34. Schoenbaum G., Roesch M.R., Stalnaker T.A., Takahashi Y.K. A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat. Rev. Neurosci. 2009, 10:885-892.
35. Schoenbaum G., Takahashi Y., Liu T.-L., McDannald M.A. Does the orbitofrontal cortex signal value?. Ann. N Y Acad. Sci. 2011, 1239:87-99.
36. Strait C.E., Blanchard T.C., Hayden B.Y. Reward value comparison via mutual inhibition in ventromedial prefrontal cortex. Neuron 2014, 82:1357-1366.
37. Takahashi Y.K., Roesch M.R., Wilson R.C., Toreson K., O'Donnell P., Niv Y., Schoenbaum G. Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex. Nat. Neurosci. 2011, 14:1590-1597.
38. Tremblay L., Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature 1999, 398:704-708.
39. Tsujimoto S., Genovesio A., Wise S.P. Monkey orbitofrontal cortex encodes response choices near feedback time. J.Neurosci. 2009, 29:2569-2574.
40. Wallis J.D. Orbitofrontal cortex and its contribution to decision-making. Annu. Rev. Neurosci. 2007, 30:31-56.
41. Watson K.K., Platt M.L. Social signals in primate orbitofrontal cortex. Curr. Biol. 2012, 22:2268-2273.
42. West E.A., DesJardin J.T., Gale K., Malkova L. Transient inactivation of orbitofrontal cortex blocks reinforcer devaluation in macaques. J.Neurosci. 2011, 31:15128-15135.
43. Wilson R.C., Takahashi Y.K., Schoenbaum G., Niv Y. Orbitofrontal cortex as a cognitive map of task space. Neuron 2014, 81:267-279.