Single-neuron mechanisms underlying cost-benefit analysis in frontal cortex

Journal of Neuroscience

Volumn 33, Issue 44, 2013, Pages 17385-17397

  Hosokawa, Takayuki ^a   Kennerley, Steven W ^b   Sloan, Jennifer ^a   Wallis, Jonathan D ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ANTERIOR CINGULATE; ARTICLE; CINGULATE GYRUS; COST BENEFIT ANALYSIS; DECISION MAKING; FRONTAL CORTEX; HISTOGRAM; MALE; MENTAL TASK; NERVE CELL; NERVE CELL NETWORK; NEUROPHYSIOLOGY; NONHUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; ORBITAL CORTEX; PHOTOGRAPHY; PREFRONTAL CORTEX; PRIORITY JOURNAL; REWARD; RHESUS MONKEY; SENSORY STIMULATION; TASK PERFORMANCE;

ANIMALS; BRAIN MAPPING; CHOICE BEHAVIOR; COST-BENEFIT ANALYSIS; FRONTAL LOBE; MACACA MULATTA; MALE; NEURONS; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE;

EID: 84886664615     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2221-13.2013     Document Type: Article

References (68)

1. Akkal D, Bioulac B, Audin J, Burbaud P (2002) Comparison of neuronal activity in the rostral supplementary and cingulate motor areas during a task with cognitive and motor demands. Eur J Neurosci 15:887-904. CrossRef Medline
2. Amemori K, Graybiel AM (2012) Localized microstimulation of primate pregenual cingulate cortex induces negative decision-making. Nat Neu-rosci 15:776-785. CrossRef Medline
3. Amiez C, Joseph JP, Procyk E (2006) Reward encoding in the monkey anterior cingulate cortex. Cereb Cortex 16:1040-1055. CrossRef Medline
4. Asaad WF, Eskandar EN (2008) A flexible software tool for temporally-precise behavioral control in Matlab. J Neurosci Methods 174:245-258. CrossRef Medline
5. Balleine BW, O'Doherty JP (2010) Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35:48-69. CrossRef Medline
6. Burke KA, Franz TM, Miller DN, Schoenbaum G (2008) The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards. Nature 454:340-344. CrossRef Medline
7. Cai X, Padoa-Schioppa C (2012) Neuronal encoding of subjective value in dorsal and ventral anterior cingulate cortex. J Neurosci 32:3791-3808. CrossRef Medline
8. Camille N, Tsuchida A, Fellows LK (2011) Double dissociation of stimulus-value and action-value learning in humans with orbitofrontal or anterior cingulate cortex damage. J Neurosci 31:15048-15052. CrossRef Medline
9. Carmichael ST, Price JL (1995) Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys. J Comp Neurol 363:642-664. CrossRef Medline
10. Cisek P (2012) Making decisions through a distributed consensus. Curr Opin Neurobiol 22:927-936. CrossRef Medline
11. Clithero JA, Rangel A (2013) Informatic parcellation of the network involved in the computation of subjective value. Social Cogn Affect Neuro-sci, in press. CrossRef Medline
12. Croxson PL, Walton ME, O'Reilly JX, Behrens TE, Rushworth MF (2009) Effort-based cost-benefit valuation and the human brain. J Neurosci 29: 4531-4541. CrossRef Medline
13. Gan JO, Walton ME, Phillips PE (2010) Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat Neurosci 13:25-27. CrossRef Medline
14. Glimcher PW, Dorris MC, Bayer HM (2005) Physiological utility theory and the neuroeconomics of choice. Games Econ Behav 52:213-256. CrossRef Medline
15. Grabenhorst F, Rolls ET, Bilderbeck A (2008) How cognition modulates affective responses to taste and flavor: top-down influences on the orbito-frontal and pregenual cingulate cortices. Cereb Cortex 18:1549-1559. CrossRef Medline
16. Hayden BY, Pearson JM, Platt ML (2009) Fictive reward signals in the anterior cingulate cortex. Science 324:948-950. CrossRef Medline
17. Hayden BY, Pearson JM, Platt ML (2011) Neuronal basis of sequential for-aging decisions in a patchy environment. Nat Neurosci 14:933-939. CrossRef Medline
18. Hillman KL, Bilkey DK (2010) Neurons in the rat anterior cingulate cortex dynamically encode cost-benefit in a spatial decision-making task. J Neu-rosci 30:7705-7713. CrossRef Medline
19. Hwang J, Kim S, Lee D (2009) Temporal discounting and inter-temporal choice in rhesus monkeys. Front Behav Neurosci 3:9. CrossRef Medline
20. Kable JW, Glimcher PW (2007) The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10:1625-1633. CrossRef Medline
21. Kennerley SW (2012) Is the reward really worth it? Nat Neurosci 15:647-649. CrossRef Medline
22. Kennerley SW, Walton ME, Behrens TE, Buckley MJ, Rushworth MF (2006) Optimal decision making and the anterior cingulate cortex. Nat Neurosci 9:940-947. CrossRef Medline
23. Kennerley SW, Dahmubed AF, Lara AH, Wallis JD (2009) Neurons in the frontal lobe encode the value of multiple decision variables. J Cogn Neu-rosci 21:1162-1178. CrossRef Medline
24. Kennerley SW, Behrens TE, Wallis JD (2011) Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nat Neu-rosci 14:1581-1589. CrossRef Medline
25. Kim HF, Hikosaka O (2013) Distinct basal ganglia circuits controlling behaviors guided by flexible and stable values. Neuron 79:1001-1010. CrossRef Medline
26. Kim S, Hwang J, Lee D (2008) Prefrontal coding of temporally discounted values during intertemporal choice. Neuron 59:161-172. CrossRef Medline
27. Kurniawan IT, Guitart-Masip M, Dayan P, Dolan RJ (2013) Effort and valuation in the brain: the effects of anticipation and execution. J Neurosci 33:6160-6169. CrossRef Medline
28. Lara AH, Kennerley SW, Wallis JD (2009) Encoding of gustatory working memory by orbitofrontal neurons. J Neurosci 29:765-774. CrossRef Medline
29. Levy DJ, Glimcher PW (2012) The root of all value: a neural common currency for choice. Curr Opin Neurobiol 22:1027-1038. CrossRef Medline
30. Luk CH, Wallis JD (2013) Choice coding in frontal cortex during stimulus-guided or action-guided decision-making. J Neurosci 33:1864-1871. CrossRef Medline
31. Mainen ZF, Kepecs A (2009) Neural representation of behavioral outcomes in the orbitofrontal cortex. Curr Opin Neurobiol 19:84-91. CrossRef Medline
32. McClure SM, Laibson DI, Loewenstein G, Cohen JD (2004) Separate neural systems value immediate and delayed monetary rewards. Science 306: 503-507. CrossRef Medline
33. McClure SM, Ericson KM, Laibson DI, Loewenstein G, Cohen JD (2007) Time discounting for primary rewards. J Neurosci 27:5796-5804. CrossRef Medline
34. McDannald MA, Lucantonio F, Burke KA, Niv Y, Schoenbaum G (2011) Ventral striatum and orbitofrontal cortex are both required for model-based, but not model-free, reinforcement learning. J Neurosci 31:2700-2705. CrossRef Medline
35. Miller EK, Nieder A, Freedman DJ, Wallis JD (2003) Neural correlates of categories and concepts. Curr Opin Neurobiol 13:198-203. CrossRef Medline
36. Noonan MP, Walton ME, Behrens TE, Sallet J, Buckley MJ, Rushworth MF (2010) Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc Natl Acad Sci U S A 107: 20547-20552. CrossRef Medline
37. Ohyama K, Sugase-Miyamoto Y, Matsumoto N, Shidara M, Sato C (2012) Stimulus-related activity during conditional associations in monkey perirhinal cortex neurons depends on upcoming reward outcome. J Neu-rosci 32:17407-17419. CrossRef Medline
38. O'Neill M, Schultz W (2010) Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron 68:789-800. CrossRef Medline
39. Ostlund SB, Balleine BW (2007) Orbitofrontal cortex mediates outcome encoding in Pavlovian but not instrumental conditioning. J Neurosci 27:4819-4825. CrossRef Medline
40. Padoa-Schioppa C (2009) Range-adapting representation of economic value in the orbitofrontal cortex. J Neurosci 29:14004-14014. CrossRef Medline
41. Padoa-Schioppa C (2011) Neurobiology of economic choice: a good-based model. Annu Rev Neurosci 34:333-359. CrossRef Medline
42. Padoa-Schioppa C, Assad JA (2006) Neurons in the orbitofrontal cortex encode economic value. Nature 441:223-226. CrossRef Medline
43. Padoa-Schioppa C, Assad JA (2008) The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat Neurosci 11:95-102. CrossRef Medline
44. Prévost C, Pessiglione M, Météreau E, Cléry-Melin ML, Dreher JC (2010) Separate valuation subsystems for delay and effort decision costs. J Neu-rosci 30:14080-14090. CrossRef Medline
45. Rangel A, Hare T (2010) Neural computations associated with goal-directed choice. Curr Opin Neurobiol 20:262-270. CrossRef Medline
46. Rigotti M, Barak O, Warden MR, Wang XJ, Daw ND, Miller EK, Fusi S (2013) The importance of mixed selectivity in complex cognitive tasks. Nature 497:585-590. CrossRef Medline
47. Roesch MR, Olson CR (2005) Neuronal activity in primate orbitofrontal cortex reflects the value of time. J Neurophysiol 94:2457-2471. CrossRef Medline
48. Roesch MR, Taylor AR, Schoenbaum G (2006) Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 51:509-520. CrossRef Medline
49. Rudebeck PH, Walton ME, Smyth AN, Bannerman DM, Rushworth MF (2006) Separate neural pathways process different decision costs. Nat Neurosci 9:1161-1168. CrossRef Medline
50. Rudebeck PH, Behrens TE, Kennerley SW, Baxter MG, Buckley MJ, Walton ME, Rushworth MF (2008) Frontal cortex subregions play distinct roles in choices between actions and stimuli. J Neurosci 28:13775-13785. CrossRef Medline
51. Rushworth MF, Walton ME, Kennerley SW, Bannerman DM (2004) Action sets and decisions in the medial frontal cortex. Trends Cogn Sci 8:410-417. CrossRef Medline
52. Rushworth MF, Kolling N, Sallet J, Mars RB (2012) Valuation and decision-making in frontal cortex: one or many serial or parallel systems? Curr Opin Neurobiol 22:946-955. CrossRef Medline
53. Schapiro AC, Rogers TT, Cordova NI, Turk-Browne NB, Botvinick MM (2013) Neural representations of events arise from temporal community structure. Nat Neurosci 16:486-492. CrossRef Medline
54. Shenoy KV, Sahani M, Churchland MM (2013) Cortical control of arm movements: a dynamical systems perspective. Annu Rev Neurosci 36: 337-359. CrossRef Medline
55. Shidara M, Richmond BJ (2002) Anterior cingulate: single neuronal signals related to degree of reward expectancy. Science 296:1709-1711. CrossRef Medline
56. Shima K, Tanji J (1998) Role for cingulate motor area cells in voluntary movement selection based on reward. Science 282:1335-1338. CrossRef Medline
57. Small DM, Bender G, Veldhuizen MG, Rudenga K, Nachtigal D, Felsted J (2007) The role of the human orbitofrontal cortex in taste and flavor processing. Ann N Y Acad Sci 1121:136-151. CrossRef Medline
58. Takahashi YK, Roesch MR, Wilson RC, Toreson K, O'Donnell P, Niv Y, Schoenbaum G (2011) Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex. Nat Neurosci 14:1590-1597. CrossRef Medline
59. Thaler RH (1981) Some empirical evidence on dynamic inconsistency. Econ Lett 8:201-207. CrossRef
60. Toda K, Sugase-Miyamoto Y, Mizuhiki T, Inaba K, Richmond BJ, Shidara M (2012) Differential encoding of factors influencing predicted reward value in monkey rostral anterior cingulate cortex. PLoS One 7:e30190. CrossRef Medline
61. Van Hoesen GW, Morecraft RJ, Vogt BA (1993) Connections of the monkey cingulate cortex. In: Neurobiology of cingulate cortex and limbic thalamus: a comprehensive handbook (Vogt BA, Gabriel M, eds), pp 249-284. Cambridge, MA: Birkhaeuser.
62. Wallis JD, Kennerley SW (2010) Heterogeneous reward signals in prefrontal cortex. Curr Opin Neurobiol 20:191-198. CrossRef Medline
63. Wallis JD, Rich EL (2011) Challenges of interpreting frontal neurons during value-based decision-making. Front Neurosci 5:124.
64. Wallis JD, Anderson KC, Miller EK (2001) Single neurons in prefrontal cortex encode abstract rules. Nature 411:953-956. CrossRef Medline
65. Walton ME, Bannerman DM, Rushworth MF (2002) The role of rat medial frontal cortex in effort-based decision making. J Neurosci 22:10996-11003. Medline
66. Walton ME, Behrens TE, Buckley MJ, Rudebeck PH, Rushworth MF (2010) Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65:927-939. CrossRef Medline
67. Wise SP (2008) Forward frontal fields: phylogeny and fundamental function. Trends Neurosci 31:599-608. CrossRef Medline
68. Wu KN, Tan BK, Howard JD, Conley DB, Gottfried JA (2012) Olfactory input is critical for sustaining odor quality codes in human orbitofrontal cortex. Nat Neurosci 15:1313-1319. CrossRef Medline