Decision making and reward in frontal cortex: Complementary evidence from neurophysiological and neuropsychological studies

Behavioral Neuroscience

Volumn 125, Issue 3, 2011, Pages 297-317

  Kennerley, Steven W ^a   Walton, Mark E ^b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Anterior cingulate cortex (ACC); Decision making; Learning; Orbitofrontal cortex (OFC); Reward

Indexed keywords

ADAPTATION; ANALYTICAL ERROR; ARTICLE; BRAIN DAMAGE; COGNITION; DECISION MAKING; FRONTAL LOBE; HUMAN; LEARNING; LEARNING DISORDER; NEUROMODULATION; NEUROPHYSIOLOGY; NEUROPSYCHOLOGY; NONHUMAN; PREFRONTAL CORTEX; REWARD; SIGNAL TRANSDUCTION; TASK PERFORMANCE;

ANIMALS; BRAIN MAPPING; CHOICE BEHAVIOR; COGNITION; DECISION MAKING; FRONTAL LOBE; LEARNING; NEURONS; PREFRONTAL CORTEX; REWARD;

EID: 79958736364     PISSN: 07357044     EISSN: 19390084     Source Type: Journal    
DOI: 10.1037/a0023575     Document Type: Article

References (204)

1. Amiez C., Joseph J.P., Procyk E. Anterior cingulate error-related activity is modulated by predicted reward. European Journal of Neuroscience 2005, 21:3447-3452.
2. Amiez C., Joseph J.P., Procyk E. Reward encoding in the monkey anterior cingulate cortex. Cerebral Cortex 2006, 16:1040-1055.
3. Aron A.R., Robbins T.W., Poldrack R.A. Inhibition and the right inferior frontal cortex. Trends in Cognitive Sciences 2004, 8:170-177.
4. Awh E., Jonides J. Overlapping mechanisms of attention and spatial working memory. Trends in Cognitive Sciences 2001, 5:119-126.
5. Balleine B.W., O'Doherty J.P. Human and rodent homologies in action control: Corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 2010, 35:48-69.
6. Baxter M.G., Gaffan D., Kyriazis D.A., Mitchell A.S. Dorsolateral prefrontal lesions do not impair tests of scene learning and decision-making that require frontal-temporal interaction. European Journal of Neuroscience 2008, 28:491-499.
7. Baxter M.G., Gaffan D., Kyriazis D.A., Mitchell A.S. Ventrolateral prefrontal cortex is required for performance of a strategy implementation task but not reinforcer devaluation effects in rhesus monkeys. European Journal of Neuroscience 2009, 29:2049-2059.
8. Baxter M.G., Parker A., Lindner C.C., Izquierdo A.D., Murray E.A. Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. Journal of Neuroscience 2000, 20:4311-4319.
9. Bayer H.M., Glimcher P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 2005, 47:129-141.
10. Baylis L.L., Gaffan D. Amygdalectomy and ventromedial prefrontal ablation produce similar deficits in food choice and in simple object discrimination learning for an unseen reward. Experimental Brain Research 1991, 86:617-622.
11. Bays P.M., Husain M. Dynamic shifts of limited working memory resources in human vision. Science 2008, 321(5890):851-854.
12. Bechara A., Damasio A.R., Damasio H., Anderson S.W. Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 1994, 50:15.
13. Bechara A., Damasio H., Tranel D., Anderson S.W. Dissociation of working memory from decision making within the human prefrontal cortex. Journal of Neuroscience 1998, 18:428-437.
14. Beck J.M., Ma W.J., Kiani R., Hanks T., Churchland A.K., Roitman J., Pouget A. Probabilistic population codes for Bayesian decision making. Neuron 2008, 60:1142-1152.
15. Behrens T.E., Woolrich M.W., Walton M.E., Rushworth M.F. Learning the value of information in an uncertain world. Nature Neuroscience 2007, 10:1214-1221.
16. Bendiksby M.S., Platt M.L. Neural correlates of reward and attention in macaque area LIP. Neuropsychologia 2006, 44:2411-2420.
17. Berger B., Trottier S., Verney C., Gaspar P., Alvarez C. Regional and laminar distribution of the dopamine and serotonin innervation in the macaque cerebral cortex: A radioautographic study. Journal of Comparative Neurology 1988, 273:99-119.
18. Bogacz R. Optimal decision-making theories: Linking neurobiology with behaviour. Trends in Cognitive Sciences 2007, 11:118-125.
19. Bouret S., Richmond B.J. Ventromedial and orbital prefrontal neurons differentially encode internally and externally driven motivational values in monkeys. Journal of Neuroscience 2010, 30:8591-8601.
20. Buckley M.J., Mansouri F.A., Hoda H., Mahboubi M., Browning P.G., Kwok S.C., Tanaka K. Dissociable components of rule-guided behavior depend on distinct medial and prefrontal regions. Science 2009, 325:52-58.
21. Carmichael S.T., Price J.L. Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys. Journal of Comparative Neurology 1995, 363:642-664.
22. Cavada C., Company T., Tejedor J., Cruz-Rizzolo R.J., Reinoso-Suarez F. The anatomical connections of the macaque monkey orbitofrontal cortex. A review. Cerebral Cortex 2000, 10:220-242.
23. Cisek P. Cortical mechanisms of action selection: The affordance competition hypothesis. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences 2007, 362:1585-1599.
24. Cisek P., Kalaska J.F. Neural correlates of reaching decisions in dorsal premotor cortex: Specification of multiple direction choices and final selection of action. Neuron 2005, 45:801-814.
25. Cisek P., Puskas G.A., El-Murr S. Decisions in changing conditions: The urgency-gating model. Journal of Neuroscience 2009, 29:11560-11571.
26. Coricelli G., Critchley H.D., Joffily M., O'Doherty J.P., Sirigu A., Dolan R.J. Regret and its avoidance: A neuroimaging study of choice behavior. Nature Neuroscience 2005, 8:1255-1262.
27. Critchley H.D., Rolls E.T. Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. Journal of Neurophysiology 1996, 75:1673-1686.
28. Cromwell H.C., Hassani O.K., Schultz W. Relative reward processing in primate striatum. Experimental Brain Research 2005, 162:520-525.
29. Croxson P.L., Johansen-Berg H., Behrens T.E., Robson M.D., Pinsk M.A., Gross C.G., Rushworth M.F. Quantitative investigation of connections of the prefrontal cortex in the human and macaque using probabilistic diffusion tractography. Journal of Neuroscience 2005, 25:8854-8866.
30. Curtis C.E., Lee D. Beyond working memory: The role of persistent activity in decision making. Trends in Cognitive Sciences 2010, 14:216-222.
31. Damasio A.R. Descartes' error: Emotion, reason, and the human brain 1994, Putman, New York, NY.
32. Damasio A.R., Van Hoesen G.W. Emotional disturbances associated with focal lesions of the limbic frontal lobe. Neuropsychology of human emotion 1983, 1:85-110. Guilford Press, New York, NY. K.M. Heilman, P. Satz (Eds.).
33. de Araujo I.E., Gutierrez R., Oliveira-Maia A.J., Pereira A., Nicolelis M.A., Simon S.A. Neural ensemble coding of satiety states. Neuron 2006, 51:483-494.
34. Devinsky O., Lucuano D. The contributions of cingulate cortex to human behavior. Neurobiology of cingulate cortex and limbic thalamus: A comprehensive handbook 1993, 527-556. Birkhaeuser, Cambridge, MA. B.A. Vogt, M. Gabriel (Eds.).
35. Doya K. Modulators of decision making. Nature Neuroscience 2008, 11:410-416.
36. Dum R.P., Strick P.L. Cingulate motor areas. Neurobiology of cingulate cortex and limbic thalamus: A comprehensive handbook 1993, 415-441. Birkhaeuser, Cambridge, MA. B.A. Vogt, M. Gabriel (Eds.).
37. Dum R.P., Strick P.L. Spinal cord terminations of the medial wall motor areas in macaque monkeys. Journal of Neuroscience 1996, 16:6513-6525.
38. Duncan J. An adaptive coding model of neural function in prefrontal cortex. Nature Reviews Neuroscience 2001, 2:820-829.
39. Eslinger P.J., Damasio A.R. Severe disturbance of higher cognition after bilateral frontal lobe ablation: Patient EVR. Neurology 1985, 35:1731-1741.
40. Fellows L.K. Deciding how to decide: Ventromedial frontal lobe damage affects information acquisition in multi-attribute decision making. Brain 2006, 129:944-952.
41. Fellows L.K., Farah M.J. Ventromedial frontal cortex mediates affective shifting in humans: Evidence from a reversal learning paradigm. Brain 2003, 126(Pt. 8):1830-1837.
42. Fellows L.K., Farah M.J. Different underlying impairments in decision-making following ventromedial and dorsolateral frontal lobe damage in humans. Cerebral Cortex 2005, 15:58-63.
43. Fellows L.K., Farah M.J. The role of ventromedial prefrontal cortex in decision making: Judgment under uncertainty or judgment per se?. Cerebral Cortex 2007, 17:2669-2674.
44. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
45. Fleming S.M., Thomas C.L., Dolan R.J. Overcoming status quo bias in the human brain. Proceedings of the National Academy of Sciences of the United States of America 2010, 107:6005-6009.
46. Floresco S.B., Ghods-Sharifi S. Amygdala-prefrontal cortical circuitry regulates effort-based decision making. Cerebral Cortex 2007, 17:251-260.
47. Floyd N.S., Price J.L., Ferry A.T., Keay K.A., Bandler R. Orbitomedial prefrontal cortical projections to hypothalamus in the rat. Journal of Comparative Neurology 2001, 432:307-328.
48. Fujiwara J., Tobler P.N., Taira M., Iijima T., Tsutsui K. A parametric relief signal in human ventrolateral prefrontal cortex. NeuroImage 2009, 44:1163-1170.
49. Funahashi S., Bruce C.J., Goldman-Rakic P.S. Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. Journal of Neurophysiology 1989, 61:331-349.
50. Gallagher M., McMahan R.W., Schoenbaum G. Orbitofrontal cortex and representation of incentive value in associative learning. Journal of Neuroscience 1999, 19:6610-6614.
51. Gold J.I., Shadlen M.N. Representation of a perceptual decision in developing oculomotor commands. Nature 2000, 404:390-394.
52. Gold J.I., Shadlen M.N. Banburismus and the brain: Decoding the relationship between sensory stimuli, decisions, and reward. Neuron 2002, 36:299-308.
53. Gold J.I., Shadlen M.N. The influence of behavioral context on the representation of a perceptual decision in developing oculomotor commands. Journal of Neuroscience 2003, 23:632-651.
54. Hare T.A., Camerer C.F., Rangel A. Self-control in decision-making involves modulation of the vmPFC valuation system. Science 2009, 324(5927):646-648.
55. Hare T.A., O'Doherty J., Camerer C.F., Schultz W., Rangel A. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. Journal of Neuroscience 2008, 28:5623-5630.
56. Hayden B.Y., Platt M.L. Neurons in anterior cingulate cortex multiplex information about reward and action. Journal of Neuroscience 2010, 30:3339-3346.
57. He S.Q., Dum R.P., Strick P.L. Topographic organization of corticospinal projections from the frontal lobe: Motor areas on the medial surface of the hemisphere. Journal of Neuroscience 1995, 15:3284-3306.
58. Hikosaka K., Watanabe M. Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. Cerebral Cortex 2000, 10:263-271.
59. Hikosaka K., Watanabe M. Long- and short-range reward expectancy in the primate orbitofrontal cortex. European Journal of Neuroscience 2004, 19:1046-1054.
60. Hillman K.L., Bilkey D.K. Neurons in the rat anterior cingulate cortex dynamically encode cost-benefit in a spatial decision-making task. Journal of Neuroscience 2010, 30:7705-7713.
61. Holland P.C., Straub J.J. Differential effects of two ways of devaluing the unconditioned stimulus after Pavlovian appetitive conditioning. Journal of Experimental Psychology: Animal Behavior Processes 1979, 5:65-78.
62. Hosokawa T., Kato K., Inoue M., Mikami A. Neurons in the macaque orbitofrontal cortex code relative preference of both rewarding and aversive outcomes. Neuroscience Research 2007, 57:434-445.
63. Ito S., Stuphorn V., Brown J.W., Schall J.D. Performance monitoring by the anterior cingulate cortex during saccade countermanding. Science 2003, 302:120-122.
64. Izquierdo A., Suda R.K., Murray E.A. Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. Journal of Neuroscience 2004, 24:7540-7548.
65. Jocham G., Neumann J., Klein T.A., Danielmeier C., Ullsperger M. Adaptive coding of action values in the human rostral cingulate zone. Journal of Neuroscience 2009, 29:7489-7496.
66. Johnston K., Levin H.M., Koval M.J., Everling S. Top-down control-signal dynamics in anterior cingulate and prefrontal cortex neurons following task switching. Neuron 2007, 53:453-462.
67. Kable J.W., Glimcher P.W. The neurobiology of decision: Consensus and controversy. Neuron 2009, 63:733-745.
68. Kennerley S.W., Dahmubed A.F., Lara A.H., Wallis J.D. Neurons in the frontal lobe encode the value of multiple decision variables. Journal of Cognitive Neuroscience 2009, 21:1162-1178.
69. Kennerley S.W., Wallis J.D. Encoding of reward and space during a working memory task in the orbitofrontal cortex and anterior cingulate sulcus. Journal of Neurophysiology 2009, 102:3352-3364.
70. Kennerley S.W., Wallis J.D. Evaluating choices by single neurons in the frontal lobe: Outcome value encoded across multiple decision variables. European Journal of Neuroscience 2009, 29:2061-2073.
71. Kennerley S.W., Wallis J.D. Reward-dependent modulation of working memory in lateral prefrontal cortex. Journal of Neuroscience 2009, 29:3259-3270.
72. Kennerley S.W., Walton M.E., Behrens T.E., Buckley M.J., Rushworth M.F. Optimal decision making and the anterior cingulate cortex. Nature Neuroscience 2006, 9:940-947.
73. Kepecs A., Uchida N., Zariwala H.A., Mainen Z.F. Neural correlates, computation and behavioural impact of decision confidence. Nature 2008, 455:227-231.
74. Kim J.N., Shadlen M.N. Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque. Nature Neuroscience 1999, 2:176-185.
75. Kim S., Hwang J., Lee D. Prefrontal coding of temporally discounted values during intertemporal choice. Neuron 2008, 59:161-172.
76. Knutson B., Wimmer G.E. Splitting the difference: How does the brain code reward episodes?. Annals of the New York Academy of Sciences 2007, 1104:54-69.
77. Kobayashi S., Nomoto K., Watanabe M., Hikosaka O., Schultz W., Sakagami M. Influences of rewarding and aversive outcomes on activity in macaque lateral prefrontal cortex. Neuron 2006, 51:861-870.
78. Kobayashi S., Pinto de Carvalho O., Schultz W. Adaptation of reward sensitivity in orbitofrontal neurons. Journal of Neuroscience 2010, 30:534-544.
79. Krajbich I., Armel C., Rangel A. Visual fixations and the computation and comparison of value in simple choice. Nature Neuroscience 2010, 13:1292-1298.
80. Lara A.H., Kennerley S.W., Wallis J.D. Encoding of gustatory working memory by orbitofrontal neurons. Journal of Neuroscience 2009, 29:765-774.
81. Lebedev M.A., Messinger A., Kralik J.D., Wise S.P. Representation of attended versus remembered locations in prefrontal cortex. PLoS Biology 2004, 2:e365. doi: 10.1371/journal.pbio.0020365.
82. Leon M.I., Shadlen M.N. Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron 1999, 24:415-425.
83. Leon M.I., Shadlen M.N. Representation of time by neurons in the posterior parietal cortex of the macaque. Neuron 2003, 38:317-327.
84. Lohrenz T., McCabe K., Camerer C.F., Montague P.R. Neural signature of fictive learning signals in a sequential investment task. Proceedings of the National Academy of Sciences of the United States of America 2007, 104:9493-9498.
85. Luk C.H., Wallis J.D. Dynamic encoding of responses and outcomes by neurons in medial prefrontal cortex. Journal of Neuroscience 2009, 29:7526-7539.
86. Mansouri F.A., Buckley M.J., Tanaka K. Mnemonic function of the dorsolateral prefrontal cortex in conflict-induced behavioral adjustment. Science 2007, 318:987-990.
87. Mansouri F.A., Tanaka K., Buckley M.J. Conflict-induced behavioural adjustment: A clue to the executive functions of the prefrontal cortex. Nature Reviews Neuroscience 2009, 10:141-152.
88. Matsumoto K., Suzuki W., Tanaka K. Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science 2003, 301:229-232.
89. Matsumoto M., Hikosaka O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 2009, 459:837-841.
90. Matsumoto M., Matsumoto K., Abe H., Tanaka K. Medial prefrontal cell activity signaling prediction errors of action values. Nature Neuroscience 2007, 10:647-656.
91. Maunsell J.H. Neuronal representations of cognitive state: Reward or attention?. Trends in Cognitive Science 2004, 8:261-265.
92. McCoy A.N., Crowley J.C., Haghighian G., Dean H.L., Platt M.L. Saccade reward signals in posterior cingulate cortex. Neuron 2003, 40:1031-1040.
93. Miller E.K., Cohen J.D. An integrative theory of prefrontal cortex function. Annual Review of Neuroscience 2001, 24:167-202.
94. Mitz A.R., Tsujimoto S., Maclarty A.J., Wise S.P. A method for recording single-cell activity in the frontal-pole cortex of macaque monkeys. Journal of Neuroscience Methods 2009, 177:60-66.
95. Montague P.R., Berns G.S. Neural economics and the biological substrates of valuation. Neuron 2002, 36:265-284.
96. Montague P.R., Dayan P., Sejnowski T.J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. Journal of Neuroscience 1996, 16:1936-1947.
97. Morrison S.E., Salzman C.D. The convergence of information about rewarding and aversive stimuli in single neurons. Journal of Neuroscience 2009, 29:11471-11483.
98. Munoz D.P., Wurtz R.H. Saccade-related activity in monkey superior colliculus. I. Characteristics of burst and buildup cells. Journal of Neurophysiology 1995, 73:2313-2333.
99. Murray E.A., O'Doherty J.P., Schoenbaum G. What we know and do not know about the functions of the orbitofrontal cortex after 20 years of cross-species studies. Journal of Neuroscience 2007, 27:8166-8169.
100. Nakano Y., Oomura Y., Nishino H., Aou S., Yamamoto T., Nemoto S. Neuronal activity in the medial orbitofrontal cortex of the behaving monkey: Modulation by glucose and satiety. Brain Research Bulletin 1984, 12:381-385.
101. Niki H., Watanabe M. Cingulate unit activity and delayed response. Brain Research 1976, 110:381-386.
102. Niki H., Watanabe M. Prefrontal and cingulate unit activity during timing behavior in the monkey. Brain Research 1979, 171:213-224.
103. Noonan M.P., Walton M.E., Behrens T.E., Sallet J., Buckley M.J., Rushworth M.F. Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proceedings of the National Academy of Sciences of the United States of America 2010, 107:20547-20552.
104. O'Doherty J.P., Hampton A., Kim H. Model-based fMRI and its application to reward learning and decision making. Annals of the New York Academy of Sciences 2007, 1104:35-53.
105. O'Neill M., Schultz W. Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron 2010, 68:789-800.
106. Ongur D., An X., Price J.L. Prefrontal cortical projections to the hypothalamus in macaque monkeys. Journal of Comparative Neurology 1998, 401:480-505.
107. Ostlund S.B., Balleine B.W. Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goal-directed learning. Journal of Neuroscience 2005, 25:7763-7770.
108. Ostlund S.B., Balleine B.W. The contribution of orbitofrontal cortex to action selection. Annals of the New York Academy of Sciences 2007, 1121:174-192.
109. Ostlund S.B., Balleine B.W. Orbitofrontal cortex mediates outcome encoding in Pavlovian but not instrumental conditioning. Journal of Neuroscience 2007, 27:4819-4825.
110. Padoa-Schioppa C. Range-adapting representation of economic value in the orbitofrontal cortex. Journal of Neuroscience 2009, 29:14004-14014.
111. Padoa-Schioppa C., Assad J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 2006, 441:223-226.
112. Padoa-Schioppa C., Assad J.A. The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nature Neuroscience 2008, 11:95-102.
113. Pan X., Sawa K., Tsuda I., Tsukada M., Sakagami M. Reward prediction based on stimulus categorization in primate lateral prefrontal cortex. Nature Neuroscience 2008, 11:703-712.
114. Pasupathy A., Miller E.K. Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 2005, 433:873-876.
115. Paton J.J., Belova M.A., Morrison S.E., Salzman C.D. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 2006, 439:865-870.
116. Pears A., Parkinson J.A., Hopewell L., Everitt B.J., Roberts A.C. Lesions of the orbitofrontal but not medial prefrontal cortex disrupt conditioned reinforcement in primates. Journal of Neuroscience 2003, 23:11189-11201.
117. Petrides M. Specialized systems for the processing of mnemonic information within the primate frontal cortex. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences 1996, 351(1346):1455-1461.
118. Petrides M. Dissociable roles of mid-dorsolateral prefrontal and anterior inferotemporal cortex in visual working memory. Journal of Neuroscience 2000, 20:7496-7503.
119. Petrides M. Lateral prefrontal cortex: Architectonic and functional organization. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences 2005, 360:781-795.
120. Petrides M., Pandya D.N. Comparative cytoarchitectonic analysis of the human and the macaque ventrolateral prefrontal cortex and corticocortical connection patterns in the monkey. European Journal of Neuroscience 2002, 16:291-310.
121. Pickens C.L., Saddoris M.P., Setlow B., Gallagher M., Holland P.C., Schoenbaum G. Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. Journal of Neuroscience 2003, 23:11078-11084.
122. Piekema C., Browning P.G.F., Buckley M.J. The role of the frontal pole in episodic and discrimination learning. Society for Neuroscience, Abstracts 2009, 2:ee126.
123. Platt M.L., Glimcher P.W. Neural correlates of decision variables in parietal cortex. Nature 1999, 400:233-238.
124. Procyk E., Tanaka Y.L., Joseph J.P. Anterior cingulate activity during routine and non-routine sequential behaviors in macaques. Nature Neuroscience 2000, 3:502-508.
125. Quilodran R., Rothe M., Procyk E. Behavioral shifts and action valuation in the anterior cingulate cortex. Neuron 2008, 57:314-325.
126. Rainer G., Asaad W.F., Miller E.K. Selective representation of relevant information by neurons in the primate prefrontal cortex. Nature 1998, 393:577-579.
127. Rangel A., Camerer C., Montague P.R. A framework for studying the neurobiology of value-based decision making. Nature Reviews Neuroscience 2008, 9:545-556.
128. Rangel A., Hare T. Neural computations associated with goal-directed choice. Current Opinion in Neurobiology 2010, 20:262-270.
129. Rao S.C., Rainer G., Miller E.K. Integration of what and where in the primate prefrontal cortex. Science 1997, 276:821-824.
130. Ratcliff R., Hasegawa Y.T., Hasegawa R.P., Smith P.L., Segraves M.A. Dual diffusion model for single-cell recording data from the superior colliculus in a brightness-discrimination task. Journal of Neurophysiology 2007, 97:1756-1774.
131. Ratcliff R., McKoon G. The diffusion decision model: Theory and data for two-choice decision tasks. Neural Computation 2008, 20:873-922.
132. Rizzolatti G., Luppino G., Matelli M. The classic supplementary motor area is formed by two independent areas. Advances in Neurology 1996, 70:45-56.
133. Roesch M.R., Calu D.J., Schoenbaum G. Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nature Neuroscience 2007, 10:1615-1624.
134. Roesch M.R., Olson C.R. Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. Journal of Neurophysiology 2003, 90:1766-1789.
135. Roesch M.R., Olson C.R. Neuronal activity related to reward value and motivation in primate frontal cortex. Science 2004, 304:307-310.
136. Roesch M.R., Olson C.R. Neuronal activity in primate orbitofrontal cortex reflects the value of time. Journal of Neurophysiology 2005, 94:2457-2471.
137. Roesch M.R., Olson C.R. Neuronal activity related to anticipated reward in frontal cortex: Does it represent value or reflect motivation?. Annals of the New York Academy of Sciences 2007, 1121:431-446.
138. Roesch M.R., Taylor A.R., Schoenbaum G. Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 2006, 51:509-520.
139. Roitman J.D., Shadlen M.N. Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. Journal of Neuroscience 2002, 22:9475-9489.
140. Rolls E.T. The orbitofrontal cortex and reward. Cerebral Cortex 2000, 10:284-294.
141. Rolls E.T. The affective and cognitive processing of touch, oral texture, and temperature in the brain. Neuroscience and Biobehavioral Reviews 2010, 34:237-245.
142. Rolls E.T., Critchley H.D., Browning A.S., Hernadi I., Lenard L. Responses to the sensory properties of fat of neurons in the primate orbitofrontal cortex. Journal of Neuroscience 1999, 19:1532-1540.
143. Rolls E.T., Inoue K., Browning A. Activity of primate subgenual cingulate cortex neurons is related to sleep. Journal of Neurophysiology 2003, 90:134-142.
144. Rolls E.T., Sienkiewicz Z.J., Yaxley S. Hunger modulates the responses to gustatory stimuli of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. European Journal of Neuroscience 1989, 1:53-60.
145. Rolls E.T., Yaxley S., Sienkiewicz Z.J. Gustatory responses of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. Journal of Neurophysiology 1990, 64:1055-1066.
146. Rudebeck P.H., Behrens T.E., Kennerley S.W., Baxter M.G., Buckley M.J., Walton M.E., Rushworth M.F. Frontal cortex subregions play distinct roles in choices between actions and stimuli. Journal of Neuroscience 2008, 28:13775-13785.
147. Rudebeck P.H., Buckley M.J., Walton M.E., Rushworth M.F. A role for the macaque anterior cingulate gyrus in social valuation. Science 2006, 313:1310-1312.
148. Rudebeck P.H., Murray E.A. Amygdala and orbitofrontal cortex lesions differentially influence choices during object reversal learning. Journal of Neuroscience 2008, 28:8338-8343.
149. Rudebeck P.H., Walton M.E., Smyth A.N., Bannerman D.M., Rushworth M.F. Separate neural pathways process different decision costs. Nature Neuroscience 2006, 9:1161-1168.
150. Rushworth M.F., Behrens T.E. Choice, uncertainty and value in prefrontal and cingulate cortex. Nature Neuroscience 2008, 11:389-397.
151. Rushworth M.F., Buckley M.J., Gough P.M., Alexander I.H., Kyriazis D., McDonald K.R., Passingham R.E. Attentional selection and action selection in the ventral and orbital prefrontal cortex. Journal of Neuroscience 2005, 25:11628-11636.
152. Rushworth M.F., Nixon P.D., Eacott M.J., Passingham R.E. Ventral prefrontal cortex is not essential for working memory. Journal of Neuroscience 1997, 17:4829-4838.
153. Rushworth M.F., Walton M.E., Kennerley S.W., Bannerman D.M. Action sets and decisions in the medial frontal cortex. Trends in Cognitive Science 2004, 8:410-417.
154. Sallet J., Quilodran R., Rothe M., Vezoli J., Joseph J.P., Procyk E. Expectations, gains, and losses in the anterior cingulate cortex. Cognitive, Affective, & Behavioral Neuroscience 2007, 7:327-336.
155. Satoh T., Nakai S., Sato T., Kimura M. Correlated coding of motivation and outcome of decision by dopamine neurons. Journal of Neuroscience 2003, 23:9913-9923.
156. Scangos K.W., Stuphorn V. Medial frontal cortex motivates but does not control movement initiation in the countermanding task. Journal of Neuroscience 2010, 30:1968-1982.
157. Schoenbaum G., Chiba A.A., Gallagher M. Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nature Neuroscience 1998, 1:155-159.
158. Schoenbaum G., Chiba A.A., Gallagher M. Neural encoding in orbitofrontal cortex and basolateral amygdala during olfactory discrimination learning. Journal of Neuroscience 1999, 19:1876-1884.
159. Schoenbaum G., Roesch M.R., Stalnaker T.A., Takahashi Y.K. A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nature Reviews Neuroscience 2009, 10:885-892.
160. Schoenbaum G., Setlow B., Saddoris M.P., Gallagher M. Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala. Neuron 2003, 39:855-867.
161. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
162. Schweimer J., Hauber W. Involvement of the rat anterior cingulate cortex in control of instrumental responses guided by reward expectancy. Learning & Memory 2005, 12:334-342.
163. Seo H., Barraclough D.J., Lee D. Dynamic signals related to choices and outcomes in the dorsolateral prefrontal cortex. Cerebral Cortex 2007, 17:i110-i117.
164. Seo H., Lee D. Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. Journal of Neuroscience 2007, 27:8366-8377.
165. Seo H., Lee D. Behavioral and neural changes after gains and losses of conditioned reinforcers. Journal of Neuroscience 2009, 29:3627-3641.
166. Shidara M., Richmond B.J. Anterior cingulate: Single neuronal signals related to degree of reward expectancy. Science 2002, 296:1709-1711.
167. Shima K., Tanji J. Role for cingulate motor area cells in voluntary movement selection based on reward. Science 1998, 282:1335-1338.
168. Shuler M.G., Bear M.F. Reward timing in the primary visual cortex. Science 2006, 311:1606-1609.
169. Simmons J.M., Richmond B.J. Dynamic changes in representations of preceding and upcoming reward in monkey orbitofrontal cortex. Cerebral Cortex 2008, 18:93-103.
170. So N.Y., Stuphorn V. Supplementary eye field encodes option and action value for saccades with variable reward. Journal of Neurophysiology 2010, 104:2634-2653.
171. Stephens D.W., Krebs J.R. Foraging theory 1986, Princeton University Press, Princeton, NJ.
172. Stevens J.R., Rosati A.G., Ross K.R., Hauser M.D. Will travel for food: Spatial discounting in two new world monkeys. Current Biology 2005, 15:1855-1860.
173. Stuss D.T., Levine B., Alexander M.P., Hong J., Palumbo C., Hamer L., Izukawa D. Wisconsin Card Sorting Test performance in patients with focal frontal and posterior brain damage: Effects of lesion location and test structure on separable cognitive processes. Neuropsychologia 2000, 38:388-402.
174. Sul J.H., Kim H., Huh N., Lee D., Jung M.W. Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron 2010, 66:449-460.
175. Sutton R.S., Barto A.G. Reinforcement learning 1998, MIT Press, Cambridge, MA.
176. Takahashi Y.K., Roesch M.R., Stalnaker T.A., Haney R.Z., Calu D.J., Taylor A.R., Schoenbaum G. The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes. Neuron 2009, 62:269-280.
177. Tanji J., Hoshi E. Role of the lateral prefrontal cortex in executive behavioral control. Physiological Reviews 2008, 88:37-57.
178. Thorndike E.L. A Proof of the law of effect. Science 1933, 77:173-175.
179. Thorpe S.J., Rolls E.T., Maddison S. The orbitofrontal cortex: Neuronal activity in the behaving monkey. Experimental Brain Research 1983, 49:93-115.
180. Tobler P.N., Dickinson A., Schultz W. Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. Journal of Neuroscience 2003, 23:10402-10410.
181. Tobler P.N., Fiorillo C.D., Schultz W. Adaptive coding of reward value by dopamine neurons. Science 2005, 307:1642-1645.
182. Tremblay L., Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature 1999, 398:704-708.
183. Tremblay L., Schultz W. Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. Journal of Neurophysiology 2000, 83:1877-1885.
184. Tremblay L., Schultz W. Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. Journal of Neurophysiology 2000, 83:1864-1876.
185. Tsujimoto S., Genovesio A., Wise S.P. Monkey orbitofrontal cortex encodes response choices near feedback time. Journal of Neuroscience 2009, 29:2569-2574.
186. Tsujimoto S., Genovesio A., Wise S.P. Evaluating self-generated decisions in frontal pole cortex of monkeys. Nature Neuroscience 2010, 13:120-126.
187. Uchida Y., Lu X., Ohmae S., Takahashi T., Kitazawa S. Neuronal activity related to reward size and rewarded target position in primate supplementary eye field. Journal of Neuroscience 2007, 27:13750-13755.
188. Usher M., McClelland J.L. The time course of perceptual choice: The leaky, competing accumulator model. Psychological Review 2001, 108:550-592.
189. Vogt B.A., Vogt L., Farber N.B., Bush G. Architecture and neurocytology of monkey cingulate gyrus. Journal of Comparative Neurology 2005, 485:218-239.
190. Wallis J.D., Kennerley S.W. Heterogeneous reward signals in prefrontal cortex. Current Opinion in Neurobiology 2010, 20:191-198.
191. Wallis J.D., Miller E.K. Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. European Journal of Neuroscience 2003, 18:2069-20681.
192. Walton M.E., Bannerman D.M., Alterescu K., Rushworth M.F. Functional specialization within medial frontal cortex of the anterior cingulate for evaluating effort-related decisions. Journal of Neuroscience 2003, 23:6475-6479.
193. Walton M.E., Bannerman D.M., Rushworth M.F. The role of rat medial frontal cortex in effort-based decision making. Journal of Neuroscience 2002, 22:10996-11003.
194. Walton M.E., Behrens T.E., Buckley M.J., Rudebeck P.H., Rushworth M.F. Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 2010, 65:927-939.
195. Walton M.E., Kennerley S.W., Bannerman D.M., Phillips P.E., Rushworth M.F. Weighing up the benefits of work: Behavioral and neural analyses of effort-related decision making. Neural Networks 2006, 19:1302-1314.
196. Walton M.E., Rudebeck P.H., Behrens T.E., Rushworth M.F. Cingulate and orbitofrontal contributions to valuing knowns and unknowns in a changeable world. Decision making, affect, & learning 2011, 505-531. Oxford University Press, Oxford, England. M.R. Delgado, E. Phelps, T.W. Robbins (Eds.).
197. Wang X.J. Decision making in recurrent neuronal circuits. Neuron 2008, 60:215-234.
198. Wang Y., Shima K., Isoda M., Sawamura H., Tanji J. Spatial distribution and density of prefrontal cortical cells projecting to three sectors of the premotor cortex. NeuroReport 2002, 13:1341-1344.
199. Watanabe M. The appropriateness of behavioral responses coded in post-trial activity of primate prefrontal units. Neuroscience Letters 1989, 101:113-117.
200. Watanabe M. Reward expectancy in primate prefrontal neurons. Nature 1996, 382:629-632.
201. Watanabe M., Hikosaka K., Sakagami M., Shirakawa S. Coding and monitoring of motivational context in the primate prefrontal cortex. Journal of Neuroscience 2002, 22:2391-2400.
202. Wheeler E.Z., Fellows L.K. The human ventromedial frontal lobe is critical for learning from negative feedback. Brain 2008, 131:1323-1331.
203. Williams S.M., Goldman-Rakic P.S. Widespread origin of the primate mesofrontal dopamine system. Cerebral Cortex 1998, 8:321-345.
204. Wise S.P. Forward frontal fields: Phylogeny and fundamental function. Trends in Neurosciences 2008, 31:599-608.