Re-evaluating the role of the orbitofrontal cortex in reward and reinforcement

European Journal of Neuroscience

Volumn 35, Issue 7, 2012, Pages 997-1010

  Noonan, M P ^a,b   Kolling, N ^a,b   Walton, M E ^a,b   Rushworth, M F S ^a,b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Orbitofrontal cortex; Reinforcement; Reward; Value assignment; Value comparison

Indexed keywords

ADAPTIVE BEHAVIOR; AMYGDALOID NUCLEUS; ANIMAL BEHAVIOR; ARTICLE; BEHAVIOR; BEHAVIOR CHANGE; BOLD SIGNAL; CORPUS STRIATUM; CREDIT ASSIGNMENT HYPOTHESIS; DECISION MAKING; FUNCTIONAL ANATOMY; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HABENULA; HUMAN; LATERAL HABENULA; LATERAL ORBITOFRONTAL CORTEX; MACACA; MEDIAL ORBITOFRONTAL CORTEX; MEDIODORSAL THALAMUS; NEUROANATOMY; NONHUMAN; ORBITAL CORTEX; PERIRHINAL CORTEX; PERSEVERATION; PRIORITY JOURNAL; REINFORCEMENT; REWARD; STIMULUS RESPONSE; SUBCORTEX; THALAMUS; VENTROMEDIAL PREFRONTAL CORTEX;

ANIMALS; FRONTAL LOBE; HUMANS; NERVE NET; REINFORCEMENT (PSYCHOLOGY); REWARD;

EID: 84859322403     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/j.1460-9568.2012.08023.x     Document Type: Article

References (119)

1. Adams, C.D. & Dickinson, A. (1981) Instrumental responding following reinforcer devaluation. Q. J. Exp. Psychol. B, 33, 109-121.
2. Aggleton, J.P., Albasser, M.M., Aggleton, D.J., Poirier, G.L. & Pearce, J.M. (2010) Lesions of the rat perirhinal cortex spare the acquisition of a complex configural visual discrimination yet impair object recognition. Behav. Neurosci., 124, 55-68.
3. Amaral, D.G. & Price, J.L. (1984) Amygdalo-cortical projections in the monkey (Macaca fascicularis). J. Comp. Neurol., 230, 465-496.
4. Balleine, B. & Dickinson, A. (1991) Instrumental performance following reinforcement devaluation depends upon incentive learning. Q. J. Exp. Psychol., 43B, 279-296.
5. Balleine, B. & Dickinson, A. (1998) The role of incentive learning in instrumental outcome revaluation by sensory-specific satiety. Anim. Learn. Behav., 26, 46-59.
6. Barbas, H. Pandya, D.N. (1989) Architecture and intrinsic connections of the prefrontal cortex in the rhesus monkey. J. Comp. Neurol., 286, 353-375.
7. Baxter, M.G. & Murray, E.A. (2002) The amygdala and reward. Nat. Rev. Neurosci., 3, 563-573.
8. Baxter, M.G., Parker, A., Lindner, C.C.C., Izquierdo, A.D. & Murray, E.A. (2000) Control of response selection by reinforcer value requires interaction of amygdala and orbital frontal cortex. J. Neurosci., 20, 4311-4319.
9. Baylis, L.L. & Gaffan, D. (1991) Amygdalectomy and ventromedial prefrontal ablation produce similar deficits in food choice and in simple object discrimination learning for an unseen reward. Exp. Brain Res., 86, 617-622.
10. Beckmann, M., Johansen-Berg, H. & Rushworth, M.F. (2009) Connectivity-based parcellation of human cingulate cortex and its relation to functional specialization. J. Neurosci., 29, 1175-1190.
11. Behrens, T.E., Hunt, L.T., Woolrich, M.W. & Rushworth, M.F. (2008) Associative learning of social value. Nature, 456, 245-249.
12. Boorman, E.D., Behrens, T.E., Woolrich, M.W. & Rushworth, M.F. (2009) How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron, 62, 733-743.
13. Bouret, S. & Richmond, B.J. (2010) Ventromedial and orbital prefrontal neurons differentially encode internally and externally driven motivational values in monkeys. J. Neurosci., 30, 8591-8601.
14. Bray, S., Shimojo, S. & O'Doherty, J.P. (2010) Human medial orbitofrontal cortex is recruited during experience of imagined and real rewards. J. Neurophysiol., 103, 2506-2512.
15. Breiter, H.C., Aharon, I., Kahneman, D., Dale, A. & Shizgal, P. (2001) Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron, 30, 619-639.
16. Bromberg-Martin, E.S., Matsumoto, M., Hong, S. & Hikosaka, O. (2010) A pallidus-habenula-dopamine pathway signals inferred stimulus values. J. Neurophysiol., 104, 1068-1076.
17. Buckley, M.J. & Gaffan, D. (1997) Impairment of visual object-discrimination learning after perirhinal cortex ablation. Behav. Neurosci., 111, 467-475.
18. Buckley, M.J. & Gaffan, D. (1998) Perirhinal cortex ablation impairs visual object identification. J. Neurosci., 18, 2268-2275.
19. Carmichael, S.T. & Price, J.L. (1994) Architectonic subdivision of the orbital and medial prefrontal cortex in the macaque monkey. J. Comp. Neurol., 346, 366-402.
20. Carmichael, S.T. & Price, J.L. (1995a) Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J. Comp. Neurol., 363, 615-641.
21. Carmichael, S.T. & Price, J.L. (1995b) Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys. J. Comp. Neurol., 363, 642-664.
22. Carmichael, S.T. & Price, J.L. (1996) Connectional networks within the orbital and medial prefrontal cortex of macaque monkeys. J. Comp. Neurol., 371, 179-207.
23. Chiavaras, M.M. & Petrides, M. (2000) Orbitofrontal sulci of the human and macaque monkey brain. J. Comp. Neurol., 422, 35-54.
24. Chiavaras, M.M., LeGoualher, G., Evans, A. & Petrides, M. (2001) Three-dimensional probabilistic atlas of the human orbitofrontal sulci in standardized stereotaxic space. Neuroimage, 13, 479-496.
25. Clarke, H.F., Robbins, T.W. & Roberts, A.C. (2008) Lesions of the medial striatum in monkeys produce perseverative impairments during reversal learning similar to those produced by lesions of the orbitofrontal cortex. J. Neurosci., 28, 10972-10982.
26. Colwill, R.C. & Rescorla, R.A. (1985) Postconditioning devaluation of a reinforcer affects and incentive responding. J. Exp. Psychol. Anim. Behav. Process., 11, 120-132.
27. Croxson, P.L., Johansen-Berg, H., Behrens, T.E., Robson, M.D., Pinsk, M.A., Gross, C.G., Richter, W., Richter, M.C., Kastner, S. & Rushworth, M.F. (2005) Quantitative investigation of connections of the prefrontal cortex in the human and macaque using probabilistic diffusion tractography. J. Neurosci., 25, 8854-8866.
28. Daw, N.D., O'Doherty, J.P., Dayan, P., Seymour, B. & Dolan, R.J. (2006) Cortical substrates for exploratory decisions in humans. Nature, 441, 876-879.
29. Elliott, R., Dolan, R.J. & Frith, C.D. (2000) Dissociable functions in the medial and lateral orbitofrontal cortex: evidence from human neuroimaging studies. Cereb. Cortex, 10, 308-317.
30. Elliott, R., Newman, J.L., Longe, O.A. & Deakin, J.F. (2003) Differential response patterns in the striatum and orbitofrontal cortex to financial reward in humans: a parametric functional magnetic resonance imaging study. J. Neurosci., 23, 303-307.
31. Elliott, R., Agnew, Z. & Deakin, J.F. (2008) Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans. Eur. J. Neurosci., 27, 2213-2218.
32. Fellows, L.K. & Farah, M.J. (2003) Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. Brain, 126, 1830-1837.
33. Fellows, L.K. & Farah, M.J. (2007) The role of ventromedial prefrontal cortex in decision making: judgment under uncertainty or judgment per se? Cereb. Cortex, 17, 2669-2674.
34. FitzGerald, T.H., Seymour, B. & Dolan, R.J. (2009) The role of human orbitofrontal cortex in value comparison for incommensurable objects. J. Neurosci., 29, 8388-8395.
35. Gaffan, E.A., Eacott, M.J. & Simpson, E.L. (2000) Perirhinal cortex ablation in rats selectively impairs object identification in a simultaneous visual comparison task. Behav. Neurosci., 114, 18-31.
36. Gallagher, M., McMahan, R.W. & Schoenbaum, G. (1999) Orbitofrontal cortex and representation of incentive value in associative learning. J. Neurosci., 19, 6610-6614.
37. Gläscher, J., Hampton, A.N. & O'Doherty, J.P. (2009) Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cereb. Cortex, 19, 483-495.
38. Gottfried, J.A., O'Doherty, J. & Dolan, R.J. (2002) Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging. J. Neurosci., 22, 10829-10837.
39. Hare, T.A., O'Doherty, J., Camerer, C.F., Schultz, W. & Rangel, A. (2008) Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci., 28, 5623-5630.
40. Hare, T., Schultz, W., Camerer, C., O'Doherty, J. & Rangel, A. (2011) The transformation of stimulus value signals into motor commands during simple choice. Proc. Natl. Acad. Sci. USA, 108, 18120-18125.
41. Higo, T., Mars, R.B., Boorman, E.D., Buch, E.R. & Rushworth, M.F. (2011) Distributed and causal influence of frontal operculum in task control. Proc. Natl. Acad. Sci. USA, 108, 4230-4235.
42. Hornak, J., O'Doherty, J., Bramham, J., Rolls, E.T., Morris, R.G., Bullock, P.R. & Polkey, C.E. (2004) Reward-related reversal learning after surgical excisions in orbito-frontal or dorsolateral prefrontal cortex in humans. J. Cogn. Neurosci., 16, 463-478.
43. Iversen, S.D. & Mishkin, M. (1970) Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity. Exp. Brain Res., 11, 376-386.
44. Izquierdo, A. & Murray, E.A. (2004) Combined unilateral lesions of the amygdala and orbital prefrontal cortex impair affective processing in rhesus monkeys. J. Neurophysiol., 91, 2023-2039.
45. Izquierdo, A. & Murray, E.A. (2007) Selective bilateral amygdala lesions in rhesus monkeys fail to disrupt object reversal learning. J. Neurosci., 27, 1054-1062.
46. Izquierdo, A. & Murray, E.A. (2010) Functional interaction of medial mediodorsal thalamic nucleus but not nucleus accumbens with amygdala and orbital prefrontal cortex is essential for adaptive response selection after reinforcer devaluation. J. Neurosci., 30, 661-669.
47. Izquierdo, A., Suda, R.K. & Murray, E.A. (2004) Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J. Neurosci., 24, 7540-7548.
48. Jones, B. & Mishkin, M. (1972) Limbic lesions and the problem of stimulus-reinforcement associations. Exp. Neurol., 36, 362-377.
49. Kennerley, S.W. & Wallis, J.D. (2009) Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables. Eur. J. Neurosci., 29, 2061-2073.
50. Kennerley, S.W., Walton, M.E., Behrens, T.E., Buckley, M.J. & Rushworth, M.F. (2006) Optimal decision making and the anterior cingulate cortex. Nat. Neurosci., 9, 940-947.
51. Kennerley, S.W., Behrens, T.E. & Wallis, J.D. (2011) Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nat. Neurosci., 14, 1581-1589.
52. Kim, H., Shimojo, S. & O'Doherty, J.P. (2006) Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol., 4, e233.
53. Kondo, H., Saleem, K.S. & Price, J.L. (2003) Differential connections of the temporal pole with the orbital and medial prefrontal networks in macaque monkeys. J. Comp. Neurol., 465, 499-523.
54. Kondo, H., Saleem, K.S. & Price, J.L. (2005) Differential connections of the perirhinal and parahippocampal cortex with the orbital and medial prefrontal networks in macaque monkeys. J. Comp. Neurol., 493, 479-509.
55. Kringelbach, M.L. & Rolls, E.T. (2004) The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology. Prog. Neurobiol., 72, 341-372.
56. Lebreton, M., Jorge, S., Michel, V., Thirion, B. & Pessiglione, M. (2009) An automatic valuation system in the human brain: evidence from functional neuroimaging. Neuron, 64, 431-439.
57. Lee, A.C., Bandelow, S., Schwarzbauer, C., Henson, R.N. & Graham, K.S. (2006) Perirhinal cortex activity during visual object discrimination: an event-related fMRI study. Neuroimage, 33, 362-373.
58. Lim, S.L., O'Doherty, J.P. & Rangel, A. (2011) The Decision Value Computations in the vmPFC and Striatum Use a Relative Value Code That is Guided by Visual Attention. J. Neurosci., 31, 13214-13223.
59. Litt, A., Plassmann, H., Shiv, B. & Rangel, A. (2011) Dissociating valuation and saliency signals during decision-making. Cereb. Cortex, 21, 95-102.
60. Mackey, S. & Petrides, M. (2010) Quantitative demonstration of comparable architectonic areas within the ventromedial and lateral orbital frontal cortex in the human and the macaque monkey brains. Eur. J. Neurosci., 32, 1940-1950.
61. Malkova, L., Gaffan, D. & Murray, E.A. (1997) Excitotoxic lesions of the amygdala fail to produce impairment in visual learning for auditory secondary reinforcement but interfere with reinforcer devaluation effects in rhesus monkeys. J. Neurosci., 17, 6011-6020.
62. Matsumoto, M. & Hikosaka, O. (2007) Lateral habenula as a source of negative reward signals in dopamine neurons. Nature, 447, 1111-1115.
63. Montague, P.R., Dayan, P. & Sejnowski, T.J. (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci., 16, 1936-1947.
64. Morrison, S.E. & Salzman, C.D. (2009) The convergence of information about rewarding and aversive stimuli in single neurons. J. Neurosci., 29, 11471-11483.
65. Murayama, K., Matsumoto, M., Izuma, K. & Matsumoto, K. (2010) Neural basis of the undermining effect of monetary reward on intrinsic motivation. Proc. Natl Acad. Sci. USA, 107, 20911-20916.
66. Murray, E.A. & Richmond, B.J. (2001) Role of perirhinal cortex in object perception, memory, and associations. Curr. Opin. Neurobiol., 11, 188-193.
67. Neubert, F.X., Mars, R.B., Buch, E.R., Olivier, E. & Rushworth, M.F. (2010) Cortical and subcortical interactions during action reprogramming and their related white matter pathways. Proc. Natl Acad. Sci. USA, 107, 13240-13245.
68. von Neumann, J. & Morgenstern, O. (1947). Theory of Games and Economic Behaviour, 2nd edn. Princeton University Press, Princeton, NJ.
69. Noonan, M.P., Walton, M.E., Behrens, T.E., Sallet, J., Buckley, M.J. & Rushworth, M.F. (2010) Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc. Natl. Acad. Sci. USA, 107, 20547-20552.
70. Noonan, M.P., Mars, R.B. & Rushworth, M.F. (2011) Distinct roles of three frontal cortical areas in reward-guided behavior. J. Neurosci., 31, 14399-14412.
71. O'Doherty, J.P. (2007) Lights, camembert, action! The role of human orbitofrontal cortex in encoding stimuli, rewards, and choices. Ann. NY Acad. Sci., 1121, 254-272.
72. O'Doherty, J., Kringelbach, M.L., Rolls, E.T., Hornak, J. & Andrews, C. (2001a) Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci., 4, 95-102.
73. O'Doherty, J., Rolls, E.T., Francis, S., Bowtell, R. & McGlone, F. (2001b) Representation of pleasant and aversive taste in the human brain. J. Neurophysiol., 85, 1315-1321.
74. O'Doherty, J., Winston, J., Critchley, H., Perrett, D., Burt, D.M. & Dolan, R.J. (2003a) Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness. Neuropsychologia, 41, 147-155.
75. O'Doherty, J.P., Dayan, P., Friston, K., Critchley, H. & Dolan, R.J. (2003b) Temporal difference models and reward-related learning in the human brain. Neuron, 38, 329-337.
76. O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K. & Dolan, R.J. (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science, 304, 452-454.
77. Ongur, D., An, X. & Price, J.L. (1998) Orbital and medial prefrontal cortical projections to the hypothalamus in macaque monkeys. J. Comp. Neurol., 401, 480-505.
78. Padoa-Schioppa, C. & Assad, J.A. (2008) The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat. Neurosci., 11, 95-102.
79. Petrides, M. & Pandya, A. (1994) Comparative architectonic analysis of the human and the macaque frontal cortex. In Boller, F. & Grafman, J. (Eds), Handbook of Neuropsychology. Elsevier Science, Amsterdam, pp. 17-58.
80. Pickens, C.L., Saddoris, M.P., Setlow, B., Gallagher, M., Holland, P.C. & Schoenbaum, G. (2003) Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. J. Neurosci., 23, 11078-11084.
81. Pickens, C.L., Saddoris, M.P., Gallagher, M. & Holland, P.C. (2005) Orbitofrontal lesions impair use of cue-outcome associations in a devaluation task. Behav. Neurosci., 119, 317-322.
82. Plassmann, H., O'Doherty, J. & Rangel, A. (2007) Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J. Neurosci., 27, 9984-9988.
83. Plassmann, H., O'Doherty, J., Shiv, B. & Rangel, A. (2008) Marketing actions can modulate neural representations of experienced pleasantness. Proc. Natl Acad. Sci. USA, 105, 1050-1054.
84. Plassmann, H., O'Doherty, J.P. & Rangel, A. (2010) Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision making. J. Neurosci., 30, 10799-10808.
85. Prevost, C., Pessiglione, M., Metereau, E., Clery-Melin, M.L. & Dreher, J.C. (2010) Separate valuation subsystems for delay and effort decision costs. J. Neurosci., 30, 14080-14090.
86. Quilodran, R., Rothe, M. & Procyk, E. (2008) Behavioral shifts and action valuation in the anterior cingulate cortex. Neuron, 57, 314-325.
87. Rangel, A., Camerer, C. & Montague, P.R. (2008) A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci., 9, 545-556.
88. Rescorla, R.A. (1990) Instrumental responses become associated with reinforcers that differ in one feature. Anim. Learn. Behav., 18, 206-211.
89. Rescorla, R.A. (1992) Depression of an instrumental response by a single devaluation of its outcome. Q. J. Exp. Psychol. B, 44, 123-136.
90. Rolls, E.T. (2008) Functions of the orbitofrontal and pregenual cingulate cortex in taste, olfaction, appetite and emotion. Acta Physiol. Hung., 95, 131-164.
91. Rolls, B.J., Rolls, E.T., Rowe, E.A. & Sweeney, K. (1981) Sensory specific satiety in man. Physiol. Behav., 27, 137-142.
92. Rolls, E.T., Critchley, H.D., Mason, R. & Wakeman, E.A. (1996) Orbitofrontal cortex neurons: role in olfactory and visual association learning. J. Neurophysiol., 75, 1970-1981.
93. Rudebeck, P.H. & Murray, E.A. (2008) Amygdala and orbitofrontal cortex lesions differentially influence choices during object reversal learning. J. Neurosci., 28, 8338-8343.
94. Rudebeck, P.H. & Murray, E.A. (2011) Dissociable effects of subtotal lesions within the macaque orbital prefrontal cortex on reward-guided behavior. J. Neurosci., 31, 10569-10578.
95. Rudebeck, P.H., Behrens, T.E., Kennerley, S.W., Baxter, M.G., Buckley, M.J., Walton, M.E. & Rushworth, M.F. (2008) Frontal cortex subregions play distinct roles in choices between actions and stimuli. J. Neurosci., 28, 13775-13785.
96. Rushworth, M.F., Noonan, M.P., Boorman, E.D., Walton, M.E. & Behrens, T.E. (2011) Frontal cortex and reward-guided learning and decision-making. Neuron, 70, 1054-1069.
97. Rygula, R., Walker, S.C., Clarke, H.F., Robbins, T.W. & Roberts, A.C. (2010) Differential contributions of the primate ventrolateral prefrontal and orbitofrontal cortex to serial reversal learning. J. Neurosci., 30, 14552-14559.
98. Saleem, K.S., Kondo, H. & Price, J.L. (2008) Complementary circuits connecting the orbital and medial prefrontal networks with the temporal, insular, and opercular cortex in the macaque monkey. J. Comp. Neurol., 506, 659-693.
99. Schultz, W., Dayan, P. & Montague, P.R. (1997) A neural substrate of prediction and reward. Science, 275, 1593-1599.
100. Sescousse, G., Redoute, J. & Dreher, J.C. (2010) The architecture of reward value coding in the human orbitofrontal cortex. J. Neurosci., 30, 13095-13104.
101. Small, D.M., Zatorre, R.J., Dagher, A., Evans, A.C. & Jones-Gotman, M. (2001) Changes in brain activity related to eating chocolate: from pleasure to aversion. Brain, 124, 1720-1733.
102. Smith, D.V., Hayden, B.Y., Truong, T.K., Song, A.W., Platt, M.L. & Huettel, S.A. (2010) Distinct value signals in anterior and posterior ventromedial prefrontal cortex. J. Neurosci., 30, 2490-2495.
103. Sul, J.H., Kim, H., Huh, N., Lee, D. & Jung, M.W. (2010) Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron, 66, 449-460.
104. Tanaka, S.C., Doya, K., Okada, G., Ueda, K., Okamoto, Y. & Yamawaki, S. (2004) Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat. Neurosci., 7, 887-893.
105. Thorndike, E.L. (1911). Animal Intelligence: Experimental Studies. Macmillan, New York.
106. Thorndike, E.L. (1933) A proof of the law of effect. Science, 77, 173-175.
107. Tobler, P.N., Fletcher, P.C., Bullmore, E.T. & Schultz, W. (2007) Learning-related human brain activations reflecting individual finances. Neuron, 54, 167-175.
108. Tom, S.M., Fox, C.R., Trepel, C. & Poldrack, R.A. (2007) The neural basis of loss aversion in decision-making under risk. Science, 315, 515-518.
109. Tremblay, L. & Schultz, W. (1999) Relative reward preference in primate orbitofrontal cortex. Nature, 398, 704-708.
110. Ursu, S. & Carter, C.S. (2005) Outcome representations, counterfactual comparisons and the human orbitofrontal cortex: implications for neuroimaging studies of decision-making. Brain Res. Cogn. Brain Res., 23, 51-60.
111. Valentin, V.V., Dickinson, A. & O'Doherty, J.P. (2007) Determining the neural substrates of goal-directed learning in the human brain. J. Neurosci., 27, 4019-4026.
112. Walker, E.A. (1940) A cytoarchitectural study of the prefrontal area of the macaque monkey. J. Comp. Neurol., 73, 59-86.
113. Walton, M.E., Devlin, J.T. & Rushworth, M.F. (2004) Interactions between decision making and performance monitoring within prefrontal cortex. Nat. Neurosci., 7, 1259-1265.
114. Walton, M.E., Behrens, T.E., Buckley, M.J., Rudebeck, P.H. & Rushworth, M.F. (2010) Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron, 65, 927-939.
115. Walton, M.E., Behrens, T.E., Noonan, M.P. & Rushworth, M.F. (2011) Giving credit where credit is due: orbitofrontal cortex and valuation in an uncertain world. N. Y. Acad. Sci., 1239, 14-24.
116. Wellman, L.L., Gale, K. & Malkova, L. (2005) GABAA-mediated inhibition of basolateral amygdala blocks reward devaluation in macaques. J. Neurosci., 25, 4577-4586.
117. West, E.A., DesJardin, J.T., Gale, K. & Malkova, L. (2011) Transient inactivation of orbitofrontal cortex blocks reinforcer devaluation in macaques. J. Neurosci., 31, 15128-15135.
118. de Wit, S., Corlett, P.R., Aitken, M.R., Dickinson, A. & Fletcher, P.C. (2009) Differential engagement of the ventromedial prefrontal cortex by goal-directed and habitual behavior toward food pictures in humans. J. Neurosci., 29, 11330-11338.
119. Wunderlich, K., Rangel, A. & O'Doherty, J. (2010) Economic choices can be made using only stimulus values. Proc. Natl. Acad. Sci. USA, 107, 15005-15010.