From reward value to decision-making. Neuronal and computational principles

Handbook of Reward and Decision Making

Volumn , Issue , 2009, Pages 97-133

  Rolls, Edmund T ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84882485148     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-374620-7.00005-4     Document Type: Chapter

References (208)

1. Rolls E.T. Emotion Explained 2005, Oxford University Press, Oxford.
2. Gray J.A. Elements of a Two-Process Theory of Learning 1975, Academic Press, London.
3. Dickinson A. Contemporary Animal Learning Theory 1980, Cambridge University Press, Cambridge.
4. Mackintosh N.J. Conditioning and Associative Learning 1983, Oxford University Press, Oxford.
5. Mazur J.E. Learning and Behavior 1998, Prentice Hall, Upper Saddle River, NJ. fourth ed.
6. Lieberman D.A. Learning 2000, Wadsworth, Belmont, CA.
7. Rolls E.T. The Brain and Emotion 1999, Oxford University Press, Oxford.
8. Weiskrantz L. Emotion. Analysis of Behavioural Change 1968, 50-90. Harper and Row, New York and London. L. Weiskrantz (Ed.).
9. Carmichael S.T., Price J.L. Architectonic subdivision of the orbital and medial prefrontal cortex in the macaque monkey. J. Comp. Neurol. 1994, 346:366-402.
10. Petrides M., Pandya D.N. Comparative architectonic analysis of the human and macaque frontal cortex. Handbook of Neuropsychology 1995, 17-58. Elsevier Science, Amsterdam. F. Boller, J. Grafman (Eds.).
11. Öngür D., Price J.L. The organisation of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb. Cortex 2000, 10:206-219.
12. Kringelbach M.L., Rolls E.T. The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology. Prog. Neurobiol. 2004, 72:341-372.
13. Price J.L. Connections of orbital cortex. The Orbitofrontal Cortex 2006, 39-55. Oxford University Press, Oxford. D.H. Zald, S.L. Rauch (Eds.).
14. Price J.L. Definition of the orbital cortex in relation to specific connections with limbic and visceral structures and other cortical regions. Ann. NY Acad. Sci. 2007, 1121:54-71.
15. Rolls E.T. Functions of the primate temporal lobe cortical visual areas in invariant visual object and face recognition. Neuron 2000, 27:205-218.
16. Rolls E.T. The representation of information about faces in the temporal and frontal lobes. Neuropsychologia 2007, 45:125-143.
17. Rolls E.T. Memory, Attention, and Decision-making: A Unifying Computational Neuroscience Approach 2008, Oxford University Press, Oxford.
18. Rolls E.T., Deco G. Computational Neuroscience of Vision 2002, Oxford University Press, Oxford.
19. Rolls E.T., Stringer S.M. Invariant visual object recognition: a model, with lighting invariance. J. Physiol. Paris 2006, 100:43-62.
20. Norgren R. Central neural mechanisms of taste. Handbook of Physiology - The Nervous System III, Sensory Processes 1 1984, 1087-1128. American Physiological Society, Washington, DC. I. Darien-Smith (Ed.).
21. Rolls E.T., Scott T.R. Central taste anatomy and neurophysiology. Handbook of Olfaction and Gustation 2003, 679-705. Dekker, New York. second ed. R.L. Doty (Ed.).
22. Carmichael S.T., Price J.L. Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys. J. Comp. Neurol. 1995, 363:642-664.
23. Barbas H. Anatomic basis of cognitive-emotional interactions in the primate prefrontal cortex. Neurosci. Biobehav. Rev. 1995, 19:499-510.
24. Pandya D.N., Yeterian E.H. Comparison of prefrontal architecture and connections. Philos. Trans. R. Soc. Lond. B Biol. Sci. 1996, 351:1423-1431.
25. E.T. Rolls, F. Grabenhorst, The orbitofrontal cortex and beyond: from affect to decision-making, Prog. Neurobiol. 86 (2008) 216-244.
26. Rolls E.T. The functions of the orbitofrontal cortex. Brain Cogn. 2004, 55:11-29.
27. Rolls E.T., Yaxley S., Sienkiewicz Z.J. Gustatory responses of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. J. Neurophysiol. 1990, 64:1055-1066.
28. Baylis L.L., Rolls E.T. Responses of neurons in the primate taste cortex to glutamate. Physiol. Behav. 1991, 49:973-979.
29. Rolls E.T. The representation of umami taste in the taste cortex. J. Nutr. 2000, 130:S960-S965.
30. Rolls E.T., Critchley H., Wakeman E.A., Mason R. Responses of neurons in the primate taste cortex to the glutamate ion and to inosine 5'-monophosphate. Physiol. Behav. 1996, 59:991-1000.
31. Rolls E.T., Critchley H.D., Browning A., Hernadi I. The neurophysiology of taste and olfaction in primates, and umami flavor. Ann. NY Acad. Sci. 1998, 855:426-437.
32. Rolls E.T., Verhagen J.V., Kadohisa M. Representations of the texture of food in the primate orbitofrontal cortex: neurons responding to viscosity, grittiness and capsaicin. J. Neurophysiol. 2003, 90:3711-3724.
33. Rolls E.T., Critchley H.D., Browning A.S., Hernadi A., Lenard L. Responses to the sensory properties of fat of neurons in the primate orbitofrontal cortex. J. Neurosci. 1999, 19:1532-1540.
34. Verhagen J.V., Rolls E.T., Kadohisa M. Neurons in the primate orbitofrontal cortex respond to fat texture independently of viscosity. J. Neurophysiol. 2003, 90:1514-1525.
35. Critchley H.D., Rolls E.T. Responses of primate taste cortex neurons to the astringent tastant tannic acid. Chem. Senses 1996, 21:135-145.
36. Simon S.A., de Araujo I.E., Gutierrez R., Nicolelis M.A. The neural mechanisms of gustation: a distributed processing code. Nat. Rev. Neurosci. 2006, 7:890-901.
37. Rolls E.T., Sienkiewicz Z.J., Yaxley S. Hunger modulates the responses to gustatory stimuli of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. Eur. J. Neurosci. 1989, 1:53-60.
38. Kringelbach M.L., O'Doherty J., Rolls E.T., Andrews C. Activation of the human orbitofrontal cortex to a liquid food stimulus is correlated with its subjective pleasantness. Cereb. Cortex 2003, 13:1064-1071.
39. Grabenhorst F., Rolls E.T. Selective attention to affective value alters how the brain processes taste stimuli. Eur. J. Neurosci. 2008, 27:723-729.
40. Mora F., Avrith D.B., Phillips A.G., Rolls E.T. Effects of satiety on self-stimulation of the orbitofrontal cortex in the monkey. Neurosci. Lett. 1979, 13:141-145.
41. Mora F., Avrith D.B., Rolls E.T. An electrophysiological and behavioural study of self-stimulation in the orbitofrontal cortex of the rhesus monkey. Brain Res. Bull. 1980, 5:111-115.
42. Rolls E.T., Burton M.J., Mora F. Neurophysiological analysis of brain-stimulation reward in the monkey. Brain Res. 1980, 194:339-357.
43. Rolls E.T. Understanding the mechanisms of food intake and obesity. Obes. Rev. 2007, 8:67-72.
44. Baylis L.L., Rolls E.T., Baylis G.C. Afferent connections of the orbitofrontal cortex taste area of the primate. Neuroscience 1995, 64:801-812.
45. Rolls E.T., Critchley H.D., Mason R., Wakeman E.A. Orbitofrontal cortex neurons: role in olfactory and visual association learning. J. Neurophysiol. 1996, 75:1970-1981.
46. Rolls E.T., Baylis L.L. Gustatory, olfactory, and visual convergence within the primate orbitofrontal cortex. J. Neurosci. 1994, 14:5437-5452.
47. Critchley H.D., Rolls E.T. Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. J. Neurophysiol. 1996, 75:1673-1686.
48. Pritchard T.C., Edwards E.M., Smith C.A., Hilgert K.G., Gavlick A.M., Maryniak T.D., Schwartz G.J., Scott T.R. Gustatory neural responses in the medial orbitofrontal cortex of the old world monkey. J. Neurosci. 2005, 25:6047-6056.
49. Pritchard T.C., Schwartz G.J., Scott T.R. Taste in the medial orbitofrontal cortex of the macaque. Ann. NY Acad. Sci. 2007, 1121:121-135.
50. Rolls E.T. Functions of the orbitofrontal and pregenual cingulate cortex in taste, olfaction, appetite and emotion. Acta Physiol. Hung. 2008, 95:131-164.
51. Pritchard T.C., Nedderman E.N., Edwards E.M., Petticoffer A.C., Schwartz G.J., Scott T.R. Satiety-responsive neurons in the medial orbitofrontal cortex of the macaque. Behav. Neurosci. 2008, 122:174-182.
52. Sanghera M.K., Rolls E.T., Roper-Hall A. Visual responses of neurons in the dorsolateral amygdala of the alert monkey. Exp. Neurol. 1979, 63:610-626.
53. Scott T.R., Karadi Z., Oomura Y., Nishino H., Plata-Salaman C.R., Lenard L., Giza B.K., Ao S. Gustatory neural coding in the amygdala of the alert monkey. J. Neurophysiol. 1993, 69:1810-1820.
54. Kadohisa M., Rolls E.T., Verhagen J.V. Neuronal representations of stimuli in the mouth: the primate insular taste cortex, orbitofrontal cortex, and amygdala. Chem. Senses 2005, 30:401-419.
55. Kadohisa M., Rolls E.T., Verhagen J.V. The primate amygdala: neuronal representations of the viscosity, fat texture, temperature, grittiness and taste of foods. Neuroscience 2005, 132:33-48.
56. Yan J., Scott T.R. The effect of satiety on responses of gustatory neurons in the amygdala of alert cynomolgus macaques. Brain Res. 1996, 740:193-200.
57. Burton M.J., Rolls E.T., Mora F. Effects of hunger on the responses of neurones in the lateral hypothalamus to the sight and taste of food. Exp. Neurol. 1976, 51:668-677.
58. O'Doherty J., Rolls E.T., Francis S., Bowtell R., McGlone F. The representation of pleasant and aversive taste in the human brain. J. Neurophysiol. 2001, 85:1315-1321.
59. Rolls E.T. The anterior and midcingulate cortices and reward. Cingulate Neurobiology & Disease 2008, Oxford University Press, Oxford. B.A. Vogt (Ed.).
60. Jones-Gotman M., Zatorre R.J. Olfactory identification in patients with focal cerebral excision. Neuropsychologia 1988, 26:387-400.
61. Zatorre R.J., Jones-Gotman M., Evans A.C., Meyer E. Functional localization of human olfactory cortex. Nature 1992, 360:339-340.
62. Takagi S.F. Olfactory frontal cortex and multiple olfactory processing in primates. Cerebral Cortex 1991, 133-152. Plenum Press, New York. A. Peters, E.G. Jones (Eds.).
63. Critchley H.D., Rolls E.T. Olfactory neuronal responses in the primate orbitofrontal cortex: analysis in an olfactory discrimination task. J. Neurophysiol. 1996, 75:1659-1672.
64. Schoenbaum G., Saddoris M.P., Stalnaker T.A. Reconciling the roles of orbitofrontal cortex in reversal learning and the encoding of outcome expectancies. Ann. NY Acad. Sci. 2007, 1121:320-335.
65. Schoenbaum G., Eichenbaum H. Information encoding in the rodent prefrontal cortex .1. Single-neuron activity in orbitofrontal cortex compared with that in pyriform cortex. J. Neurophysiol. 1995, 74:733-750.
66. Rolls E.T., Kringelbach M.L., de Araujo I.E.T. Different representations of pleasant and unpleasant odors in the human brain. Eur. J. Neurosci. 2003, 18:695-703.
67. Francis S., Rolls E.T., Bowtell R., McGlone F., O'Doherty J., Browning A., Clare S., Smith E. The representation of pleasant touch in the brain and its relationship with taste and olfactory areas. Neuroreport 1999, 10:453-459.
68. O'Doherty J., Rolls E.T., Francis S., Bowtell R., McGlone F., Kobal G., Renner B., Ahne G. Sensory-specific satiety related olfactory activation of the human orbitofrontal cortex. Neuroreport 2000, 11:893-897.
69. Morris J.S., Dolan R.J. Involvement of human amygdala and orbitofrontal cortex in hunger-enhanced memory for food stimuli. J. Neurosci. 2001, 21:5304-5310.
70. de Araujo I.E.T., Rolls E.T., Kringelbach M.L., McGlone F., Phillips N. Taste-olfactory convergence, and the representation of the pleasantness of flavour, in the human brain. Eur. J. Neurosci. 2003, 18:2374-2390.
71. Verhagen J.V., Kadohisa M., Rolls E.T. The primate insular/opercular taste cortex: neuronal representations of the viscosity, fat texture, grittiness, temperature and taste of foods. J. Neurophysiol. 2004, 92:1685-1699.
72. Chaudhari N., Landin A.M., Roper S.D. A metabotropic glutamate receptor variant functions as a taste receptor. Nat. Neurosci. 2000, 3:113-119.
73. Zhao G.Q., Zhang Y., Hoon M.A., Chandrashekar J., Erlenbach I., Ryba N.J., Zuker C.S. The receptors for mammalian sweet and umami taste. Cell 2003, 115:255-266.
74. Maruyama Y., Pereira E., Margolskee R.F., Chaudhari N., Roper S.D. Umami responses in mouse taste cells indicate more than one receptor. J. Neurosci. 2006, 26:2227-2234.
75. de Araujo I.E.T., Kringelbach M.L., Rolls E.T., Hobden P. The representation of umami taste in the human brain. J. Neurophysiol. 2003, 90:313-319.
76. McCabe C., Rolls E.T. Umami: a delicious flavor formed by convergence of taste and olfactory pathways in the human brain. Eur. J. Neurosci. 2007, 25:1855-1864.
77. Rolls E.T. Taste, olfactory, visual and somatosensory representations of the sensory properties of foods in the brain, and their relation to the control of food intake. Neural and Metabolic Control of Macronutrient Intake 2000, 247-262. CRC Press, Boca-Raton, FL. H.-R. Berthoud, R.J. Seeley (Eds.).
78. Kadohisa M., Rolls E.T., Verhagen J.V. Orbitofrontal cortex neuronal representation of temperature and capsaicin in the mouth. Neuroscience 2004, 127:207-221.
79. de Araujo I.E.T., Rolls E.T. The representation in the human brain of food texture and oral fat. J. Neurosci. 2004, 24:3086-3093.
80. Guest S., Grabenhorst F., Essick G., Chen Y., Young M., McGlone F., de Araujo I., Rolls E.T. Human cortical representation of oral temperature. Physiol. Behav. 2007, 92:975-984.
81. Rolls B.J., Wood R.J., Rolls E.T. Thirst: the initiation, maintenance, and termination of drinking. Prog. Psychobiol. Physiol. Psychol. 1980, 9:263-321.
82. Rolls E.T., O'Doherty J., Kringelbach M.L., Francis S., Bowtell R., McGlone F. Representations of pleasant and painful touch in the human orbitofrontal and cingulate cortices. Cereb. Cortex 2003, 13:308-317.
83. Olausson H., Lamarre Y., Backlund H., Morin C., Wallin B.G., Starck G., Ekholm S., Strigo I., Worsley K., Vallbo A.B., Bushnell M.C. Unmyelinated tactile afferents signal touch and project to insular cortex. Nat. Neurosci. 2002, 5:900-904.
84. McCabe C., Rolls E.T., Bilderbeck A., McGlone F. Cognitive influences on the affective representation of touch and the sight of touch in the human brain. Soc. Cogn. Affect. Neurosci. 2008, 3:97-108.
85. Rolls E.T., Grabenhorst F., Parris B.A. Warm pleasant feelings in the brain. Neuroimage 2008, 41:1504-1513.
86. Grabenhorst F., Rolls E.T., Bilderbeck A. How cognition modulates affective responses to taste and flavor: top down influences on the orbitofrontal and pregenual cingulate cortices. Cereb. Cortex 2008, 18:1549-1559.
87. Anderson A.K., Christoff K., Stappen I., Panitz D., Ghahremani D.G., Glover G., Gabrieli J.D., Sobel N. Dissociated neural representations of intensity and valence in human olfaction. Nat. Neurosci. 2003, 6:196-202.
88. Grabenhorst F., Rolls E.T., Margot C., da Silva M.A., Velazco M.I.A.P. How pleasant and unpleasant stimuli combine in different brain regions: odor mixtures. J. Neurosci. 2007, 27:13532-13540.
89. E.T. Rolls, The affective and cognitive processing of touch, oral texture, and temperature in the brain, Neurosci. Biobehav. Rev. (2008), April 3, Epub ahead of print.
90. Rolls E.T. Face processing in different brain areas, and critical band masking. J. Neuropsychol. 2008, 2:325-360.
91. Thorpe S.J., Rolls E.T., Maddison S. Neuronal activity in the orbitofrontal cortex of the behaving monkey. Exp. Brain Res. 1983, 49:93-115.
92. O'Doherty J.P., Deichmann R., Critchley H.D., Dolan R.J. Neural responses during anticipation of a primary taste reward. Neuron 2002, 33:815-826.
93. Rolls E.T., Judge S.J., Sanghera M. Activity of neurones in the inferotemporal cortex of the alert monkey. Brain Res. 1977, 130:229-238.
94. Rolls E.T., Treves A. Neural Networks and Brain Function 1998, Oxford University Press, Oxford.
95. Deco G., Rolls E.T. Synaptic and spiking dynamics underlying reward reversal in orbitofrontal cortex. Cereb. Cortex 2005, 15:15-30.
96. Roesch M., Schoenbaum G. From associations to expectancies: orbitofrontal cortex as gateway between the limbic system and representational memory. The Orbitofrontal Cortex 2006, 199-236. Oxford University Press, Oxford. D.H. Zald, S.L. Rauch (Eds.).
97. Rolls E.T., Hornak J., Wade D., McGrath J. Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage. J. Neurol. Neurosurg. Psychiatry 1994, 57:1518-1524.
98. Fellows L.K., Farah M.J. Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. Brain 2003, 126:1830-1837.
99. Hornak J., O'Doherty J., Bramham J., Rolls E.T., Morris R.G., Bullock P.R., Polkey C.E. Reward-related reversal learning after surgical excisions in orbitofrontal and dorsolateral prefrontal cortex in humans. J. Cogn. Neurosci. 2004, 16:463-478.
100. Paton J.J., Belova M.A., Morrison S.E., Salzman C.D. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 2006, 439:865-870.
101. Kringelbach M.L., Rolls E.T. Neural correlates of rapid reversal learning in a simple model of human social interaction. Neuroimage 2003, 20:1371-1383.
102. Rolls E.T., McCabe C., Redoute J. Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cereb. Cortex 2008, 18:652-663.
103. Schultz W. Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology. Curr. Opin. Neurobiol. 2004, 14:139-147.
104. Schultz W. Behavioral theories and the neurophysiology of reward. Annu. Rev. Psychol. 2006, 57:87-115.
105. Hare T.A., O'Doherty J., Camerer C.F., Schultz W., Rangel A. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci. 2008, 28:5623-5630.
106. Schultz W., Tremblay L., Hollerman J.R. Reward processing in primate orbitofrontal cortex and basal ganglia. Cereb. Cortex 2000, 10:272-284.
107. Niki H., Watanabe M. Prefrontal and cingulate unit activity during timing behavior in the monkey. Brain Res. 1979, 171:213-224.
108. Shima K., Tanji J. Role for cingulate motor area cells in voluntary movement selection based on reward. Science 1998, 282:1335-1338.
109. Bush G., Vogt B.A., Holmes J., Dale A.M., Greve D., Jenike M.A., Rosen B.R. Dorsal anterior cingulate cortex: a role in reward-based decision making. Proc. Natl. Acad. Sci. USA 2002, 99:523-528.
110. Rushworth M.F., Walton M.E., Kennerley S.W., Bannerman D.M. Action sets and decisions in the medial frontal cortex. Trends Cogn. Sci. 2004, 8:410-417.
111. Matsumoto M., Matsumoto K., Abe H., Tanaka K. Medial prefrontal selectivity signalling prediction errors of action values. Nat. Neurosci. 2007, 10:647-656.
112. Rushworth M.F., Behrens T.E. Choice, uncertainty and value in prefrontal and cingulate cortex. Nat. Neurosci. 2008, 11:389-397.
113. Cingulate Neurobiology & Disease 2008, Oxford University Press, Oxford. B.A. Vogt (Ed.).
114. Rolls E.T. Neurons in the cortex of the temporal lobe and in the amygdala of the monkey with responses selective for faces. Hum. Neurobiol. 1984, 3:209-222.
115. Rolls E.T. Neurophysiological mechanisms underlying face processing within and beyond the temporal cortical visual areas. Philos. Trans. R. Soc. Lond. B Biol. Sci. 1992, 335:11-21.
116. Rolls E.T. The orbitofrontal cortex. Philos. Trans. R. Soc. Lond. B Biol. Sci. 1996, 351:1433-1444.
117. Rolls E.T., Critchley H.D., Browning A.S., Inoue K. Face-selective and auditory neurons in the primate orbitofrontal cortex. Exp. Brain Res. 2006, 170:74-87.
118. Rolls E.T., Baylis G.C. Size and contrast have only small effects on the responses to faces of neurons in the cortex of the superior temporal sulcus of the monkey. Exp. Brain Res. 1986, 65:38-48.
119. Hasselmo M.E., Rolls E.T., Baylis G.C. The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey. Behav. Brain Res. 1989, 32:203-218.
120. O'Doherty J., Winston J., Critchley H., Perrett D., Burt D.M., Dolan R.J. Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness. Neuropsychologia 2003, 41:147-155.
121. Hornak J., Rolls E.T., Wade D. Face and voice expression identification in patients with emotional and behavioural changes following ventral frontal lobe damage. Neuropsychologia 1996, 34:247-261.
122. Hornak J., Bramham J., Rolls E.T., Morris R.G., O'Doherty J., Bullock P.R., Polkey C.E. Changes in emotion after circumscribed surgical lesions of the orbitofrontal and cingulate cortices. Brain 2003, 126:1691-1712.
123. de Araujo I.E.T., Rolls E.T., Velazco M.I., Margot C., Cayeux I. Cognitive modulation of olfactory processing. Neuron 2005, 46:671-679.
124. Rolls E.T. Sensory processing in the brain related to the control of food intake. Proc. Nutr. Soc. 2007, 66:96-112.
125. Rolls E.T., Grabenhorst F., Margot C., da Silva M.A.A.P., Velazco M.I. Selective attention to affective value alters how the brain processes olfactory stimuli. J. Cogn. Neurosci. 2008, 20:1815-1826.
126. Deco G., Rolls E.T. Attention, short-term memory, and action selection: a unifying theory. Prog. Neurobiol. 2005, 76:236-256.
127. Desimone R., Duncan J. Neural mechanisms of selective visual attention. Annu. Rev. Neurosci. 1995, 18:193-222.
128. Deco G., Rolls E.T. Neurodynamics of biased competition and co-operation for attention: a model with spiking neurons. J. Neurophysiol. 2005, 94:295-313.
129. Rolls E.T. Top-down control of visual perception: attention in natural vision. Perception 2008, 37:333-354.
130. Millenson J.R. Principles of Behavioral Analysis 1967, MacMillan, New York.
131. Rolls E.T. A theory of emotion, and its application to understanding the neural basis of emotion. Emotions. Neural and Chemical Control 1986, 325-344. Karger, Basel. Y. Oomura (Ed.).
132. Rolls E.T. Neural systems involved in emotion in primates. Emotion: theory, research, and experience, Vol. 3. Biological foundations of emotion 1986, 125-143. Academic Press, New York. R. Plutchik, H. Kellerman (Eds.).
133. Rolls E.T. A theory of emotion, and its application to understanding the neural basis of emotion. Cogn. Emotion 1990, 4:161-190.
134. Rolls E.T. The functions of the orbitofrontal cortex. Neurocase 1999, 5:301-312.
135. Rolls E.T. Précis of The brain and emotion. Behav. Brain Sci. 2000, 23:177-233.
136. Fellows L.K., Farah M.J. Different underlying impairments in decision-making following ventromedial and dorsolateral frontal lobe damage in humans. Cereb. Cortex 2005, 15:58-63.
137. Berlin H., Rolls E.T., Kischka U. Impulsivity, time perception, emotion, and reinforcement sensitivity in patients with orbitofrontal cortex lesions. Brain 2004, 127:1108-1126.
138. Fellows L.K. The role of orbitofrontal cortex in decision making: a component process account. Ann. NY Acad. Sci. 2007, 1121:421-430.
139. O'Doherty J., Kringelbach M.L., Rolls E.T., Hornak J., Andrews C. Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci. 2001, 4:95-102.
140. Adolphs R., Gosselin F., Buchanan T.W., Tranel D., Schyns P., Damasio A.R. A mechanism for impaired fear recognition after amygdala damage. Nature 2005, 433:68-72.
141. Spezio M.L., Huang P.Y., Castelli F., Adolphs R. Amygdala damage impairs eye contact during conversations with real people. J. Neurosci. 2007, 27:3994-3997.
142. Bechara A., Damasio H., Damasio A.R., Lee G.P. Different contributions of the human amygdala and ventromedial prefrontal cortex to decision-making. J. Neurosci. 1999, 19:5473-5481.
143. Brand M., Grabenhorst F., Starcke K., Vandekerckhove M.M., Markowitsch H.J. Role of the amygdala in decisions under ambiguity and decisions under risk: evidence from patients with Urbach-Wiethe disease. Neuropsychologia 2007, 45:1305-1317.
144. Phelps E.A., LeDoux J.E. Contributions of the amygdala to emotion processing: from animal models to human behavior. Neuron 2005, 48:175-187.
145. Seymour B., Dolan R. Emotion, decision making, and the amygdala. Neuron 2008, 58:662-671.
146. Rolls E.T. Emotion, higher order syntactic thoughts, and consciousness. Frontiers of Consciousness 2008, 131-167. Oxford University Press, Oxford. L. Weiskrantz, M.K. Davies (Eds.).
147. Rolls E.T., McCabe C. Enhanced affective brain representations of chocolate in cravers vs non-cravers. Eur. J. Neurosci. 2007, 26:1067-1076.
148. Beaver J.D., Lawrence A.D., Ditzhuijzen Jv., Davis M.H., Woods A., Calder A.J. Individual differences in reward drive predict neural responses to images of food. J. Neurosci. 2006, 26:5160-5166.
149. Berlin H., Rolls E.T. Time perception, impulsivity, emotionality, and personality in self-harming borderline personality disorder patients. J. Pers. Disord. 2004, 18:358-378.
150. Berlin H., Rolls E.T., Iversen S.D. Borderline personality disorder, impulsivity and the orbitofrontal cortex. Am. J. Psychiatry 2005, 162:2360-2373.
151. Rahman S., Sahakian B.J., Hodges J.R., Rogers R.D., Robbins T.W. Specific cognitive deficits in mild frontal variant frontotemporal dementia. Brain 1999, 122:1469-1493.
152. Viskontas I.V., Possin K.L., Miller B.L. Symptoms of frontotemporal dementia provide insights into orbitofrontal cortex function and social behavior. Ann. NY Acad. Sci. 2007, 1121:528-545.
153. Coyle J.T., Tsai G., Goff D. Converging evidence of NMDA receptor hypofunction in the pathophysiology of schizophrenia. Ann. NY Acad. Sci. 2003, 1003:318-327.
154. Loh M., Rolls E.T., Deco G. A dynamical systems hypothesis of schizophrenia. PLoS Comput. Biol. 2007, 3:e228. doi:210.1371/journal.pcbi.0030228.
155. Rolls E.T., Loh M., Deco G., Winterer G. Computational models of schizophrenia and dopamine modulation in the prefrontal cortex. Nat. Rev. Neurosci. 2008, 9:696-709.
156. Chakrabarty K., Bhattacharyya S., Christopher R., Khanna S. Glutamatergic dysfunction in OCD. Neuropsychopharmacology 2005, 30:1735-1740.
157. Pittenger C., Krystal J.H., Coric V. Glutamate-modulating drugs as novel pharmacotherapeutic agents in the treatment of obsessive-compulsive disorder. NeuroRx 2006, 3:69-81.
158. Rolls E.T., Loh M., Deco G. An attractor hypothesis of obsessive-compulsive disorder. Eur. J. Neurosci. 2008, 28:782-793.
159. Wallis J.D. Neuronal mechanisms in prefrontal cortex underlying adaptive choice behavior. Ann. NY Acad. Sci. 2007, 1121:447-460.
160. Padoa-Schioppa C., Assad J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 2006, 441:223-226.
161. de Araujo I.E.T., Kringelbach M.L., Rolls E.T., McGlone F. Human cortical responses to water in the mouth, and the effects of thirst. J. Neurophysiol. 2003, 90:1865-1876.
162. Plassmann H., O'Doherty J., Shiv B., Rangel A. Marketing actions can modulate neural representations of experienced pleasantness. Proc. Natl. Acad. Sci. USA 2008, 105:1050-1054.
163. Padoa-Schioppa C., Assad J.A. The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat. Neurosci. 2008, 11:95-102.
164. Tremblay L., Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature 1999, 398:704-708.
165. F. Grabenhorst, E.T. Rolls, Different representations of relative and absolute value in the human brain, (2009) (in press).
166. Glimcher P. Decisions, Uncertainty, and the Brain 2004, MIT Press, Cambridge, MA.
167. Tanaka S.C., Doya K., Okada G., Ueda K., Okamoto Y., Yamawaki S. Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat. Neurosci. 2004, 7:887-893.
168. Daw N.D., O'Doherty J.P., Dayan P., Seymour B., Dolan R.J. Cortical substrates for exploratory decisions in humans. Nature 2006, 441:876-879.
169. Kim H., Shimojo S., O'Doherty J.P. Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol. 2006, 4:e233.
170. Sutton R.S., Barto A.G. Reinforcement Learning 1998, MIT Press, Cambridge, MA.
171. Bernoulli J. Exposition of a new theory on the measurement of risk. Econometrica 1738/1954, 22:23-36.
172. von Neumann J., Morgenstern O. The Theory of Games and Economic Behavior 1944, Princeton University Press, Princeton, NJ.
173. Kahneman D., Tversky A. Prospect theory: an analysis of decision under risk. Econometrica 1979, 47:263-292.
174. Kahneman D., Tversky A. Choices, values, and frames. Am. Psychol. 1984, 4:341-350.
175. Tversky A., Kahneman D. Rational choice and the framing of decisions. J. Bus. 1986, 59:251-278.
176. Gintis H. Game Theory Evolving 2000, Princeton University Press, Princeton, NJ.
177. Rangel A., Camerer C., Montague P.R. A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 2008, 9:545-556.
178. Kable J.W., Glimcher P.W. The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 2007, 10:1625-1633.
179. Romo R., Hernandez A., Zainos A. Neuronal correlates of a perceptual decision in ventral premotor cortex. Neuron 2004, 41:165-173.
180. de Lafuente V., Romo R. Neural correlate of subjective sensory experience gradually builds up across cortical areas. Proc. Natl. Acad. Sci. USA 2006, 103:14266-14271.
181. G. Deco, E.T. Rolls, R. Romo, Stochastic dynamics as a principle of brain function, (2009) Prog. Neurobiol. doi: 10.1016./j.pneurobio.2009.01.006.
182. Grabenhorst F., Rolls E.T., Parris B.A. From affective value to decision-making in the prefrontal cortex. Eur. J. Neurosci. 2008, 28:1930-1939.
183. E.T. Rolls, F. Grabenhorst, B.A. Parris, Neural systems underlying decisions about affective odors, (2009), J. Cogn. Neurosci. Epub 25 March 2009.
184. Shallice T., Burgess P.W. Deficits in strategy application following frontal lobe damage in man. Brain 1991, 114(Pt 2):727-741.
185. Burgess P.W. Strategy application disorder: the role of the frontal lobes in human multitasking. Psychol. Res. 2000, 63:279-288.
186. Burgess P.W., Dumontheil I., Gilbert S.J. The gateway hypothesis of rostral prefrontal cortex (area 10) function. Trends Cogn. Sci. 2007, 11:290-298.
187. Heekeren H.R., Wartenburger I., Schmidt H., Prehn K., Schwintowski H.P., Villringer A. Influence of bodily harm on neural correlates of semantic and moral decision-making. Neuroimage 2005, 24:887-897.
188. Behrens T.E., Woolrich M.W., Walton M.E., Rushworth M.F. Learning the value of information in an uncertain world. Nat. Neurosci. 2007, 10:1214-1221.
189. Marsh A.A., Blair K.S., Vythilingam M., Busis S., Blair R.J. Response options and expectations of reward in decision-making: the differential roles of dorsal and rostral anterior cingulate cortex. Neuroimage 2007, 35:979-988.
190. Rushworth M.F., Behrens T.E., Rudebeck P.H., Walton M.E. Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour. Trends Cogn. Sci. 2007, 11:168-176.
191. Rushworth M.F., Buckley M.J., Behrens T.E., Walton M.E., Bannerman D.M. Functional organization of the medial frontal cortex. Curr. Opin. Neurobiol. 2007, 17:220-227.
192. Arana F.S., Parkinson J.A., Hinton E., Holland A.J., Owen A.M., Roberts A.C. Dissociable contributions of the human amygdala and orbitofrontal cortex to incentive motivation and goal selection. J. Neurosci. 2003, 23:9632-9638.
193. Moll J., Krueger F., Zahn R., Pardini M., de Oliveira-Souza R., Grafman J. Human fronto-mesolimbic networks guide decisions about charitable donation. Proc. Natl. Acad. Sci. USA 2006, 103:15623-15628.
194. Kim H., Adolphs R., O'Doherty J.P., Shimojo S. Temporal isolation of neural processes underlying face preference decisions. Proc. Natl. Acad. Sci. USA 2007, 104:18253-18258.
195. Wang X.J. Probabilistic decision making by slow reverberation in cortical circuits. Neuron 2002, 36:955-968.
196. Deco G., Rolls E.T. Decision-making and Weber's Law: a neurophysiological model. Eur. J. Neurosci. 2006, 24:901-916.
197. Carmichael S.T., Clugnet M-C., Price J.L. Central olfactory connections in the macaque monkey. J. Comp. Neurol. 1994, 346:403-434.
198. Morecraft R.J., Geula C., Mesulam M-M. Cytoarchitecture and neural afferents of orbitofrontal cortex in the brain of the monkey. J. Comp. Neurol. 1992, 232:341-358.
199. Small D.M., Gregory M.D., Mak Y.E., Gitelman D., Mesulam M.M., Parrish T. Dissociation of neural representation of intensity and affective valuation in human gustation. Neuron 2003, 39:701-711.
200. Critchley H.D., Wiens S., Rotshtein P., Ohman A., Dolan R.J. Neural systems supporting interoceptive awareness. Nat. Neurosci. 2004, 7:189-195.
201. Carmichael S.T., Price J.L. Connectional networks within the orbital and medial prefrontal cortex of macaque monkeys. J. Comp. Neurol. 1996, 371:179-207.
202. McFarland D.J. Problems of Animal Behaviour 1989, Longman, Harlow.
203. Montague P.R., Berns G.S. Neural economics and the biological substrates of valuation. Neuron 2002, 36:265-284.
204. Izuma K., Saito D.N., Sadato N. Processing of social and monetary rewards in the human striatum. Neuron 2008, 58:284-294.
205. Hebb D.O. The Organization of Behavior: A Neuropsychological Theory 1949, Wiley, New York.
206. Giocomo L.M., Hasselmo M.E. Neuromodulation by glutamate and acetylcholine can change circuit dynamics by regulating the relative influence of afferent input and excitatory feedback. Mol. Neurobiol. 2007, 36:184-200.
207. Rolls E.T. Memory systems in the brain. Annu. Rev. Psychol. 2000, 51:599-630.
208. Rodriguez S., Warren C.S., Moreno S., Cepeda-Benito A., Gleaves D.H., Del Carmen Fernandez M., Vila J. Adaptation of the food-craving questionnaire trait for the assessment of chocolate cravings: Validation across British and Spanish Women. Appetite 2007, 49:245-250.