Non-reward neural mechanisms in the orbitofrontal cortex

Cortex

Volumn 83, Issue , 2016, Pages 27-38

  Rolls, Edmund T ^a,b   Deco, Gustavo ^c,d  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF WARWICK   (United Kingdom)

^c UNIVERSITAT POMPEU FABRA   (Spain)

^d INSTITUCIÓ CATALANA DE RECERCA I ESTUDIS AVANÇATS ICREA   (Spain)

Author keywords

Attractor network; Depression; Emotion; Impulsiveness; Non reward; Orbitofrontal cortex; Reward; Reward prediction error

Indexed keywords

ARTICLE; CELL POPULATION; HUMAN; LONG TERM DEPRESSION; MODEL; NERVE CELL NETWORK; NOISE; ORBITAL CORTEX; PREDICTION; PRESYNAPTIC POTENTIAL; PUNISHMENT; REINFORCEMENT; REWARD; SHORT TERM SYNAPTIC DEPRESSION; SIMULATION; SYNAPTIC TRANSMISSION; ACTION POTENTIAL; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; EMOTION; NERVE CELL; PHYSIOLOGY; PREFRONTAL CORTEX;

ACTION POTENTIALS; COMPUTER SIMULATION; EMOTIONS; HUMANS; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONS; PREFRONTAL CORTEX; REWARD;

EID: 84969690788     PISSN: 00109452     EISSN: 19738102     Source Type: Journal    
DOI: 10.1016/j.cortex.2016.06.023     Document Type: Article

References (93)

1. Abeles, A., Corticonics. 1991, Cambridge University Press, New York.
2. Alexander, W.H., Brown, J.W., Medial prefrontal cortex as an action–outcome predictor. Nature Neuroscience 14 (2011), 1338–1344.
3. Amit, D.J., Modeling brain function. The world of attractor neural networks. 1989, Cambridge University Press, Cambridge.
4. Battaglia, F., Treves, A., Stable and rapid recurrent processing in realistic autoassociative memories. Neural Computation 10 (1998), 431–450.
5. Baylis, L.L., Gaffan, D., Amygdalectomy and ventromedial prefrontal ablation produce similar deficits in food choice and in simple object discrimination learning for an unseen reward. Experimental Brain Research 86 (1991), 617–622.
6. Berlin, H., Rolls, E.T., Iversen, S.D., Borderline personality disorder, impulsivity, and the orbitofrontal cortex. American Journal of Psychiatry 58 (2005), 234–245.
7. Berlin, H., Rolls, E.T., Kischka, U., Impulsivity, time perception, emotion, and reinforcement sensitivity in patients with orbitofrontal cortex lesions. Brain 127 (2004), 1108–1126.
8. Braitenberg, V., Schütz, A., Anatomy of the cortex. 1991, Springer-Verlag, Berlin.
9. Brunel, N., Wang, X.J., Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition. Journal of Computational Neuroscience 11 (2001), 63–85.
10. Butter, C.M., Perseveration in extinction and in discrimination reversal tasks following selective prefrontal ablations in Macaca mulatta. Physiology & Behavior 4 (1969), 163–171.
11. Butter, C.M., McDonald, J.A., Snyder, D.R., Orality, preference behavior, and reinforcement value of non-food objects in monkeys with orbital frontal lesions. Science 164 (1969), 1306–1307.
12. Camille, N., Tsuchida, A., Fellows, L.K., Double dissociation of stimulus-value and action-value learning in humans with orbitofrontal or anterior cingulate cortex damage. Journal of Neuroscience 31 (2011), 15048–15052.
13. Carlson, P.J., Diazgranados, N., Nugent, A.C., Ibrahim, L., Luckenbaugh, D.A., Brutsche, N., et al. Neural correlates of rapid antidepressant response to ketamine in treatment-resistant unipolar depression: A preliminary positron emission tomography study. Biological Psychiatry 73 (2013), 1213–1221.
14. Chau, B.K., Sallet, J., Papageorgiou, G.K., Noonan, M.P., Bell, A.H., Walton, M.E., et al. Contrasting roles for orbitofrontal cortex and amygdala in credit assignment and learning in macaques. Neuron 87 (2015), 1106–1118.
15. Cheng, W., Rolls, E.T., Qiu, J., Liu, W., Tang, Y., Huang, C.-C., et al. Medial reward and lateral non-reward orbitofrontal cortex circuits change in opposite directions in depression. Brain, 2016 in revision.
16. Critchley, H.D., Rolls, E.T., Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. Journal of Neurophysiology 75 (1996), 1673–1686.
17. Critchley, H.D., Rolls, E.T., Olfactory neuronal responses in the primate orbitofrontal cortex: Analysis in an olfactory discrimination task. Journal of Neurophysiology 75 (1996), 1659–1672.
18. Dayan, P., Abbott, L.F., Theoretical neuroscience. 2001, MIT Press, Cambridge, MA.
19. Deco, G., Ledberg, A., Almeida, R., Fuster, J., Neural dynamics of cross-modal and cross-temporal associations. Experimental Brain Research 166 (2005), 325–336.
20. Deco, G., Rolls, E.T., Neurodynamics of biased competition and cooperation for attention: A model with spiking neurons. Journal of Neurophysiology 94 (2005), 295–313.
21. Deco, G., Rolls, E.T., Sequential memory: A putative neural and synaptic dynamical mechanism. Journal of Cognitive Neuroscience 17 (2005), 294–307.
22. Deco, G., Rolls, E.T., Synaptic and spiking dynamics underlying reward reversal in the orbitofrontal cortex. Cerebral Cortex 15 (2005), 15–30.
23. Deco, G., Rolls, E.T., A neurophysiological model of decision-making and Weber's law. European Journal of Neuroscience 24 (2006), 901–916.
24. Deco, G., Rolls, E.T., Romo, R., Synaptic dynamics and decision-making. Proceedings of the National Academy of Sciences of the United States of America 107 (2010), 7545–7549.
25. Fellows, L.K., The role of orbitofrontal cortex in decision making: A component process account. Annals of the New York Academy of Sciences 1121 (2007), 421–430.
26. Fellows, L.K., Orbitofrontal contributions to value-based decision making: Evidence from humans with frontal lobe damage. Annals of the New York Academy of Sciences 1239 (2011), 51–58.
27. Fellows, L.K., Farah, M.J., Ventromedial frontal cortex mediates affective shifting in humans: Evidence from a reversal learning paradigm. Brain 126 (2003), 1830–1837.
28. Grabenhorst, F., Rolls, E.T., Value, pleasure, and choice systems in the ventral prefrontal cortex. Trends in Cognitive Sciences 15 (2011), 56–67.
29. Grabenhorst, F., Rolls, E.T., Bilderbeck, A., How cognition modulates affective responses to taste and flavor: Top-down influences on the orbitofrontal and pregenual cingulate cortices. Cerebral Cortex 18 (2008), 1549–1559.
30. Hertz, J., Krogh, A., Palmer, R.G., Introduction to the theory of neural computation. 1991, Addison Wesley, Wokingham, U.K.
31. Hopfield, J.J., Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences of the United States of America 79 (1982), 2554–2558.
32. Hornak, J., O'Doherty, J., Bramham, J., Rolls, E.T., Morris, R.G., Bullock, P.R., et al. Reward-related reversal learning after surgical excisions in orbitofrontal and dorsolateral prefrontal cortex in humans. Journal of Cognitive Neuroscience 16 (2004), 463–478.
33. Iversen, S.D., Mishkin, M., Perseverative interference in monkey following selective lesions of the inferior prefrontal convexity. Experimental Brain Research 11 (1970), 376–386.
34. Jahr, C., Stevens, C., Voltage dependence of NMDA-activated macroscopic conductances predicted by single-channel kinetics. Journal of Neuroscience 10 (1990), 3178–3182.
35. Jones, B., Mishkin, M., Limbic lesions and the problem of stimulus–reinforcement associations. Experimental Neurology 36 (1972), 362–377.
36. Koch, K.W., Fuster, J.M., Unit activity in monkey parietal cortex related to haptic perception and temporary memory. Experimental Brain Research 76 (1989), 292–306.
37. Kringelbach, M.L., O'Doherty, J., Rolls, E.T., Andrews, C., Activation of the human orbitofrontal cortex to a liquid food stimulus is correlated with its subjective pleasantness. Cerebral Cortex 13 (2003), 1064–1071.
38. Kringelbach, M.L., Rolls, E.T., Neural correlates of rapid reversal learning in a simple model of human social interaction. NeuroImage 20 (2003), 1371–1383.
39. Kringelbach, M.L., Rolls, E.T., The functional neuroanatomy of the human orbitofrontal cortex: Evidence from neuroimaging and neuropsychology. Progress in Neurobiology 72 (2004), 341–372.
40. Lally, N., Nugent, A.C., Luckenbaugh, D.A., Niciu, M.J., Roiser, J.P., Zarate, C.A. Jr., Neural correlates of change in major depressive disorder anhedonia following open-label ketamine. Journal of Psychopharmacology 29 (2015), 596–607.
41. Meunier, M., Bachevalier, J., Mishkin, M., Effects of orbital frontal and anterior cingulate lesions on object and spatial memory in rhesus monkeys. Neuropsychologia 35 (1997), 999–1015.
42. Murray, E.A., Izquierdo, A., Orbitofrontal cortex and amygdala contributions to affect and action in primates. Annals of the New York Academy of Sciences 1121 (2007), 273–296.
43. O'Doherty, J., Kringelbach, M.L., Rolls, E.T., Hornak, J., Andrews, C., Abstract reward and punishment representations in the human orbitofrontal cortex. Nature Neuroscience 4 (2001), 95–102.
44. Panzeri, S., Rolls, E.T., Battaglia, F., Lavis, R., Speed of feedforward and recurrent processing in multilayer networks of integrate-and-fire neurons. Network: Computation in Neural Systems 12 (2001), 423–440.
45. Passingham, R.E.P., Wise, S.P., The neurobiology of the prefrontal cortex. 2012, Oxford University Press, Oxford.
46. Rabinovich, M., Huerta, R., Laurent, G., Transient dynamics for neural processing. Science 321 (2008), 48–50.
47. Rabinovich, M.I., Varona, P., Tristan, I., Afraimovich, V.S., Chunking dynamics: Heteroclinics in mind. Frontiers in Computational Neuroscience, 8, 2014, 22.
48. Rolls, E.T., Processing beyond the inferior temporal visual cortex related to feeding, learning, and striatal function. Katsuki, Y., Norgren, R., Sato, M., (eds.) Brain mechanisms of sensation, 1981, Wiley, New York, 241–269.
49. Rolls, E.T., Memory, attention, and decision-making. A unifying computational neuroscience approach. 2008, Oxford University Press, Oxford.
50. Rolls, E.T., Advantages of dilution in the connectivity of attractor networks in the brain. Biologically Inspired Cognitive Architectures 1 (2012), 44–54.
51. Rolls, E.T., Emotion and decision-making explained. 2014, Oxford University Press, Oxford.
52. Rolls, E.T., Functions of the anterior insula in taste, autonomic, and related functions. Brain and Cognition, 2015, 10.1016./j.bandc.2015.07.002.
53. Rolls, E.T., Taste, olfactory, and food reward value processing in the brain. Progress in Neurobiology 127–128 (2015), 64–90.
54. Rolls, E.T., Cerebral cortex: Principles of operation. 2016, Oxford University Press, Oxford.
55. Rolls, E.T., A non-reward attractor theory of depression. Neuroscience and Biobehavioral Reviews 68 (2016), 47–58.
56. Rolls, E.T., Reward systems in the brain and nutrition. Annual Review of Nutrition, 36, 2016, 14.
57. Rolls, E.T., Baylis, L.L., Gustatory, olfactory and visual convergence within the primate orbitofrontal cortex. Journal of Neuroscience 14 (1994), 5437–5452.
58. Rolls, E.T., Critchley, H.D., Browning, A.S., Hernadi, A., Lenard, L., Responses to the sensory properties of fat of neurons in the primate orbitofrontal cortex. Journal of Neuroscience 19 (1999), 1532–1540.
59. Rolls, E.T., Critchley, H.D., Mason, R., Wakeman, E.A., Orbitofrontal cortex neurons: Role in olfactory and visual association learning. Journal of Neurophysiology 75 (1996), 1970–1981.
60. Rolls, E.T., Deco, G., Computational neuroscience of vision. 2002, Oxford University Press, Oxford.
61. Rolls, E.T., Deco, G., The noisy Brain: Stochastic dynamics as a principle of brain function. 2010, Oxford University Press, Oxford.
62. Rolls, E.T., Deco, G., Prediction of decisions from noise in the brain before the evidence is provided. Frontiers in Neuroscience, 5, 2011, 33.
63. Rolls, E.T., Deco, G., Networks for memory, perception, and decision-making, and beyond to how the syntax for language might be implemented in the brain. Brain Research 1621 (2015), 316–334.
64. Rolls, E.T., Deco, G., A stochastic neurodynamics approach to the changes in cognition and memory in aging. Neurobiology of Learning and Memory 118 (2015), 150–161.
65. Rolls, E.T., Dempere-Marco, L., Deco, G., Holding multiple items in short term memory: A neural mechanism. Plos One, 8, 2013, e61078.
66. Rolls, E.T., Grabenhorst, F., The orbitofrontal cortex and beyond: From affect to decision-making. Progress in Neurobiology 86 (2008), 216–244.
67. Rolls, E.T., Grabenhorst, F., Deco, G., Decision-making, errors, and confidence in the brain. Journal of Neurophysiology 104 (2010), 2359–2374.
68. Rolls, E.T., Hornak, J., Wade, D., McGrath, J., Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage. Journal of Neurology, Neurosurgery and Psychiatry 57 (1994), 1518–1524.
69. Rolls, E.T., McCabe, C., Redoute, J., Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cerebral Cortex 18 (2008), 652–663.
70. Rolls, E.T., O'Doherty, J., Kringelbach, M.L., Francis, S., Bowtell, R., McGlone, F., Representations of pleasant and painful touch in the human orbitofrontal and cingulate cortices. Cerebral Cortex 13 (2003), 308–317.
71. Rolls, E.T., Sienkiewicz, Z.J., Yaxley, S., Hunger modulates the responses to gustatory stimuli of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. European Journal of Neuroscience 1 (1989), 53–60.
72. Rolls, E.T., Thorpe, S.J., Maddison, S.P., Responses of striatal neurons in the behaving monkey. 1. Head of the caudate nucleus. Behavioural Brain Research 7 (1983), 179–210.
73. Rolls, E.T., Treves, A., Neural networks and brain function. 1998, Oxford University Press, Oxford.
74. Rolls, E.T., Treves, A., The neuronal encoding of information in the brain. Progress in Neurobiology 95 (2011), 448–490.
75. Rolls, E.T., Treves, A., Foster, D., Perez-Vicente, C., Simulation studies of the CA3 hippocampal subfield modelled as an attractor neural network. Neural Networks 10 (1997), 1559–1569.
76. Rolls, E.T., Verhagen, J.V., Kadohisa, M., Representations of the texture of food in the primate orbitofrontal cortex: Neurons responding to viscosity, grittiness, and capsaicin. Journal of Neurophysiology 90 (2003), 3711–3724.
77. Rolls, E.T., Webb, T.J., Deco, G., Communication before coherence. European Journal of Neuroscience 36 (2012), 2689–2709.
78. Rolls, E.T., Williams, G.V., Neuronal activity in the ventral striatum of the primate. Carpenter, M.B., Jayamaran, A., (eds.) The Basal Ganglia II – Structure and function – Current concepts, 1987, Plenum, New York, 349–356.
79. Rolls, E.T., Yaxley, S., Sienkiewicz, Z.J., Gustatory responses of single neurons in the orbitofrontal cortex of the macaque monkey. Journal of Neurophysiology 64 (1990), 1055–1066.
80. Rosenkilde, C.E., Bauer, R.H., Fuster, J.M., Single unit activity in ventral prefrontal cortex in behaving monkeys. Brain Research 209 (1981), 375–394.
81. Rudebeck, P.H., Murray, E.A., Dissociable effects of subtotal lesions within the macaque orbital prefrontal cortex on reward-guided behavior. Journal of Neuroscience 31 (2011), 10569–10578.
82. Rushworth, M.F., Kolling, N., Sallet, J., Mars, R.B., Valuation and decision-making in frontal cortex: One or many serial or parallel systems?. Current Opinion in Neurobiology 22 (2012), 946–955.
83. Schultz, W., Updating dopamine reward signals. Current Opinion in Neurobiology 23 (2013), 229–238.
84. Thorpe, S.J., Maddison, S., Rolls, E.T., Single unit activity in the orbitofrontal cortex of the behaving monkey. Neuroscience Letters, S3, 1979, S77.
85. Thorpe, S.J., Rolls, E.T., Maddison, S., Neuronal activity in the orbitofrontal cortex of the behaving monkey. Experimental Brain Research 49 (1983), 93–115.
86. Treves, A., Mean-field analysis of neuronal spike dynamics. Network 4 (1993), 259–284.
87. Tuckwell, H., Introduction to theoretical neurobiology. 1988, Cambridge University Press, Cambridge.
88. Verhagen, J.V., Rolls, E.T., Kadohisa, M., Neurons in the primate orbitofrontal cortex respond to fat texture independently of viscosity. Journal of Neurophysiology 90 (2003), 1514–1525.
89. Wang, X.J., Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36 (2002), 955–968.
90. Wheeler, E.Z., Fellows, L.K., The human ventromedial frontal lobe is critical for learning from negative feedback. Brain 131 (2008), 1323–1331.
91. Williams, G.V., Rolls, E.T., Leonard, C.M., Stern, C., Neuronal responses in the ventral striatum of the behaving macaque. Behavioural Brain Research 55 (1993), 243–252.
92. Wilson, F.A.W., O'Scalaidhe, S.P., Goldman-Rakic, P., Functional synergism between putative gamma-aminobutyrate-containing neurons and pyramidal neurons in prefrontal cortex. Proceedings of the National Academy of Sciences of the United States of America 91 (1994), 4009–4013.
93. Wise, S.P., Forward frontal fields: Phylogeny and fundamental function. Trends in Neuroscience 31 (2008), 599–608.