Synaptic and spiking dynamics underlying reward reversal in the orbitofrontal cortex

Cerebral Cortex

Volumn 15, Issue 1, 2005, Pages 15-30

  Deco, Gustavo ^a   Rolls, Edmund T ^b  

^a UNIVERSITAT POMPEU FABRA   (Spain)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Attention; Computational neuroscience; Emotion; Orbitofrontal cortex; Reversal learning set; Reward reversal; Working memory

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; BEHAVIOR; COGNITION; EMOTIONALITY; LEARNING; NERVE CELL NETWORK; NONHUMAN; ORBITAL CORTEX; PRIORITY JOURNAL; PUNISHMENT; REINFORCEMENT; REWARD; STIMULUS RESPONSE; WORKING MEMORY;

ACTION POTENTIALS; ANIMALS; CONDITIONING (PSYCHOLOGY); DISCRIMINATION LEARNING; MACACA; MODELS, NEUROLOGICAL; NEURONS; PATTERN RECOGNITION, VISUAL; PREFRONTAL CORTEX; REWARD; SYNAPSES; TASTE;

EID: 11144307494     PISSN: 10473211     EISSN: None     Source Type: Journal    
DOI: 10.1093/cercor/bhh103     Document Type: Article

References (77)

1. Abbott LF, Nelson SB (2000) Synaptic plasticity: taming the beast. Nat Neurosci 3:1178-1183.
2. Abeles A (1991) Corticonics. New York: Cambridge University Press.
3. Amit D, Brunel N (1997) Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cereb Cortex 7:237-252.
4. Asaad WF, Rainer G, Miller EK (1998) Neural activity in the primate prefrontal cortex during associative learning. Neuron 21:1399-1407.
5. Asaad WF, Rainer G, Miller EK (2000) Task-specific neural activity in the primate prefrontal cortex. J Neurophysiol 84:451-459.
6. Battaglia F, Treves A (1998) Stable and rapid recurrent processing in realistic autoassociative memories. Neural Computat 10:431-450.
7. Brunel N, Wang X (2001) Effects of neuromodulation in a cortical networks model of object working memory dominated by recurrent inhibition. J Computat Neurosci 11:63-85.
8. Chelazzi L (1998) Serial attention mechanisms in visual search: a critical look at the evidence. Psychol Res 62:195-219.
9. Chelazzi L, Miller E, Duncan J, Desimone R (1993) A neural basis for visual search in inferior temporal cortex. Nature 363:345-347.
10. Cools R, Clark L, Owen AM, Robbins TW (2002) Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging. J Neurosci 22:4563-4567.
11. Corchs S, Deco G (2002) Large-scale neural model for visual attention: integration of experimental single cell and fMRI data. Cereb Cortex 12:339-348.
12. Critchley HD, Rolls ET (1996) Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. J Neurophysiol 75:1673-1686.
13. Damasio AR (1994) Descartes' error. New York: Putnam.
14. Dayan P, Abbott LF (2002) Theoretical neuroscience. Cambridge, MA: MIT Press.
15. Deco G, Lee T (2002) A unified model of spatial and object attention based on inter-cortical biased competition. Neurocomputing 44-46:775-781.
16. Deco G, Rolls ET (2003) Attention and working memory: a dynamical model of neuronal activity in the prefrontal cortex. Eur J Neurosci 18:2374-2390.
17. Deco G, Zihl J (2001) Top-down selective visual attention: a neurodynamical approach. Vis Cogn 8:119-140.
18. Deco G, Rolls ET, Horwitz B (2004) 'What' and 'where' in visual working memory: a computational neurodynamical perspective for integrating fMRI and single-neuron data. J Cogn Neurosci 16:683-701.
19. Dehaene S, Changeaux JP (1991) The Wisconsin card sorting test: theoretical analysis and modelling in a neural network. Cereb Cortex 1:62-79.
20. Del Giudice P, Fusi S, Mattia M (2003) Modelling the formation of working memory with networks of integrate-and-fire neurons connected by plastic synapses. J Physiol Paris 97:659-681.
21. Destexhe A, Mainen Z, Sejnowski T (1998) Kinetic models of synaptic transmission. In: Methods in neural modelling: from ions to networks, 2nd edn (Koch C, Segev I, eds), pp. 1-25. Cambridge, MA: MIT Press.
22. Divac I, Rosvold HE, Szwarcbart MK (1967) Behavioural effects of selective ablation of the caudate nucleus. J Comp Physiol Psychol 63:184-190.
23. Frank M, Loughry B, O'Reilly R (2001) Interactions between frontal cortex and basal ganglia in working memory: a computational model. Cogn Affect Behav Neurosci 1:137-160.
24. Giugliano M, La Camera G, Rauch A, Luescher H-R, Fusi S (2002) Nonmonotonic current-to-rate response function in a novel integrate-and-fire model neuron. In: Proceedings of ICANN 2002, LNCS 2415 (Dorronsoro J, ed.), pp. 141-146. New York: Springer.
25. Hansel D, Mato G, Meunier C, Neltner L (1998) On numerical simulations of integrate-and-fire neural networks. Neural Computat 10:467-483.
26. Hestrin S, Sah P, Nicoll R (1990) Mechanisms generating the time course of dual component excitatory synaptic currents recorded in hippocampal slices. Neuron 5:247-253.
27. Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Nat Acad Sci USA 79:2554-2558.
28. Hornak J, Bramham J, Rolls ET, Morris RG, O'Doherty J, Bullock PR, Polkey CE (2003) Changes in emotion after circumscribed surgical lesions of the orbitofrontal and cingulate cortices. Brain 126:1691-1712.
29. Hornak J, O'Doherty J, Bramham J, Rolls ET, Morris RG, Bullock PR, Polkey CE (2004) Reward-related reversal learning after surgical excisions in orbitofrontal and dorsolateral prefrontal cortex in humans. J Cogn Neurosci 16:463-478.
30. Iversen S D, Mishkin M (1970) Perseverative interference in monkey following selective lesions of the inferior prefrontal convexity. Exp Brain Res 11:376-386.
31. Jahr C, Stevens C (1990) Voltage dependence of NMDA-activated macroscopic condunctances predicted by single-channel kinetics. J Neurosci 10:3178-3182.
32. Kringelbach ML, Rolls ET (2003) Neural correlates of rapid reversal learning in a simple model of human social interaction. Neuroimage 20:1371-1383.
33. Law-Tho D, Hirsch J, Crepel F (1994) Dopamine modulation of synaptic transmission in rat prefrontal cortex: an in vitro electrophysiological study. Neurosci Res 21:151-160.
34. Lisman JE, Fellous JM, Wang XJ (1998) A role for NMDA-receptor channels in working memory. Nat Neurosci 1:273-275.
35. Liu Y, Wang X-J (2001) Spike-frequency adaptation of a generalized leaky integrate-and-fire model neuron. J Computat Neurosci 10:25-45.
36. McCormick D, Connors B, Lighthall J, Prince D (1985) Comparative electrophysiology of pyramidal and sparsely spiny stellate neurons in the neocortex. J Neurophysiol 54:782-806.
37. Miller EK, Cohen JD (2001) An integrative theory of prefrontal functions. Annu Rev Neurosci 24:167-202.
38. Miller E, Gochin P, Gross C (1993) Suppression of visual responses of neurons in inferior temporal cortex of the awake macaque by addition of a second stimulus. Brain Res 616:25-29.
39. Milner B (1964) Some effects of frontal lobectomy in man. In: The frontal granular cortex and behavior (Warren JM, Akert K, eds), pp. 313-314. New York; McGraw-Hill.
40. Mishkin M, Manning FJ (1978) Non-spatial memory after selective prefrontal lesions in monkeys. Brain Res 143:313-324.
41. Moran J, Desimone R (1985) Selective attention gates visual processing in the extrastriate cortex. Science 229:782-784.
42. Motter B (1993) Focal attention produces spatially selective processing in visual cortical areas V1, V2 and V4 in the presence of competing stimuli. J Neurophysiol 70:909-919.
43. Nauta WJ (1971) The problem of the frontal lobe: a reinterpretation. J Psychiatry Res 8:167-187.
44. O'Reilly J, Munakata Y (2000) Computational explorations in cognitive neuroscience. Cambridge, MA: MIT Press.
45. O'Reilly RC, Noelle DC, Braver TS, Cohen JD (2002) Prefrontal cortex and dynamic categorization tasks: representational organization and neuromodulatory control. Cereb Cortex 12:246-257.
46. Rauch A, La Camera G, Luescher H-R, Senn W, Fusi S (2003) Neocortical pyramidal cells respond as integrate-and-fire neurons in in vivo-like input currents. J Neurophysiol 90:1598-1612.
47. Reynolds J, Desimone R (1999) The role of neural mechanisms of attention in solving the binding problem. Neuron 24:19-29.
48. Rolls ET (1974) The neural basis of brain-stimulation reward. Prog Neurobiol 3:71-160.
49. Rolls ET (1975) The brain and reward. Oxford: Pergamon Press.
50. Rolls ET (1990) A theory of emotion and its application to understanding the neural basis of emotion. Cogn Emotion 4:161-190.
51. Rolls ET (1997) Taste and olfactory processing in the brain and its relation to the control of eating. Crit Rev Neurobiol 11:263-287.
52. Rolls ET (1999) The brain and emotion. Oxford: Oxford University Press.
53. Rolls ET (2000a) Neurophysiology and functions of the primate amygdala and the neural basis of emotion. In: The amygdala: a functional analysis, 2nd edn (Aggleton, J ed.), pp. 447-478. Oxford: Oxford University Press.
54. Rolls ET (2000b) The orbitofrontal cortex and reward. Cereb Cortex 10:284-294.
55. Rolls ET (2000c) Précis of The Brain and Emotion. Behav Brain Sci 23:177-233.
56. Rolls ET (2004a) The functions of the orbitofrontal cortex. Brain Cogn 55:11-29.
57. Rolls ET (2004b) What are emotions, why do we have them and what are their brain mechanisms. In: Who needs emotion: the brain meets the machine (Fellous M, Arbib M, eds). New York: Oxford University Press (in press).
58. Rolls ET, Deco G (2002) Computational neuroscience of vision. Oxford: Oxford University Press.
59. Rolls ET, Treves A (1998) Neural networks and brain function. Oxford: Oxford University Press.
60. Rolls ET, Thorpe SJ, Maddison SP (1983) Responses of striatal neurons in the behaving monkey 1 head of the caudate nucleus. Behav Brain Res 7:179-210.
61. Rolls ET, Yaxley S, Sienkiewicz ZJ (1990) Gustatory responses of single neurons in the orbitofrontal cortex of the macaque monkey. J Neurophysiol 64:1055-1066.
62. Rolls ET, Hornak J, Wade D, McGrath J (1994) Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage. J Neurol Neurosurg Psychiatry 57:1518-1524.
63. Rolls ET, Critchley HD, Mason R, Wakeman EA (1996) Orbitofrontal cortex neurons: role in olfactory and visual association learning. J Neurophysiol 75:1970-1981.
64. Rougier N, O'Reilly R (2002) Learning representations in a gated prefrontal cortex model of dynamic task switching. Cogn Sci 26:503-520.
65. Salin P, Prince D (1996) Spontaneous GABA-A receptor mediated inhibitory currents in adult rat somatosensory cortex. J Neurophysiol 75:1573-1588.
66. Schoenbaum G, Setlow B (2003) Lesions of nucleus accumbens disrupt learning about aversive outcomes. J Neurosci 23:9833-9841.
67. Schoenbaum G, Chiba AA, Gallagher M (1999) Neural encoding in orbitofrontal cortex and basolateral amygdala during olfactory discrimination learning. J Neurosci 19:1876-1884.
68. Setlow B, Schoenbaum G, Gallagher M (2003) Neural encoding in ventral striatum during olfactory discrimination learning. Neuron 38:625-636.
69. Spitzer H, Desimone R, Moran J (1988) Increased attention enhances both behavioral and neuronal performance. Science 240:338-340.
70. Spruston N, Jonas P, Sakmann B (1995) Dendritic glutamate receptor channel in rat hippocampal CA3 and CA1 pyramidal neurons. J Physiol 482:325-352.
71. Sutton RS, Barto AG (1998) Reinforcement learning. Cambridge, MA: MIT Press.
72. Thorpe SJ, Rolls ET, Maddison S (1983) Neuronal activity in the orbitofrontal cortex of the behaving monkey. Exp Brain Res 49:93-115.
73. Tuckwell H (1988) Introduction to theoretical neurobiology. Cambridge: Cambridge University Press.
74. Wang X (1999) Synaptic basis of cortical persistent activity: the importance of NMDA receptors to working memory. J Neurosci 19:9587-9603.
75. Wilson FAW, O'Scalaidhe SP, Goldman-Rakic P (1994) Functional synergism between putative gamma-aminobutyrate-containing neurons and pyramidal neurons in prefrontal cortex. Proc Natl Acad Sci USA 91:4009-4013.
76. Xiang Z, Huguenard J, Prince D (1998) GABA-A receptor mediated currents in interneurons and pyramidal cells of rat visual cortex. J Physiol 506:715-730.
77. Zheng P, Zhang X-X, Bunney BS, Shi W-X (1999) Opposite modulation of cortical N-methyl-D-aspartate receptor-mediated responses by low and high concentrations of dopamine. Neuroscience 91:527-535.