Population coding and neural rhythmicity in the orbitofrontal cortex

Annals of the New York Academy of Sciences

Volumn 1239, Issue 1, 2011, Pages 149-161

  Pennartz, Cyriel M A ^a,b   Van Wingerden, Marijn ^a,c   Vinck, Martin ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

^c HEINRICH HEINE UNIVERSITY   (Germany)

Author keywords

Phase locking; Population coding; Probability; Reward; Synchrony; Uncertainty

Indexed keywords

ARTICLE; BRAIN FUNCTION; BRAIN NERVE CELL; COGNITION; NONHUMAN; ORBITAL CORTEX; PYRAMIDAL NERVE CELL;

EID: 83155161085     PISSN: 00778923     EISSN: 17496632     Source Type: Book Series    
DOI: 10.1111/j.1749-6632.2011.06296.x     Document Type: Article

References (126)

1. Baxter, M.G. et al. 2000. Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. J. Neurosci. 20: 4311-4319.
2. Bechara, A. et al. 1997. Deciding advantageously before knowing the advantageous strategy. Science 275: 1293-1295.
3. Schoenbaum, G. et al. 2009. A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat. Rev. Neurosci. 10: 885-892.
4. Tremblay, L. & W. Schultz. 1999. Relative reward preference in primate orbitofrontal cortex. Nature 398: 704-708.
5. Groenewegen, H.J. & H.B. Uylings. 2000. The prefrontal cortex and the integration of sensory, limbic and autonomic information. Prog. Brain Res. 126: 3-28.
6. Salzman, C.D. & S. Fusi. 2010. Emotion, cognition, and mental state representation in amygdala and prefrontal cortex. Annu. Rev. Neurosci. 33: 173-202.
7. Burke, K.A. et al. 2009. Orbitofrontal inactivation impairs reversal of Pavlovian learning by interfering with 'disinhibition' of responding for previously unrewarded cues. Eur. J. Neurosci. 30: 1941-1946.
8. De Bruin, J.P. et al. 2000. Role of the prefrontal cortex of the rat in learning and decision making: effects of transient inactivation. Prog. Brain Res. 126: 103-113.
9. Dias, R., T.W. Robbins & A.C. Roberts. 1996. Dissociation in prefrontal cortex of affective and attentional shifts. Nature 380: 69-72.
10. Pickens, C.L. et al. 2005. Orbitofrontal lesions impair use of cue-outcome associations in a devaluation task. Behav. Neurosci. 119: 317-322.
11. Pickens, C.L. et al. 2003. Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. J. Neurosci. 23: 11078-11084.
12. Stalnaker, T.A. et al. 2007. Basolateral amygdala lesions abolish orbitofrontal-dependent reversal impairments. Neuron 54: 51-58.
13. Walton, M.E. et al. 2010. Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65: 927-939.
14. Chamberlain, S.R. et al. 2005. The neuropsychology of obsessive compulsive disorder: the importance of failures in cognitive and behavioural inhibition as candidate endophenotypic markers. Neurosci. Biobehav. Rev. 29: 399-419.
15. Chudasama, Y., J.D. Kralik & E.A. Murray. 2007. Rhesus monkeys with orbital prefrontal cortex lesions can learn to inhibit prepotent responses in the reversed reward contingency task. Cereb. Cortex. 17: 1154-1159.
16. Fuster, J.M. 2001. The prefrontal cortex-an update: time is of the essence. Neuron 30: 319-333.
17. Man, M.S., H.F. Clarke & A.C. Roberts. 2009. The role of the orbitofrontal cortex and medial striatum in the regulation of prepotent responses to food rewards. Cereb. Cortex. 19: 899-906.
18. Kennerley, S.W. & J.D. Wallis. 2009. Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables. Eur. J. Neurosci. 29: 2061-2073.
19. Padoa-Schioppa, C. 2011. Neurobiology of economic choice: a good-based model. Annu. Rev. Neurosci. 34: 333-359.
20. Padoa-Schioppa, C. & J.A. Assad. 2006. Neurons in the orbitofrontal cortex encode economic value. Nature 441: 223-226.
21. Roesch, M.R., A.R. Taylor & G. Schoenbaum. 2006. Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 51: 509-520.
22. van Duuren, E. et al. 2007. Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task. Learn Mem. 14: 446-456.
23. van Duuren, E., J. Lankelma & C.M.A. Pennartz. 2008. Population coding of reward magnitude in the orbitofrontal cortex of the rat. J. Neurosci. 28: 8590-8603.
24. Hsu, M. et al. 2005. Neural systems responding to degrees of uncertainty in human decision-making. Science 310: 1680-1683.
25. Fries, P. 2005. A mechanism for cognitive dynamics: neuronal communication through neuronal coherence. Trends Cogn. Sci. 9: 474-480.
26. Womelsdorf, T. et al. 2007. Modulation of neuronal interactions through neuronal synchronization. Science 316: 1609-1612.
27. Abbott, L.F. & S.B. Nelson. 2000. Synaptic plasticity: taming the beast. Nat. Neurosci. 3(Suppl): 1178-1183.
28. Paxinos, G. & C. Watson. 2007. The Rat Brain in Stereotaxic Coordinates. Academic Press/Elsevier. Amsterdam, Boston .
29. Lansink, C.S. et al. 2007. A split microdrive for simultaneous multi-electrode recordings from two brain areas in awake small animals. J. Neurosci. Methods 162: 129-138.
30. Wilson, M.A. & B.L. McNaughton. 1993. Dynamics of the hippocampal ensemble code for space. Science 261: 1055-1058.
31. Eichenbaum, H., R.A. Clegg & A. Feeley. 1983. Reexamination of functional subdivisions of the rodent prefrontal cortex. Exp. Neurol. 79: 434-451.
32. Schoenbaum, G., A.A. Chiba & M. Gallagher. 1998. Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat. Neurosci. 1: 155-159.
33. van Duuren, E. et al. 2009. Single-cell and population coding of expected reward probability in the orbitofrontal cortex of the rat. J. Neurosci. 29: 8965-8976.
34. Hollerman, J.R., L. Tremblay & W. Schultz. 2000. Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior. Prog. Brain Res. 126: 193-215.
35. van Duuren, E. et al. 2007. Pharmacological manipulation of neuronal ensemble activity by reverse microdialysis in freely moving rats: a comparative study of the effects of tetrodotoxin, lidocaine, and muscimol. J. Pharmacol. Exp. Ther. 323: 61-69.
36. Zhang, K. et al. 1998. Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. J. Neurophysiol. 79: 1017-1044.
37. Kepecs, A. et al. 2008. Neural correlates, computation and behavioural impact of decision confidence. Nature 455: 227-231.
38. O'Neill, M. & W. Schultz. 2010. Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron 68: 789-800.
39. Carmichael, S.T. & J.L. Price. 1995. Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J. Comp. Neurol. 363: 615-641.
40. Cavada, C. et al. 2000. The anatomical connections of the macaque monkey orbitofrontal cortex. A review. Cereb. Cortex 10: 220-242.
41. Hare, T.A. et al. 2008. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci. 28: 5623-5630.
42. Rolls, E.T., C. McCabe & J. Redoute. 2008. Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cereb. Cortex 18: 652-663.
43. Takahashi, Y.K. et al. 2009. The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes. Neuron 62: 269-280.
44. Rescorla, R.A. & A.R. Wagner. 1972. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In Classical Conditioning II: Current Research and Theory. Black, A.H. & W.F. Prokasy, Eds.: 64-99. Appleton-Century-Crofts. New York .
45. Sul, J.H. et al. 2010. Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron 66: 449-460.
46. Sutton, R.S. & A.G. Barto. 1998. Reinforcement Learning: An Introduction. MIT Press. Cambridge, MA .
47. Pennartz, C.M.A. et al. 2011. The hippocampal-striatal axis in learning, prediction and goal-directed behavior. Trends Neurosci. 34: 548-559.
48. Pennartz, C.M.A. 1997. Reinforcement learning by Hebbian synapses with adaptive thresholds. Neuroscience 81: 303-319.
49. Pennartz, C., B. McNaughton & A.B. Mulder. 2000. The glutamate hypothesis of reinforcement learning. In Cognition, Emotion and Autonomic Responses: The Integrative Role of the Prefrontal Cortex and Limbic Structures. Uylings, H.B. et al ., Eds.: 231-253. Elsevier, Ltd. Amsterdam, the Netherlands .
50. Schroeder, C.E. & P. Lakatos. 2009. Low-frequency neuronal oscillations as instruments of sensory selection. Trends Neurosci. 32: 9-18.
51. DeCoteau, W.E. et al. 2007. Learning-related coordination of striatal and hippocampal theta rhythms during acquisition of a procedural maze task. Proc. Natl. Acad. Sci. USA 104: 5644-5649.
52. Paz, R., E.P. Bauer & D. Paré. 2008. Theta synchronizes the activity of medial prefrontal neurons during learning. Learn Mem. 15: 524-531.
53. Siapas, A.G., E.V. Lubenov & M.A. Wilson. 2005. Prefrontal phase locking to hippocampal theta oscillations. Neuron 46: 141-151.
54. Buzsáki, G. 2006. Rhythms of the Brain. Oxford University Press. Oxford, New York .
55. Pesaran, B., M.J. Nelson & R.A. Andersen. 2008. Free choice activates a decision circuit between frontal and parietal cortex. Nature 453: 406-409.
56. Benchenane, K. et al. 2010. Coherent theta oscillations and reorganization of spike timing in the hippocampal- prefrontal network upon learning. Neuron 66: 921-936.
57. Wang, X.J. 2010. Neurophysiological and computational principles of cortical rhythms in cognition. Physiol. Rev. 90: 1195-1268.
58. Womelsdorf, T. et al. 2010. Theta-activity in anterior cingulate cortex predicts task rules and their adjustments following errors. Proc. Natl. Acad. Sci. USA 107: 5248-5253.
59. Womelsdorf, T. et al. 2010. Selective theta-synchronization of choice-relevant information subserves goal-directed behavior. Front. Hum. Neurosci. 4: 1-13. Article 210.
60. Buzsáki, G. 2005. Theta rhythm of navigation: link between path integration and landmark navigation, episodic and semantic memory. Hippocampus 15: 827-840.
61. Battaglia, F. et al. 2011. The hippocampus: memory hub for communication in brain networks. Trends Cogn. Sci. 15: 310-318.
62. van Wingerden, M. et al. 2010. Theta-band phase locking of orbitofrontal neurons during reward expectancy. J. Neurosci. 30: 7078-7087.
63. Vinck, M. et al. 2011. An improved index of phase-synchronization for electrophysiological data in the presence of volume-conduction, noise and sample-size bias. Neuroimage 55: 1548-1565.
64. Vinck, M. et al. 2010. The pairwise phase consistency: a bias-free measure of rhythmic neuronal synchronization. Neuroimage 51: 112-122.
65. Gutierrez, R., S.A. Simon & M.A. Nicolelis. 2010. Licking-induced synchrony in the taste-reward circuit improves cue discrimination during learning. J. Neurosci. 30: 287-303.
66. Schultz, W., P. Dayan & P.R. Montague. 1997. A neural substrate of prediction and reward. Science 275: 1593-1599.
67. Niv, Y. & G. Schoenbaum. 2008. Dialogues on prediction errors. Trends Cogn. Sci. 12: 265-272.
68. Lansink, C.S. et al. 2009. Hippocampus leads ventral striatum in replay of place-reward information. PLoS Biol. 7: 1-11.
69. Seidenbecher, T. et al. 2003. Amygdalar and hippocampal theta rhythm synchronization during fear memory retrieval. Science 301: 846-850.
70. Lisman, J. 2005. The theta/gamma discrete phase code occuring during the hippocampal phase precession may be a more general brain coding scheme. Hippocampus 15: 913-922.
71. Bi, G.-q. & M.-m. Poo. 1998. Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci. 18: 10464-10472.
72. Cassenaer, S. & G. Laurent. 2007. Hebbian STDP in mushroom bodies facilitates the synchronous flow of olfactory information in locusts. Nature 448: 709-713.
73. Canolty, R.T. et al. 2006. High gamma power is phase-locked to theta oscillations in human neocortex. Science 313: 1626-1628.
74. Tort, A.B. et al. 2008. Dynamic cross-frequency couplings of local field potential oscillations in rat striatum and hippocampus during performance of a T-maze task. Proc. Natl. Acad. Sci. USA 105: 20517-20522.
75. Canolty, R.T. & R.T. Knight. 2010. The functional role of cross-frequency coupling. Trends Cogn. Sci. 14: 506-515.
76. Bauer, M. et al. 2006. Tactile spatial attention enhances gamma-band activity in somatosensory cortex and reduces low-frequency activity in parieto-occipital areas. J. Neurosci. 26: 490-501.
77. Bragin, A. et al. 1995. Gamma (40-100 Hz) oscillation in the hippocampus of the behaving rat. J. Neurosci. 15: 47-60.
78. Brosch, M., E. Budinger & H. Scheich. 2002. Stimulus-related gamma oscillations in primate auditory cortex. J. Neurophysiol. 87: 2715-2725.
79. Cardin, J.A. et al. 2009. Driving fast-spiking cells induces gamma rhythm and controls sensory responses. Nature 459: 663-667.
80. Eeckman, F.H. & W.J. Freeman. 1990. Correlations between unit firing and EEG in the rat olfactory system. Brain Res. 528: 238-244.
81. Fries, P. et al. 2001. Modulation of oscillatory neuronal synchronization by selective visual attention. Science 291: 1560-1563.
82. Gray, C.M. et al. 1989. Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties. Nature 338: 334-337.
83. Kalenscher, T. et al. Reward-associated gamma oscillations in ventral striatum are regionally differentiated and modulate local firing activity. J. Neurophysiol. 103: 1658-1672.
84. Pesaran, B. et al. 2002. Temporal structure in neuronal activity during working memory in macaque parietal cortex. Nat. Neurosci. 5: 805-811.
85. van der Meer, M.A. & A.D. Redish. 2009. Low and high gamma oscillations in rat ventral striatum have distinct relationships to behavior, reward, and spiking activity on a learned spatial decision task. Front. Integr. Neurosci. 3: 1-19. Article 9.
86. Schoffelen, J.M., R. Oostenveld & P. Fries. 2005. Neuronal coherence as a mechanism of effective corticospinal interaction. Science 308: 111-113.
87. Wehr, M. & G. Laurent. 1996. Odour encoding by temporal sequences of firing in oscillating neural assemblies. Nature 384: 162-166.
88. Gregoriou, G.G. et al. 2009. High-frequency, long-range coupling between prefrontal and visual cortex during attention. Science 324: 1207-1210.
89. Womelsdorf, T. et al. 2006. Gamma-band synchronization in visual cortex predicts speed of change detection. Nature 439: 733-736.
90. Hoogenboom, N. et al. 2010. Visually induced gamma-band activity predicts speed of change detection in humans. Neuroimage 51: 1162-1167.
91. Taylor, K. et al. 2005. Coherent oscillatory activity in monkey area v4 predicts successful allocation of attention. Cereb. Cortex 15: 1424-1437.
92. de Almeida, L., M. Idiart & J.E. Lisman. 2009. A second function of gamma frequency oscillations: an E%-max winner-take-all mechanism selects which cells fire. J. Neurosci. 29: 7497-7503.
93. Fries, P., D. Nikolic & W. Singer. 2007. The gamma cycle. Trends Neurosci. 30: 309-316.
94. König, P. et al. 1995. How precise is neuronal synchronization? Neural Comput. 7: 469-485.
95. Rotermund, D. et al. 2009. Attention improves object representation in visual cortical field potentials. J. Neurosci. 29: 10120-10130.
96. Siegel, M., M.R. Warden & E.K. Miller. 2009. Phase-dependent neuronal coding of objects in short-term memory. Proc. Natl. Acad. Sci. USA 106: 21341-21346.
97. Singer, W. 1999. Neuronal synchrony: a versatile code for the definition of relations? Neuron 24: 49-65, 111-125.
98. Vinck, M. et al. 2010. Gamma-phase shifting in awake monkey visual cortex. J. Neurosci. 30: 1250-1257.
99. Gulyás, A.I. et al. 2010. Parvalbumin-containing fast-spiking basket cells generate the field potential oscillations induced by cholinergic receptor activation in the hippocampus. J. Neurosci. 30: 15134-15145.
100. Sohal, V.S. et al. 2009. Parvalbumin neurons and gamma rhythms enhance cortical circuit performance. Nature 459: 698-702.
101. Tiesinga, P. & T.J. Sejnowski. 2009. Cortical enlightenment: are attentional gamma oscillations driven by ING or PING? Neuron 63: 727-732.
102. Whittington, M.A. et al. 2011. Multiple origins of the cortical gamma rhythm. Dev. Neurobiol. 71: 92-106.
103. Bartos, M., I. Vida & P. Jonas. 2007. Synaptic mechanisms of synchronized gamma oscillations in inhibitory interneuron networks. Nat. Rev. Neurosci. 8: 45-56.
104. Cobb, S.R. et al. 1995. Synchronization of neuronal activity in hippocampus by individual GABAergic interneurons. Nature 378: 75-78.
105. Whittington, M.A., R.D. Traub & J.G. Jefferys. 1995. Synchronized oscillations in interneuron networks driven by metabotropic glutamate receptor activation. Nature 373: 612-615.
106. Wulff, P. et al. 2009. Hippocampal theta rhythm and its coupling with gamma oscillations require fast inhibition onto parvalbumin-positive interneurons. Proc. Natl. Acad. Sci. USA 106: 3561-3566.
107. Beshel, J., N. Kopell & L. M. Kay. 2007. Olfactory bulb gamma oscillations are enhanced with task demands. J. Neurosci. 27: 8358-8365.
108. Fries, P. et al. 2001. Rapid feature selective neuronal synchronization through correlated latency shifting. Nat. Neurosci. 4: 194-200.
109. Kay, L.M. 2003. Two species of gamma oscillations in the olfactory bulb: dependence on behavioral state and synaptic interactions. J. Integr. Neurosci. 2: 31-44.
110. van Wingerden, M. et al. 2010. Learning-associated gamma-band phase-locking of action-outcome selective neurons in orbitofrontal cortex. J. Neurosci. 30: 10025-10038.
111. Hoogenboom, N. et al. 2006. Localizing human visual gamma-band activity in frequency, time and space. Neuroimage 29: 764-773.
112. Zhou, Z., M.R. Bernard & A.B. Bonds. 2008. Deconstruction of spatial integrity in visual stimulus detected by modulation of synchronized activity in cat visual cortex. J. Neurosci. 28: 3759-3768.
113. Friedman-Hill, S., P.E. Maldonado & C.M. Gray. 2000. Dynamics of striate cortical activity in the alert macaque: I. Incidence and stimulus-dependence of gamma-band neuronal oscillations. Cereb. Cortex 10: 1105-1116.
114. Henrie, J.A. & R. Shapley. 2005. LFP power spectra in V1 cortex: the graded effect of stimulus contrast. J. Neurophysiol. 94: 479-490.
115. Lima, B. et al. 2010. Synchronization dynamics in response to plaid stimuli in monkey V1. Cereb. Cortex. 20: 1556-1573.
116. Liu, J. & W.T. Newsome. 2006. Local field potential in cortical area MT: stimulus tuning and behavioral correlations. J. Neurosci. 26: 7779-7790.
117. Tukker, J.J. et al. 2007. Cell type-specific tuning of hippocampal interneuron firing during gamma oscillations in vivo. J. Neurosci. 27: 8184-8189.
118. Csicsvari, J. et al. 2003. Mechanisms of gamma oscillations in the hippocampus of the behaving rat. Neuron 37: 311-322.
119. Hasenstaub, A. et al. 2005. Inhibitory postsynaptic potentials carry synchronized frequency information in active cortical networks. Neuron 47: 423-435.
120. Gieselmann, M.A. & A. Thiele. 2008. Comparison of spatial integration and surround suppression characteristics in spiking activity and the local field potential in macaque V1. Eur. J. Neurosci. 28: 447-459.
121. Ray, S. & J.H. Maunsell. 2010. Differences in gamma frequencies across visual cortex restrict their possible use in computation. Neuron 67: 885-896.
122. Siegel, M. & P. König. 2003. A functional gamma-band defined by stimulus-dependent synchronization in area 18 of awake behaving cats. J. Neurosci. 23: 4251-4260.
123. Donoghue, J.P. et al. 1998. Neural discharge and local field potential oscillations in primate motor cortex during voluntary movements. J. Neurophysiol. 79: 159-173.
124. Chalk, M. et al. 2010. Attention reduces stimulus-driven gamma frequency oscillations and spike field coherence in V1. Neuron 66: 114-125.
125. Mitchell, J.F., K.A. Sundberg & J.H. Reynolds. 2009. Spatial attention decorrelates intrinsic activity fluctuations in macaque area V4. Neuron 63: 879-888.
126. Briggs, F. & W.M. Usrey. 2007. Cortical activity influences geniculocortical spike efficacy in the macaque monkey. Front. Integr. Neurosci. 1: 1-5. Article 3.