NMDA Receptors Control Cue-Outcome Selectivity and Plasticity of Orbitofrontal Firing Patterns during Associative Stimulus-Reward Learning

Neuron

Volumn 76, Issue 4, 2012, Pages 813-825

  van Wingerden, Marijn ^a,c   Vinck, Martin ^a   Tijms, Vincent ^b   Ferreira, Irene R S ^d   Jonker, Allert J ^e   Pennartz, Cyriel M A ^a,b  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

^c HEINRICH HEINE UNIVERSITY   (Germany)

^d MAX PLANCK INSTITUTE OF NEUROBIOLOGY   (Germany)

^e VU UNIVERSITY MEDICAL CENTER   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

N METHYL DEXTRO ASPARTIC ACID RECEPTOR; N METHYL DEXTRO ASPARTIC ACID RECEPTOR BLOCKING AGENT;

ANIMAL BEHAVIOR; ANIMAL CELL; ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION; CONTROLLED STUDY; CORTICAL SYNCHRONIZATION; DECISION MAKING; ELECTRIC POTENTIAL; LEARNING; MALE; NERVE CELL EXCITABILITY; NERVE CELL MEMBRANE POTENTIAL; NERVE CELL NETWORK; NERVE CELL PLASTICITY; NERVE CONDUCTION; NONHUMAN; ORBITAL CORTEX; PRIORITY JOURNAL; PROTEIN FUNCTION; RAT; REWARD; SPIKE; TASK PERFORMANCE;

ACTION POTENTIALS; ANESTHETICS, LOCAL; ANIMALS; ASSOCIATION LEARNING; BEHAVIOR, ANIMAL; CHOICE BEHAVIOR; CONDITIONING, OPERANT; CUES; DISCRIMINANT ANALYSIS; DOSE-RESPONSE RELATIONSHIP, DRUG; EXCITATORY AMINO ACID AGENTS; LIDOCAINE; MALE; NEURONAL PLASTICITY; NEURONS; ODORS; PREFRONTAL CORTEX; RATS; RATS, WISTAR; REACTION TIME; RECEPTORS, N-METHYL-D-ASPARTATE; REWARD; ROC CURVE; SPECTRUM ANALYSIS; STATISTICS, NONPARAMETRIC; TRITIUM; VALINE;

EID: 84869837037     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2012.09.039     Document Type: Article

References (93)

1. Baldwin A.E., Holahan M.R., Sadeghian K., Kelley A.E. N-methyl-D-aspartate receptor-dependent plasticity within a distributed corticostriatal network mediates appetitive instrumental learning. Behav. Neurosci. 2000, 114:84-98.
2. Battaglia F.P., Benchenane K., Sirota A., Pennartz C.M., Wiener S.I. The hippocampus: hub of brain network communication for memory. Trends Cogn. Sci. 2011, 15:310-318.
3. Baxter M.G., Parker A., Lindner C.C., Izquierdo A.D., Murray E.A. Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. J. Neurosci. 2000, 20:4311-4319.
4. Bi G.Q., Poo M.M. Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci. 1998, 18:10464-10472.
5. Bohn I., Giertler C., Hauber W. Orbital prefrontal cortex and guidance of instrumental behaviour in rats under reversal conditions. Behav. Brain Res. 2003, 143:49-56.
6. Bohn I., Giertler C., Hauber W. NMDA receptors in the rat orbital prefrontal cortex are involved in guidance of instrumental behaviour under reversal conditions. Cereb. Cortex 2003, 13:968-976.
7. Bullmore E.T., Suckling J., Overmeyer S., Rabe-Hesketh S., Taylor E., Brammer M.J. Global, voxel, and cluster tests, by theory and permutation, for a difference between two groups of structural MR images of the brain. IEEE Trans. Med. Imaging 1999, 18:32-42.
8. Buzsáki G. Theta oscillations in the hippocampus. Neuron 2002, 33:325-340.
9. Buzsáki G. Neural syntax: cell assemblies, synapsembles, and readers. Neuron 2010, 68:362-385.
10. Cassenaer S., Laurent G. Hebbian STDP in mushroom bodies facilitates the synchronous flow of olfactory information in locusts. Nature 2007, 448:709-713.
11. Chernick M.R. Bootstrap Methods: A Guide for Practitioners and Researchers 2008, Wiley-Interscience, Hoboken, NJ. Second Edition.
12. Colino A., Malenka R.C. Mechanisms underlying induction of long-term potentiation in rat medial and lateral perforant paths in vitro. J. Neurophysiol. 1993, 69:1150-1159.
13. Cummings J.A., Mulkey R.M., Nicoll R.A., Malenka R.C. Ca2+ signaling requirements for long-term depression in the hippocampus. Neuron 1996, 16:825-833.
14. Davies J., Francis A.A., Jones A.W., Watkins J.C. 2-Amino-5-phosphonovalerate (2APV), a potent and selective antagonist of amino acid-induced and synaptic excitation. Neurosci. Lett. 1981, 21:77-81.
15. De Bruin J.P., Feenstra M.G., Broersen L.M., Van Leeuwen M., Arens C., De Vries S., Joosten R.N. Role of the prefrontal cortex of the rat in learning and decision making: effects of transient inactivation. Prog. Brain Res. 2000, 126:103-113.
16. Dean H.L., Hagan M.A., Pesaran B. Only coherent spiking in posterior parietal cortex coordinates looking and reaching. Neuron 2012, 73:829-841.
17. Durstewitz D., Seamans J.K., Sejnowski T.J. Neurocomputational models of working memory. Nat. Neurosci. 2000, 3(Suppl):1184-1191.
18. Ekstrom A.D., Meltzer J., McNaughton B.L., Barnes C.A. NMDA receptor antagonism blocks experience-dependent expansion of hippocampal " place fields" Neuron 2001, 31:631-638.
19. Fries P. A mechanism for cognitive dynamics: neuronal communication through neuronal coherence. Trends Cogn. Sci. 2005, 9:474-480.
20. Fries P. Neuronal gamma-band synchronization as a fundamental process in cortical computation. Annu. Rev. Neurosci. 2009, 32:209-224.
21. Gilmour G., Dix S., Fellini L., Gastambide F., Plath N., Steckler T., Talpos J., Tricklebank M. NMDA receptors, cognition and schizophrenia-testing the validity of the NMDA receptor hypofunction hypothesis. Neuropharmacology 2012, 62:1401-1412.
22. Goosens K.A., Maren S. NMDA receptors are essential for the acquisition, but not expression, of conditional fear and associative spike firing in the lateral amygdala. Eur. J. Neurosci. 2004, 20:537-548.
23. Green D.M., Swets J.A. Signal Detection Theory and Psychophysics 1966, Wiley, New York.
24. Groenewegen H.J., Uylings H.B. The prefrontal cortex and the integration of sensory, limbic and autonomic information. Prog. Brain Res. 2000, 126:3-28.
25. Herron C.E., Lester R.A., Coan E.J., Collingridge G.L. Frequency-dependent involvement of NMDA receptors in the hippocampus: a novel synaptic mechanism. Nature 1986, 322:265-268.
26. Hikosaka K., Watanabe M. Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. Cereb. Cortex 2000, 10:263-271.
27. Histed M.H., Pasupathy A., Miller E.K. Learning substrates in the primate prefrontal cortex and striatum: sustained activity related to successful actions. Neuron 2009, 63:244-253.
28. Homayoun H., Moghaddam B. NMDA receptor hypofunction produces opposite effects on prefrontal cortex interneurons and pyramidal neurons. J. Neurosci. 2007, 27:11496-11500.
29. Homayoun H., Moghaddam B. Orbitofrontal cortex neurons as a common target for classic and glutamatergic antipsychotic drugs. Proc. Natl. Acad. Sci. USA 2008, 105:18041-18046.
30. Hoover W.B., Vertes R.P. Projections of the medial orbital and ventral orbital cortex in the rat. J. Comp. Neurol. 2011, 519:3766-3801.
31. Hunt M.J., Falinska M., Łeski S., Wójcik D.K., Kasicki S. Differential effects produced by ketamine on oscillatory activity recorded in the rat hippocampus, dorsal striatum and nucleus accumbens. J. Psychopharmacol. (Oxford) 2011, 25:808-821.
32. Jackson M.E., Homayoun H., Moghaddam B. NMDA receptor hypofunction produces concomitant firing rate potentiation and burst activity reduction in the prefrontal cortex. Proc. Natl. Acad. Sci. USA 2004, 101:8467-8472.
33. Jensen O., Lisman J.E. Theta/gamma networks with slow NMDA channels learn sequences and encode episodic memory: role of NMDA channels in recall. Learn. Mem. 1996, 3:264-278.
34. Kentros C., Hargreaves E., Hawkins R.D., Kandel E.R., Shapiro M., Muller R.V. Abolition of long-term stability of new hippocampal place cell maps by NMDA receptor blockade. Science 1998, 280:2121-2126.
35. Krystal J.H., D'Souza D.C., Mathalon D., Perry E., Belger A., Hoffman R. NMDA receptor antagonist effects, cortical glutamatergic function, and schizophrenia: toward a paradigm shift in medication development. Psychopharmacology (Berl.) 2003, 169:215-233.
36. Lahti A.C., Weiler M.A., Tamara Michaelidis B.A., Parwani A., Tamminga C.A. Effects of ketamine in normal and schizophrenic volunteers. Neuropsychopharmacology 2001, 25:455-467.
37. Lee H.K., Kameyama K., Huganir R.L., Bear M.F. NMDA induces long-term synaptic depression and dephosphorylation of the GluR1 subunit of AMPA receptors in hippocampus. Neuron 1998, 21:1151-1162.
38. Lewis D.A., Moghaddam B. Cognitive dysfunction in schizophrenia: convergence of gamma-aminobutyric acid and glutamate alterations. Arch. Neurol. 2006, 63:1372-1376.
39. Li X.F., Phillips R., LeDoux J.E. NMDA and non-NMDA receptors contribute to synaptic transmission between the medial geniculate body and the lateral nucleus of the amygdala. Exp. Brain Res. 1995, 105:87-100.
40. Lisman J.E., Fellous J.M., Wang X.J. A role for NMDA-receptor channels in working memory. Nat. Neurosci. 1998, 1:273-275.
41. Lisman J.E., Coyle J.T., Green R.W., Javitt D.C., Benes F.M., Heckers S., Grace A.A. Circuit-based framework for understanding neurotransmitter and risk gene interactions in schizophrenia. Trends Neurosci. 2008, 31:234-242.
42. Lynall M.E., Bassett D.S., Kerwin R., McKenna P.J., Kitzbichler M., Muller U., Bullmore E. Functional connectivity and brain networks in schizophrenia. J. Neurosci. 2010, 30:9477-9487.
43. Ma J., Leung L.S. The supramammillo-septal-hippocampal pathway mediates sensorimotor gating impairment and hyperlocomotion induced by MK-801 and ketamine in rats. Psychopharmacology (Berl.) 2007, 191:961-974.
44. Malenka R.C., Nicoll R.A. Long-term potentiation-a decade of progress?. Science 1999, 285:1870-1874.
45. Malhotra A.K., Pinals D.A., Adler C.M., Elman I., Clifton A., Pickar D., Breier A. Ketamine-induced exacerbation of psychotic symptoms and cognitive impairment in neuroleptic-free schizophrenics. Neuropsychopharmacology 1997, 17:141-150.
46. Maris E., Schoffelen J.M., Fries P. Nonparametric statistical testing of coherence differences. J. Neurosci. Methods 2007, 163:161-175.
47. McHugh T.J., Jones M.W., Quinn J.J., Balthasar N., Coppari R., Elmquist J.K., Lowell B.B., Fanselow M.S., Wilson M.A., Tonegawa S. Dentate gyrus NMDA receptors mediate rapid pattern separation in the hippocampal network. Science 2007, 317:94-99.
48. McHugh S.B., Niewoehner B., Rawlins J.N., Bannerman D.M. Dorsal hippocampal N-methyl-D-aspartate receptors underlie spatial working memory performance during non-matching to place testing on the T-maze. Behav. Brain Res. 2008, 186:41-47.
49. Middleton S., Jalics J., Kispersky T., Lebeau F.E., Roopun A.K., Kopell N.J., Whittington M.A., Cunningham M.O. NMDA receptor-dependent switching between different gamma rhythm-generating microcircuits in entorhinal cortex. Proc. Natl. Acad. Sci. USA 2008, 105:18572-18577.
50. Morris R.G., Anderson E., Lynch G.S., Baudry M. Selective impairment of learning and blockade of long-term potentiation by an N-methyl-D-aspartate receptor antagonist, AP5. Nature 1986, 319:774-776.
51. Mulder A.B., Nordquist R.E., Orgüt O., Pennartz C.M. Learning-related changes in response patterns of prefrontal neurons during instrumental conditioning. Behav. Brain Res. 2003, 146:77-88.
52. O'Neill M., Schultz W. Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron 2010, 68:789-800.
53. Olney J.W., Labruyere J., Price M.T. Pathological changes induced in cerebrocortical neurons by phencyclidine and related drugs. Science 1989, 244:1360-1362.
54. Olney J.W., Newcomer J.W., Farber N.B. NMDA receptor hypofunction model of schizophrenia. J. Psychiatr. Res. 1999, 33:523-533.
55. Padoa-Schioppa C., Assad J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 2006, 441:223-226.
56. Paxinos G., Watson C. The Rat Brain in Stereotaxic Coordinates 2007, Academic Press/Elsevier, Amsterdam. Sixth Edition.
57. Pennartz C.M., van Wingerden M., Vinck M. Population coding and neural rhythmicity in the orbitofrontal cortex. Ann. N Y Acad. Sci. 2011, 1239:149-161.
58. Pennartz C.M.A., Ito R., Verschure P.F.M.J., Battaglia F.P., Robbins T.W. The hippocampal-striatal axis in learning, prediction and goal-directed behavior. Trends Neurosci. 2011, 34:548-559.
59. Pinault D. N-methyl d-aspartate receptor antagonists ketamine and MK-801 induce wake-related aberrant gamma oscillations in the rat neocortex. Biol. Psychiatry 2008, 63:730-735.
60. Platt M.L., Glimcher P.W. Neural correlates of decision variables in parietal cortex. Nature 1999, 400:233-238.
61. Rolls E.T., Hornak J., Wade D., McGrath J. Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage. J. Neurol. Neurosurg. Psychiatry 1994, 57:1518-1524.
62. Roopun A.K., Cunningham M.O., Racca C., Alter K., Traub R.D., Whittington M.A. Region-specific changes in gamma and beta2 rhythms in NMDA receptor dysfunction models of schizophrenia. Schizophr. Bull. 2008, 34:962-973.
63. Rotaru D.C., Yoshino H., Lewis D.A., Ermentrout G.B., Gonzalez-Burgos G. Glutamate receptor subtypes mediating synaptic activation of prefrontal cortex neurons: relevance for schizophrenia. J. Neurosci. 2011, 31:142-156.
64. Schoenbaum G., Chiba A.A., Gallagher M. Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat. Neurosci. 1998, 1:155-159.
65. Schoenbaum G., Chiba A.A., Gallagher M. Neural encoding in orbitofrontal cortex and basolateral amygdala during olfactory discrimination learning. J. Neurosci. 1999, 19:1876-1884.
66. Schoenbaum G.C.A., Nugent S.L., Saddoris M.P., Setlow B. Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations. Neuroreport 2002, 13:885-890.
67. Schoenbaum G., Setlow B., Nugent S.L., Saddoris M.P., Gallagher M. Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. Learn. Mem. 2003, 10:129-140.
68. Schoenbaum G., Setlow B., Saddoris M.P., Gallagher M. Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala. Neuron 2003, 39:855-867.
69. Schoenbaum G., Saddoris M.P., Stalnaker T.A. Reconciling the roles of orbitofrontal cortex in reversal learning and the encoding of outcome expectancies. Ann. N Y Acad. Sci. 2007, 1121:320-335.
70. Schoenbaum G., Roesch M.R., Stalnaker T.A., Takahashi Y.K. A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat. Rev. Neurosci. 2009, 10:885-892.
71. Seamans J.K., Nogueira L., Lavin A. Synaptic basis of persistent activity in prefrontal cortex in vivo and in organotypic cultures. Cereb. Cortex 2003, 13:1242-1250.
72. Selig D.K., Hjelmstad G.O., Herron C., Nicoll R.A., Malenka R.C. Independent mechanisms for long-term depression of AMPA and NMDA responses. Neuron 1995, 15:417-426.
73. Singer W. Neuronal synchrony: a versatile code for the definition of relations?. Neuron 1999, 24:49-65. 111-125.
74. Stalnaker T.A., Roesch M.R., Franz T.M., Burke K.A., Schoenbaum G. Abnormal associative encoding in orbitofrontal neurons in cocaine-experienced rats during decision-making. Eur. J. Neurosci. 2006, 24:2643-2653.
75. Stephan K.E., Friston K.J., Frith C.D. Dysconnection in schizophrenia: from abnormal synaptic plasticity to failures of self-monitoring. Schizophr. Bull. 2009, 35:509-527.
76. Sugrue L.P., Corrado G.S., Newsome W.T. Choosing the greater of two goods: neural currencies for valuation and decision making. Nat. Rev. Neurosci. 2005, 6:363-375.
77. Tremblay L., Schultz W. Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. J. Neurophysiol. 2000, 83:1864-1876.
78. Tremblay L., Schultz W. Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. J. Neurophysiol. 2000, 83:1877-1885.
79. Uhlhaas P.J., Haenschel C., Nikolić D., Singer W. The role of oscillations and synchrony in cortical networks and their putative relevance for the pathophysiology of schizophrenia. Schizophr. Bull. 2008, 34:927-943.
80. van Duuren E., Escámez F.A., Joosten R.N., Visser R., Mulder A.B., Pennartz C.M. Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task. Learn. Mem. 2007, 14:446-456.
81. van Duuren E., van der Plasse G., van der Blom R., Joosten R.N., Mulder A.B., Pennartz C.M., Feenstra M.G. Pharmacological manipulation of neuronal ensemble activity by reverse microdialysis in freely moving rats: a comparative study of the effects of tetrodotoxin, lidocaine, and muscimol. J. Pharmacol. Exp. Ther. 2007, 323:61-69.
82. van Duuren E., Lankelma J., Pennartz C.M.A. Population coding of reward magnitude in the orbitofrontal cortex of the rat. J. Neurosci. 2008, 28:8590-8603.
83. van Wingerden M., Vinck M., Lankelma J., Pennartz C.M. Theta-band phase locking of orbitofrontal neurons during reward expectancy. J. Neurosci. 2010, 30:7078-7087.
84. van Wingerden M., Vinck M., Lankelma J.V., Pennartz C.M. Learning-associated gamma-band phase-locking of action-outcome selective neurons in orbitofrontal cortex. J. Neurosci. 2010, 30:10025-10038.
85. Vinck M., van Wingerden M., Womelsdorf T., Fries P., Pennartz C.M. The pairwise phase consistency: a bias-free measure of rhythmic neuronal synchronization. Neuroimage 2010, 51:112-122.
86. Vinck M., Battaglia F.P., Womelsdorf T., Pennartz C. Improved measures of phase-coupling between spikes and the local field potential. J. Comput. Neurosci. 2012, 33:53-75.
87. Wallis J.D., Miller E.K. Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. Eur. J. Neurosci. 2003, 18:2069-2081.
88. Walton M.E., Behrens T.E., Buckley M.J., Rudebeck P.H., Rushworth M.F. Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 2010, 65:927-939.
89. Wang X.J. Synaptic basis of cortical persistent activity: the importance of NMDA receptors to working memory. J. Neurosci. 1999, 19:9587-9603.
90. Wang X.J. Probabilistic decision making by slow reverberation in cortical circuits. Neuron 2002, 36:955-968.
91. Wang H., Stradtman G.G., Wang X.J., Gao W.J. A specialized NMDA receptor function in layer 5 recurrent microcircuitry of the adult rat prefrontal cortex. Proc. Natl. Acad. Sci. USA 2008, 105:16791-16796.
92. Womelsdorf T., Lima B., Vinck M., Oostenveld R., Singer W., Neuenschwander S., Fries P. Orientation selectivity and noise correlation in awake monkey area V1 are modulated by the γ cycle. Proc. Natl. Acad. Sci. USA 2012, 109:4302-4307.
93. Wong K.F., Wang X.J. A recurrent network mechanism of time integration in perceptual decisions. J. Neurosci. 2006, 26:1314-1328.