Dopamine-enabled anti-Hebbian timing-dependent plasticity in prefrontal circuitry

Frontiers in Neural Circuits

Volumn 8, Issue APR, 2014, Pages

  Ruan, Hongyu ^a,b   Saur, Taixiang ^a,b,c   Yao, Wei Dong ^a,b  

^a HARVARD MEDICAL SCHOOL   (United States)

^b BETH ISRAEL DEACONESS MEDICAL CENTER   (United States)

^c MCLEAN HOSPITAL   (United States)

Author keywords

Dopamine; Glutamate; Hebbian; Learning; Reward; STDP

Indexed keywords

CYCLIC AMP; CYCLIC AMP DEPENDENT PROTEIN KINASE; DOPAMINE; DOPAMINE 1 RECEPTOR; DOPAMINE 2 RECEPTOR; N METHYL DEXTRO ASPARTIC ACID RECEPTOR; DOPAMINE RECEPTOR BLOCKING AGENT; DOPAMINE RECEPTOR STIMULATING AGENT; GLUTAMIC ACID; NR2B NMDA RECEPTOR;

ANIMAL TISSUE; ARTICLE; BRAIN FUNCTION; BRAIN SLICE; CONTROLLED STUDY; GABAERGIC TRANSMISSION; HEBBIAN ASSOCIATIVE PLASTICITY; LEARNING; LONG TERM DEPRESSION; LONG TERM POTENTIATION; MOUSE; NERVE CELL NETWORK; NERVE CELL PLASTICITY; NONHUMAN; PREFRONTAL CORTEX; PYRAMIDAL NERVE CELL; RECEPTOR BLOCKING; REWARD; SIGNAL TRANSDUCTION; SPIKE TIMING DEPENDENT PLASTICITY; SYNAPSE; ANIMAL; DRUG EFFECT; HEBBIAN; MALE; METABOLISM; NERVE CELL; PHYSIOLOGY; STDP;

DOPAMINE; GLUTAMATE; HEBBIAN; LEARNING; REWARD; STDP;

ANIMALS; DOPAMINE; DOPAMINE AGONISTS; DOPAMINE ANTAGONISTS; LONG-TERM POTENTIATION; MALE; MICE; NEURONS; PREFRONTAL CORTEX; RECEPTORS, DOPAMINE D1; RECEPTORS, DOPAMINE D2; RECEPTORS, N-METHYL-D-ASPARTATE;

EID: 84899152025     PISSN: 16625110     EISSN: None     Source Type: Journal    
DOI: 10.3389/fncir.2014.00038     Document Type: Article

References (65)

1. Auberson, Y. P., Allgeier, H., Bischoff, S., Lingenhoehl, K., Moretti, R., and Schmutz, M. (2002). 5-Phosphonomethylquinoxalinediones as competitive NMDA receptor antagonists with a preference for the human 1A/2A, rather than 1A/2B receptor composition. Bioorg. Med. Chem. Lett. 12, 1099-1102. doi: 10.1016/S0960-894X(02)00074-4
2. Baras, D., and Meir, R. (2007). Reinforcement learning, spike-time-dependent plasticity, and the BCM rule. Neural Comput. 19, 2245-2279. doi: 10.1162/neco.2007.19.8.2245
3. Berberich, S., Punnakkal, P., Jensen, V., Pawlak, V., Seeburg, P. H., Hvalby, O., et al. (2005). Lack of NMDA receptor subtype selectivity for hippocampal long-term potentiation. J. Neurosci. 25, 6907-6910. doi: 10.1523/JNEUROSCI.1905-05.2005
4. Bi, G. Q., and Poo, M. M. (1998). Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci. 18, 10464-10472.
5. Bi, G. Q., and Poo, M. M. (2001). Synaptic modification by correlated activity: Hebb's postulate revisited. Annu. Rev. Neurosci. 24, 139-166. doi: 10.1146/annurev.neuro.24.1.139
6. Bissiere, S., Humeau, Y., and Luthi, A. (2003). Dopamine gates LTP induction in lateral amygdala by suppressing feedforward inhibition. Nat. Neurosci. 6, 587-592. doi: 10.1038/nn1058
7. Bliss, T., and Schoepfer, R. (2004). Neuroscience. Controlling the ups and downs of synaptic strength. Science 304, 973-974. doi: 10.1126/science.1098805
8. Caporale, N., and Dan, Y. (2008). Spike timing-dependent plasticity: a Hebbian learning rule. Annu. Rev. Neurosci.31, 25-46. doi: 10.1146/annurev.neuro.31.060407.125639
9. Cassenaer, S., and Laurent, G. (2012). Conditional modulation of spike-timing-dependent plasticity for olfactory learning. Nature 482, 47-52. doi: 10.1038/nature10776
10. Chen, N., Luo, T., and Raymond, L. A. (1999). Subtype-dependence of NMDA receptor channel open probability. J. Neurosci. 19, 6844-6854.
11. Chiu, C. Q., Puente, N., Grandes, P., and Castillo, P. E. (2010). Dopaminergic modulation of endocannabinoid-mediated plasticity at GABAergic synapses in the prefrontal cortex. J. Neurosci. 30, 7236-7248. doi: 10.1523/JNEUROSCI.0736-10.2010
12. Clarke, R. J., and Johnson, J. W. (2006). NMDA receptor NR2 subunit dependence of the slow component of magnesium unblock. J. Neurosci. 26, 5825-5834. doi: 10.1523/JNEUROSCI.0577-06.2006
13. Couey, J. J., Meredith, R. M., Spijker, S., Poorthuis, R. B., Smit, A. B., Brussaard, A. B., et al. (2007). Distributed network actions by nicotine increase the threshold for spike-timing-dependent plasticity in prefrontal cortex. Neuron 54, 73-87. doi: 10.1016/j.neuron.2007.03.006
14. Cull-Candy, S. G., and Leszkiewicz, D. N. (2004). Role of distinct NMDA receptor subtypes at central synapses. Sci. STKE 2004, re16.
15. Dan, Y., and Poo, M. M. (2006). Spike timing-dependent plasticity: from synapse to perception. Physiol. Rev. 86, 1033-1048. doi: 10.1152/physrev.00030.2005
16. Davies, C. H., Starkey, S. J., Pozza, M. F., and Collingridge, G. L. (1991). GABA autoreceptors regulate the induction of LTP. Nature 349, 609-611. doi: 10.1038/349609a0
17. Feldman, D. E. (2012). The spike-timing dependence of plasticity. Neuron 75, 556-571. doi: 10.1016/j.neuron.2012.08.001
18. Fino, E., Deniau, J. M., and Venance, L. (2008). Cell-specific spike-timing-dependent plasticity in GABAergic and cholinergic interneurons in corticostriatal rat brain slices. J. Physiol. 586, 265-282. doi: 10.1113/jphysiol.2007.144501
19. Fino, E., Glowinski, J., and Venance, L. (2005). Bidirectional activity-dependent plasticity at corticostriatal synapses. J. Neurosci. 25, 11279-11287. doi: 10.1523/JNEUROSCI.4476-05.2005
20. Florian, R. V. (2007). Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity. Neural Comput. 19, 1468-1502. doi: 10.1162/neco.2007.19.6.1468
21. Fremaux, N., Sprekeler, H., and Gerstner, W. (2010). Functional requirements for reward-modulated spike-timing-dependent plasticity. J. Neurosci. 30, 13326-13337. doi: 10.1523/JNEUROSCI.6249-09.2010
22. Fuster, J. M. (2008). The Prefrontal Cortex. New York: Academic Press.
23. Ganguly, K., and Poo, M. M. (2013). Activity-dependent neural plasticity from bench to bedside. Neuron 80, 729-741. doi: 10.1016/j.neuron.2013.10.028
24. Gerkin, R. C., Lau, P. M., Nauen, D. W., Wang, Y. T., and Bi, G. Q. (2007). Modular competition driven by NMDA receptor subtypes in spike-timing-dependent plasticity. J. Neurophysiol. 97, 2851-2862. doi: 10.1152/jn.00860.2006
25. Greengard, P., Allen, P. B., and Nairn, A. C. (1999). Beyond the dopamine receptor: the DARPP-32/protein phosphatase-1 cascade. Neuron 23, 435-447. doi: 10.1016/S0896-6273(00)80798-9
26. Han, V. Z., Grant, K., and Bell, C. C. (2000). Reversible associative depression and nonassociative potentiation at a parallel fiber synapse. Neuron 27, 611-622. doi: 10.1016/S0896-6273(00)00070-2
27. Hebb, D. O. (1949). The Organization of Behavior. New York: Wiley.
28. Izhikevich, E. M. (2007). Solving the distal reward problem through linkage of STDP and dopamine signaling. Cereb. Cortex 17, 2443-2452. doi: 10.1093/cercor/bhl152
29. Johnston, D., Hoffman, D. A., Colbert, C. M., and Magee, J. C. (1999). Regulation of back-propagating action potentials in hippocampal neurons. Curr. Opin. Neurobiol. 9, 288-292. doi: 10.1016/S0959-4388(99)80042-7
30. Lamsa, K. P., Heeroma, J. H., Somogyi, P., Rusakov, D. A., and Kullmann, D. M. (2007). Anti-Hebbian long-term potentiation in the hippocampal feedback inhibitory circuit. Science 315, 1262-1266. doi: 10.1126/science.1137450
31. Lau, C. G., and Zukin, R. S. (2007). NMDA receptor trafficking in synaptic plasticity and neuropsychiatric disorders. Nat. Rev. Neurosci. 8, 413-426. doi: 10.1038/nrn2153
32. Letzkus, J. J., Kampa, B. M., and Stuart, G. J. (2006). Learning rules for spike timing-dependent plasticity depend on dendritic synapse location. J. Neurosci. 26, 10420-10429. doi: 10.1523/JNEUROSCI.2650-06.2006
33. Lin, Y. W., Min, M. Y., Chiu, T. H., and Yang, H. W. (2003). Enhancement of associative long-term potentiation by activation of beta-adrenergic receptors at CA1 synapses in rat hippocampal slices. J. Neurosci. 23, 4173-4181.
34. Liu, L., Wong, T. P., Pozza, M. F., Lingenhoehl, K., Wang, Y., Sheng, M., et al. (2004). Role of NMDA receptor subtypes in governing the direction of hippocampal synaptic plasticity. Science 304, 1021-1024. doi: 10.1126/science.1096615
35. Liu, Q. S., Pu, L., and Poo, M. M. (2005). Repeated cocaine exposure in vivo facilitates LTP induction in midbrain dopamine neurons. Nature 437, 1027-1031. doi: 10.1038/nature04050
36. Lu, J. T., Li, C. Y., Zhao, J. P., Poo, M. M., and Zhang, X. H. (2007). Spike-timing-dependent plasticity of neocortical excitatory synapses on inhibitory interneurons depends on target cell type. J. Neurosci. 27, 9711-9720. doi: 10.1523/JNEUROSCI.2513-07.2007
37. Magee, J. C., and Johnston, D. (1997). A synaptically controlled, associative signal for Hebbian plasticity in hippocampal neurons. Science 275, 209-213. doi: 10.1126/science.275.5297.209
38. Malenka, R. C., and Bear, M. F. (2004). LTP and LTD: an embarrassment of riches. Neuron 44, 5-21. doi: 10.1016/j.neuron.2004.09.012
39. Markram, H., Lubke, J., Frotscher, M., and Sakmann, B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275, 213-215. doi: 10.1126/science.275.5297.213
40. Massey, P. V., Johnson, B. E., Moult, P. R., Auberson, Y. P., Brown, M. W., Molnar, E., et al. (2004). Differential roles of NR2A and NR2B-containing NMDA receptors in cortical long-term potentiation and long-term depression.J. Neurosci. 24, 7821-7828. doi: 10.1523/JNEUROSCI.1697-04.2004
41. Meredith, R. M., Floyer-Lea, A. M., and Paulsen, O. (2003). Maturation of long-term potentiation induction rules in rodent hippocampus: role of GABAergic inhibition. J. Neurosci. 23, 11142-11146.
42. Morishita, W., Connor, J. H., Xia, H., Quinlan, E. M., Shenolikar, S., and Malenka, R. C. (2001). Regulation of synaptic strength by protein phosphatase 1. Neuron 32, 1133-1148. doi: 10.1016/S0896-6273(01)00554-2
43. Morishita, W., Lu, W., Smith, G. B., Nicoll, R. A., Bear, M. F., and Malenka, R. C. (2007). Activation of NR2B-containing NMDA receptors is not required for NMDA receptor-dependent long-term depression. Neuropharmacology 52, 71-76. doi: 10.1016/j.neuropharm.2006.07.005
44. Mrzljak, L., Bergson, C., Pappy, M., Huff, R., Levenson, R., and Goldman-Rakic, P. S. (1996). Localization of dopamine D4 receptors in GABAergic neurons of the primate brain. Nature 381, 245-248. doi: 10.1038/381245a0
45. Mulkey, R. M., Endo, S., Shenolikar, S., and Malenka, R. C. (1994). Involvement of a calcineurin/inhibitor-1 phosphatase cascade in hippocampal long-term depression. Nature 369, 486-488. doi: 10.1038/369486a0
46. Paille, V., Fino, E., Du, K., Morera-Herreras, T., Perez, S., Kotaleski, J. H., et al. (2013). GABAergic circuits control spike-timing-dependent plasticity. J. Neurosci. 33, 9353-9363. doi: 10.1523/JNEUROSCI.5796-12.2013
47. Pawlak, V., and Kerr, J. N. (2008). Dopamine receptor activation is required for corticostriatal spike-timing-dependent plasticity. J. Neurosci. 28, 2435-2446. doi: 10.1523/JNEUROSCI.4402-07.2008
48. Pawlak, V., Wickens, J. R., Kirkwood, A., and Kerr, J. N. (2010). Timing is not everything: neuromodulation opens the STDP gate. Front. Synaptic Neurosci. 2:146. doi: 10.3389/fnsyn.2010.00146
49. Riccio, A., and Ginty, D. D. (2002). What a privilege to reside at the synapse: NMDA receptor signaling to CREB. Nat. Neurosci. 5, 389-390. doi: 10.1038/nn0502-389
50. Safo, P. K., and Regehr, W. G. (2005). Endocannabinoids control the induction of cerebellar LTD. Neuron 48, 647-659. doi: 10.1016/j.neuron.2005.09.020
51. Schultz, W. (2002). Getting formal with dopamine and reward. Neuron 36, 241-263. doi: 10.1016/S0896-6273(02)00967-4
52. Seamans, J. K., Durstewitz, D., Christie, B. R., Stevens, C. F., and Sejnowski, T. J. (2001). Dopamine D1/D5 receptor modulation of excitatory synaptic inputs to layer V prefrontal cortex neurons. Proc. Natl. Acad. Sci. U.S.A. 98, 301-306. doi: 10.1073/pnas.98.1.301
53. Seamans, J. K., and Yang, C. R. (2004). The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog. Neurobiol. 74, 1-58. doi: 10.1016/j.pneurobio.2004.05.006
54. Seol, G. H., Ziburkus, J., Huang, S., Song, L., Kim, I. T., Takamiya, K., et al. (2007). Neuromodulators control the polarity of spike-timing-dependent synaptic plasticity. Neuron 55, 919-929. doi: 10.1016/j.neuron.2007.08.013
55. Shen, W., Flajolet, M., Greengard, P., and Surmeier, D. J. (2008). Dichotomous dopaminergic control of striatal synaptic plasticity. Science 321, 848-851. doi: 10.1126/science.1160575
56. Tully, K., Li, Y., Tsvetkov, E., and Bolshakov, V. Y. (2007). Norepinephrine enables the induction of associative long-term potentiation at thalamo-amygdala synapses. Proc. Natl. Acad. Sci. U.S.A. 104, 14146-14150. doi: 10.1073/pnas.0704621104
57. Varela, J. A., Hirsch, S. J., Chapman, D., Leverich, L. S., and Greene, R. W. (2009). D1/D5 modulation of synaptic NMDA receptor currents. J. Neurosci. 29, 3109-3119. doi: 10.1523/JNEUROSCI.4746-08.2009
58. Wang, H., Stradtman, G. G. III, Wang, X. J., and Gao, W. J. (2008). A specialized NMDA receptor function in layer 5 recurrent microcircuitry of the adult rat prefrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 105, 16791-16796. doi: 10.1073/pnas.0804318105
59. Weitlauf, C., Honse, Y., Auberson, Y. P., Mishina, M., Lovinger, D. M., and Winder, D. G. (2005). Activation of NR2A-containing NMDA receptors is not obligatory for NMDA receptor-dependent long-term potentiation. J. Neurosci. 25, 8386-8390. doi: 10.1523/JNEUROSCI.2388-05.2005
60. Wigstrom, H., and Gustafsson, B. (1983). Facilitated induction of hippocampal long-lasting potentiation during blockade of inhibition. Nature 301, 603-604. doi: 10.1038/301603a0
61. Wise, R. A. (2004). Dopamine, learning and motivation. Nat. Rev. Neurosci. 5, 483-494. doi: 10.1038/nrn1406
62. Xu, T. X., and Yao, W. D. (2010). D1 and D2 dopamine receptors in separate circuits cooperate to drive associative long-term potentiation in the prefrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 107, 16366-16371. doi: 10.1073/pnas.1004108107
63. Xu, T. X., Sotnikova, T. D., Liang, C., Zhang, J., Jung, J. U., Spealman, R. D., et al. (2009). Hyperdopaminergic tone erodes prefrontal long-term potential via a D2 receptor-operated protein phosphatase gate. J. Neurosci. 29, 14086-14099. doi: 10.1523/JNEUROSCI.0974-09.2009
64. Zhang, J. C., Lau, P. M., and Bi, G. Q. (2009). Gain in sensitivity and loss in temporal contrast of STDP by dopaminergic modulation at hippocampal synapses. Proc. Natl. Acad. Sci. U.S.A. 106, 13028-13033. doi: 10.1073/pnas.0900546106
65. Zhao, M. G., Toyoda, H., Lee, Y. S., Wu, L. J., Ko, S. W., Zhang, X. H., et al. (2005). Roles of NMDA NR2B subtype receptor in prefrontal long-term potentiation and contextual fear memory. Neuron 47, 859-872. doi: 10.1016/j.neuron.2005.08.014