Spike-Timing-Dependent Hebbian Plasticity as Temporal Difference Learning

Neural Computation

Volumn 13, Issue 10, 2001, Pages 2221-2237

  Rao, Rajesh P N ^a   Sejnowski, Terrence J ^b,c  

^a University of Washington   (United States)

^b HOWARD HUGHES MEDICAL INSTITUTE   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POTENTIAL; ANIMAL; ARTICLE; BIOLOGICAL MODEL; LEARNING; NEOCORTEX; NERVE CELL PLASTICITY; PHYSIOLOGY; REACTION TIME; SYNAPSE;

ACTION POTENTIALS; ANIMALS; LEARNING; MODELS, NEUROLOGICAL; NEOCORTEX; NEURONAL PLASTICITY; REACTION TIME; SYNAPSES;

EID: 0035489925     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976601750541787     Document Type: Article

References (47)

1. Abbott, L. F., & Blum, K. I. (1996). Functional significance of long-term potentiation for sequence learning and prediction. Cereb. Cortex, 6, 406-416.
2. Abbott, L. F., & Song, S. (1999). Temporally asymmetric Hebbian learning, spike timing and neural response variability. In M. S. Kearns, S. Solla, & D. Cohn (Eds.), Advances in neural information processing systems, 11 (pp. 69-75). Cambridge, MA: MIT Press.
3. Barlow, H. (1998). Cerebral predictions. Perception, 27, 885-888.
4. Ben-Yishai, R., Bar-Or, R. L., & Sompolinsky, H. (1995). Theory of orientation tuning in visual cortex. Proc. Natl. Acad. Sci. U.S.A., 92, 3844-3848.
5. Bi, G. Q., & Poo, M. M. (1998). Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci., 18, 10464-10472.
6. Bliss, T. V., & Collingridge, G. L. (1993). A synaptic model of memory: Long-term potentiation in the hippocampus. Nature, 361, 31-39.
7. Chance, F. S., Nelson, S. B., & Abbott, L. F. (1999). Complex cells as cortically amplified simple cells. Nature Neuroscience, 2, 277-282.
8. Daugman, J. G., & Downing, C. J. (1995). Demodulation, predictive coding, and spatial vision. J. Opt. Soc. Am. A, 12, 641-660.
9. Dayan, P., & Hinton, G. (1996). Varieties of Helmholtz machine. Neural Networks, 9(8), 1385-1403.
10. Destexhe, A., Mainen, Z., & Sejnowski, T. (1998). Kinetic models of synaptic transmission. In C. Koch & I. Segev (Eds.), Methods in neuronal modeling. Cambridge, MA: MIT Press.
11. Douglas, R. J., Koch, C., Mahowald, M., Martin, K. A., & Suarez, H. H. (1995). Recurrent excitation in neocortical circuits. Science, 269, 981-985.
12. Douglas, R. J., Martin, K. A. C., & Whitteridge, D. (1991). An intracellular analysis of the visual responses of neurons in cat visual cortex. J. Physiol., 440, 659-696.
13. Doya, K. (2000). Reinforcement learning in continuous time and space. Neural Computation, 12(1), 219-245.
14. Elman, J. (1990). Finding structure in time. Cognitive Science, 14, 179-211.
15. Emptage, N. J. (1999). Calcium on the up: Supralinear calcium signaling in central neurons. Neuron, 24, 495-497.
16. Feldman, D. (2000). Timing-based LTP and LTD at vertical inputs to layer II/III pyramidal cells in rat barrel cortex. Neuron, 27, 45-56.
17. Franks, K. M., Bartol, T. M., Egelman, D. M., Poo, M. M., & Sejnowski, T. J. (1999). Simulated dendritic influx of calcium ions through voltage-and ligand-gated channels using MCell. Soc. Neurosci. Abstr., 25, 1989.
18. Gerstner, W., Kempter, R., van Hemmen, J. L., & Wagner, H. (1996). A neuronal learning rule for sub-millisecond temporal coding. Nature, 383, 76-81.
19. Jordan, M. (1986). Attractor dynamics and parallelism in a connectionist sequential machine. In Proceedings of the Eighth Annual Conference of the Cognitive Science Society (pp. 531-546). Hillsdale, NJ: Erlbaum.
20. Koch, C. (1999). Biophysics of computation: Information processing in single neurons. New York: Oxford University Press.
21. Koester, H. J., & Sakmann, B. (1998). Calcium dynamics in single spines during coincident pre-and postsynaptic activity depend on relative timing of back-propagating action potentials and subthreshold excitatory postsynaptic potentials. Proc. Natl. Acad. Sci. U.S.A., 95(16), 9596-9601.
22. Levy, W. B., & Steward, O. (1983). Temporal contiguity requirements for long-term associative potentiation/depression in the hippocampus. Neuroscience, 8, 791-797.
23. Linden, D. J. (1999). The return of the spike: Postsynaptic action potentials and the induction of LTP and LTD. Neuron, 22(4), 661-666.
24. Magee, J. C., & Johnston, D. (1997). A synaptically controlled, associative signal for Hebbian plasticity in hippocampal neurons. Science, 275, 209-213.
25. Mainen, Z., & Sejnowski, T. (1996). Influence of dendritic structure on firing pattern in model neocortical neurons. Nature, 382, 363-366.
26. Markram, H., Lubke, J., Frotscher, M., & Sakmann, B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science, 275, 213-215.
27. Mehta, M. R., Barnes, C. A., & McNaughton, B. L. (1997). Experience-dependent, asymmetric expansion of hippocampal place fields. Proc. Natl. Acad. Sci. U.S.A., 94, 8918-8921.
28. Mehta, M. R., & Wilson, M. (2000). From hippocampus to V1: Effect of LTP on spatiotemporal dynamics of receptive fields. Neurocomputing, 32, 905-911.
29. Minai, A. A., & Levy, W. B. (1993). Sequence learning in a single trial. In Proceedings of the 1993 INNS World Congress on Neural Networks II (pp. 505-508). Hillsdale, NJ: Erlbaum.
30. Montague, P. R., & Sejnowski, T. J. (1994). The predictive brain: Temporal coincidence and temporal order in synaptic learning mechanisms. Learning and Memory, 1, 1-33.
31. Paulsen, O., & Sejnowski, T. J. (2000). Natural patterns of activity and long-term synaptic plasticity. Curr. Opin. Neurobiol., 10(2), 172-179.
32. Rao, R. P. N. (1999). An optimal estimation approach to visual perception and learning. Vision Research, 39(11), 1963-1989.
33. Rao, R. P. N., & Ballard, D. H. (1997). Dynamic model of visual recognition predicts neural response properties in the visual cortex. Neural Computation, 9(4), 721-763.
34. Rao, R. P. N., & Ballard, D. H. (1999). Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive field effects. Nature Neuroscience, 2(1), 79-87.
35. Rao, R. P. N., & Sejnowski, T. J. (2000). Predictive sequence learning in recurrent neocortical circuits. In S. A. Solla, T. K. Leen, & K.-R. Muller (Eds.), Advances in neural information processing systems, 12 (pp. 164-170). Cambridge, MA: MIT Press.
36. Roberts, P. D. (1999). Computational consequences of temporally asymmetric learning rules: I. Differential Hebbian learning. J. Computational Neurosci., 7, 235-246.
37. Schiller, J., Schiller, Y., & Clapham, D. E. (1998). NMDA receptors amplify calcium influx into dendritic spines during associative pre-and postsynaptic activation. Nature Neurosci., 1(2), 114-118.
38. Sejnowski, T. J. (1977). Storing covariance with nonlinearly interacting neurons. Journal of Mathematical Biology, 4, 203-211.
39. Sejnowski, T. J. (1999). The book of Hebb. Neuron, 24(4), 773-776.
40. Somers, D. C., Nelson, S. B., & Sur, M. (1995). An emergent model of orientation selectivity in cat visual cortical simple cells. J. Neurosci., 15, 5448-5465.
41. Song, S., Miller, K. D., & Abbott, L. F. (2000). Competitive Hebbian learning through spike-timing dependent synaptic plasticity. Nature Neuroscience, 3, 919-926.
42. Stiles, J. S., Bartol, T. M., Salpeter, M. M., Salpeter, E. E., & Sejnowski, T. J. (2000). Synaptic variability: New insights from reconstructions and Monte Carlo simulations with MCell. In M. Cowan & K. Davies (Eds.), Synapses. Baltimore: Johns Hopkins University Press.
43. Stuart, G. J., & Sakmann, B. (1994). Active propagation of somatic action potentials into neocortical pyramidal cell dendrites. Nature, 367, 69-72.
44. Suarez, H., Koch, C., & Douglas, R. (1995). Modeling direction selectivity of simple cells in striate visual cortex with the framework of the canonical microcircuit. J. Neurosci., 15(10), 6700-6719.
45. Sutton, R. S. (1988). Learning to predict by the method of temporal differences. Machine Learning, 3(1), 9-44.
46. Westerman, W. C., Northmore, D. P. M., & Elias, J. G. (1999). Antidromic spikes drive Hebbian learning in an artificial dendritic tree. Analog Integrated Circuits and Signal Processing, 18, 141-152.
47. Zhang, L. I., Tao, H. W., Holt, C. E., Harris, W. A., & Poo, M. M. (1998). A critical window for cooperation and competition among developing retinotectal synapses. Nature, 395, 37-44.