Intrinsic stabilization of output rates by spike-based Hebbian learning

Neural Computation

Volumn 13, Issue 12, 2001, Pages 2709-2741

  Kempter, Richard ^a   Gerstner, Wulfram ^b   Van Hemmen, J Leo ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b EPFL   (Switzerland)

^c TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POTENTIAL; ANIMAL; ARTICLE; BIOLOGICAL MODEL; LEARNING; NERVE CELL PLASTICITY; PHYSIOLOGY; POISSON DISTRIBUTION; REACTION TIME; STATISTICAL MODEL; SYNAPSE;

ACTION POTENTIALS; ANIMALS; LEARNING; LINEAR MODELS; MODELS, NEUROLOGICAL; NEURONAL PLASTICITY; POISSON DISTRIBUTION; REACTION TIME; SYNAPSES;

EID: 0035653423     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976601317098501     Document Type: Article

References (73)

1. Abbott, L. F., & Blum, K. I. (1996). Functional significance of long-term potentiation for sequence learning and prediction. Cereb. Cortex, 6, 406-416.
2. Abbott, L. F., & Munro, P. (1999). Neural information processing systems (NIPS). Workshop on spike timing and synaptic plasticity, Breckenridge, CO. Available on-line at: http://www.pitt.edu/∼pwm/LTP_LTD_99/.
3. Artola, A., & Singer, W. (1993). Long-term depression of excitatory synaptic transmission and its relationship to long-term potentiation. Trends Neurosci., 16, 480-187.
4. Bell, C. C., Han, V. Z., Sugawara, Y., & Grant, K. (1997). Synaptic plasticity in a cerebellum-like structure depends on temporal order. Nature, 387, 278-281.
5. Bi, G.-q., & Poo, M.-m. (1998). Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci., 18, 10464-10472.
6. Bi, G.-q., & Poo, M.-m. (1999). Distributed synaptic modification in neural networks induced by patterned stimulation. Nature, 401, 792-796.
7. Bi, G.-q., & Poo, M.-m. (2001). Synaptic modification by correlated activity: Hebb's postulate revisited. Annu. Rev. Neurosci., 24, 139-166.
8. Bienenstock, E. L., Cooper, L. N., & Munro, P. W. (1982). Theory for the development of neuron selectivity: Orientation specificity and binocular interaction in visual cortex. J. Neurosci., 2, 32-48.
9. Bliss, T. V. P., & Collingridge, G. L. (1993). A synaptic model of memory: Long-term potentiation in the hippocampus. Nature, 361, 31-39.
10. Brenner, N., Agam, O., Bialek, W., & de Ruyter van Steveninck, R. R. (1998). Universal statistical behavior of neuronal spike trains. Phys. Rev. Lett., 81(18), 4000-4003.
11. Brown, T. H., & Chattarji, S. (1994). Hebbian synaptic plasticity: Evolution of the contemporary concept. In E. Domany, J. L. van Hemmen, & K. Schulten (Eds.), Models of neural networks II (pp. 287-314). New York: Springer-Verlag.
12. Christofi, G., Nowicky, A. V., Bolsover, S. R., & Bindman, L. J. (1993). The postsynaptic induction of nonassociative long-term depression of excitatory synaptic transmission in rat hippocampal slices. J. Neurophysiol., 69, 219-229.
13. Debanne, D., Gähwiler, B. H., & Thompson, S. M. (1998). Long-term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures. J. Physiol., 507, 237-247.
14. Desai, N. S., Rutherford, L. C., & Turrigiano, G. G. (1999). Plasticity in the intrinsic excitability of cortical pyramidal neurons. Nat. Neurosci., 2, 515-520.
15. Egger, V., Feldmeyer, D., & Sakmann, B. (1999). Coincidence detection and changes of synaptic efficacy in spiny stellate neurons in rat barrel cortex. Nat. Neurosci., 2, 1098-1105.
16. Eurich, C. W., Pawelzik, K., Ernst, U., Cowan, J. D., & Milton, J. G. (1999). Dynamics of self-organized delay adaption. Phys. Rev. Lett., 82, 1594-1597.
17. Feldman, D. E. (2000). Timing-based LTP and LTD at vertical inputs to layer II/III pyramidal cells in rat barrel cortex. Neuron, 27, 45-56.
18. Fetz, E. E., & Gustafsson, B. (1983). Relation between shapes of postsynaptic potentials and changes in the firing probability of cat motoneurons. J. Physiol., 341, 387-410.
19. Gerstner, W. (2000). Population dynamics of spiking neurons: Fast transients, asynchronous states and locking. Neural Computation, 12, 43-89.
20. Gerstner, W., & Abbott, L. F. (1997). Learning navigational maps through potentiation and modulation of hippocampal place cells. J. Comput. Neurosci., 4, 79-94.
21. Gerstner, W., & van Hemmen, J. L. (1992). Associative memory in a network of "spiking" neurons. Network, 3, 139-164.
22. Gerstner, W., van Hemmen, J. L., & Cowan, J. D. (1996). What matters in neuronal locking. Neural Comput., 8, 1689-1712.
23. Gerstner, W., Kempter, R., van Hemmen, J. L., & Wagner, H. (1996). A neuronal learning rule for sub-millisecond temporal coding. Nature, 383, 76-78.
24. Gerstner, W., Kempter, R., van Hemmen, J. L., & Wagner, H. (1997). A developmental learning rule for coincidence tuning in the barn owl auditory system. In J. Bower (Ed.), Computational neuroscience: Trends in research 1997 (pp. 665-669). New York: Plenum Press.
25. Gerstner, W., Kempter, R., van Hemmen, J. L., & Wagner, H. (1998). Hebbian learning of pulse timing in the barn owl auditory system. In W. Maass, & C. M. Bishop (Eds.), Pulsed neural networks (pp. 353-377). Cambridge, MA: MIT Press.
26. Gerstner, W., Ritz, R., & van Hemmen, J. L. (1993). Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns. Biol. Cybern., 69, 503-515.
27. Häfliger, P., Mahowald, M., & Watts, L. (1997). A spike based learning neuron in analog VLSI. In M. C. Mozer, M. I. Jordan, & T. Petsche (Eds.), Advances in neural information processing systems, 9 (pp. 692-698). Cambridge, MA: MIT Press.
28. Hebb, D. O. (1949). The organization of behavior. New York: Wiley.
29. Hertz, J., Krogh, A., & Palmer, R. G. (1991). Introduction to the theory of neural computation. Redwood City, CA: Addison-Wesley.
30. Herz, A. V. M., Sulzer, B., Kühn, R., & van Hemmen, J. L. (1988). The Hebb rule: Representation of static and dynamic objects in neural nets. Europhys. Lett., 7, 663-669.
31. Herz, A. V. M., Sulzer, B., Kühn, R., & van Hemmen, J. L. (1989). Hebbian learning reconsidered: Representation of static and dynamic objects in associative neural nets. Biol. Cybern., 60, 457-467.
32. Kempter, R., Gerstner, W., & van Hemmen, J. L. (1999a). Hebbian learning and spiking neurons. Phys. Rev. E, 59, 4498-4514.
33. Kempter, R., Gerstner, W., & van Hemmen, J. L. (1999b). Spike-based compared to rate-based Hebbian learning. In M. S. Kearns, S. A. Solla, & D. A. Cohn (Eds.), Advances in neural information processing systems, 11 (pp. 125-131). Cambridge, MA: MIT Press.
34. Kempter, R., Gerstner, W., van Hemmen, J. L., & Wagner, H. (1996). Temporal coding in the sub-millisecond range: Model of barn owl auditory pathway. In D. S. Touretzky, M. C. Mozer, & M. E. Hasselmo (Eds.), Advances in neural information processing systems, 8 (pp. 124-130). Cambridge, MA: MIT Press.
35. Kempter, R., Gerstner, W., van Hemmen, J. L., & Wagner, H. (1998). Extracting oscillations: Neuronal coincidence detection with noisy periodic spike input. Neural Comput., 10, 1987-2017.
36. Kempter, R., Leibold, C., Wagner, H., & van Hemmen, J. L. (2001). Formation of temporal-feature maps by axonal propagation of synaptic learning. Proc. Natl. Acad. Sci. U.S.A., 98, 4166-4171.
37. Kistler, W. M., & van Hemmen, J. L. (2000). Modeling synaptic plasticity in conjunction with the timing of pre- and postsynaptic action potentials Neural Comput., 12, 385-405.
38. Kohonen, T. (1984). Self-organization and associative memory. Berlin: Springer-Verlag.
39. Levy, W. B., & Stewart, D. (1983). Temporal contiguity requirements for long-term associative potentiation/depression in the hippocampus. Neurosci., 8, 791-797.
40. Linden, D. J. (1999). The return of the spike: Postsynaptic action potentials and the induction of LTP and LTD. Neuron, 22, 661-666.
41. Linsker, R. (1986). From basic network principles to neural architecture: Emergence of spatial-opponent cells. Proc. Natl. Acad. Sci. USA, 83, 7508-7512.
42. MacKay, D. J. C., & Miller, K. D. (1990). Analysis of Linsker's application of Hebbian rules to linear networks. Network, 1, 257-297.
43. Markram, H., Lübke, J., Frotscher, M., & Sakmann, B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science, 275, 213-215.
44. Miller, K. D. (1996a). Receptive fields and maps in the visual cortex: Models of ocular dominance and orientation columns. In E. Domany, J. L. van Hemmen, & K. Schulten (Eds.), Models of neural networks III (pp. 55-78). New York: Springer-Verlag.
45. Miller, K. D. (1996b). Synaptic economics: Competition and cooperation in correlation-based synaptic plasticity. Neuron, 17, 371-374.
46. Miller, K. D., & MacKay, D. J. C. (1994). The role of constraints in Hebbian learning. Neural Comput., 6, 100-126.
47. Oja, E. (1982). A simplified neuron model as a principal component analyzer. J. Math. Biol., 15, 267-273.
48. Paulsen, O., & Sejnowski, T. J. (2000). Natural patterns of activity and long-term synaptic plasticity. Curr. Opin. Neurobiol., 10, 172-179.
49. Plesser, H. E., & Gerstner, W. (2000). Noise in integrate-and-fire models: From stochastic input to escape rates. Neural Computation, 12, 367-384.
50. Pockett, S., Brookes, N. H., & Bindman, L. J. (1990). Long-term depression at synapses in slices of rat hippocampus can be induced by bursts of postsy-naptic activity. Exp. Brain Res., 80, 196-200.
51. Poliakov, A. V., Powers, R. K., Sawczuk, A., & Binder, M. D. (1996). Effects of background noise on the response of rat and cat motoneurons to excitatory current transients. J. Physiol., 495, 143-157.
52. Roberts, P. D. (1999). Computational consequences of temporally asymmetric learning rules: I. Differential Hebbian learning. J. Compu. Neurosci., 7, 235-246.
53. Ruf, B., & Schmitt, M. (1997). Unsupervised learning in networks of spiking neurons using temporal coding. In W. Gerstner, A. Germond, M. Hasler, & J.-D. Nicoud (Eds.), Proc. 7th Int. Conf. Artificial Neural Networks (ICANN'97) (pp. 361-366). Heidelberg: Springer-Verlag.
54. Sejnowski, T. J. (1977). Storing covariance with nonlinearly interacting neurons J. Mathematical Biology, 4, 303-321.
55. Sejnowski, T. J., & Tesauro, G. (1989). The Hebb rule for synaptic plasticity: Algorithms and implementations. In J. H. Byrne, & W. O. Berry (Eds.), Neural models of plasticity: Experimental and theoretical approaches (pp. 94-103). San Diego: Academic Press.
56. Senn, W., Tsodyks, M., & Markram, H. (1997). An algorithm for synaptic modification based on exact timing of pre- and postsynaptic action potentials. In W. Gerstner, A. Germond, M. Hasler, & J.-D. Nicoud (Eds.), Proc. 7 th Int. Conf. Artificial Neural Networks (ICANN'97) (pp. 121-126). Heidelberg: Springer-Verlag.
57. Senn, W., Markram, H., & Tsodyks, M. (2001). An algorithm for modifying neuro-transmitter release probability based on pre- and postsynaptic spike timing. Neural Comput., 13, 35-67.
58. Shouval, H. Z., & Perrone, M. P. (1995). Post-Hebbian learning rules. In M. A. Arbib (Ed.), The handbook of brain theory and neural networks (pp. 745-748). Cambridge, MA: MIT Press.
59. Song, S., Miller, K. D., & Abbott, L. F. (2000). Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat. Neurosci., 3, 919-926.
60. Stanton, P. K., & Sejnowski, T. J. (1989). Associative long-term depression in the hippocampus induced by Hebbian covariance. Nature, 339, 215-218.
61. Stemmler, M., & Koch, C. (1999). How voltage-dependent conductances can adapt to maximize the information encoded by neurons. Nat. Neurosci., 2, 521-527.
62. Turrigiano, G. G. (1999). Homeostatic plasticity in neuronal networks: The more things change, the more they stay the same. Trends Neurosci., 22, 221-227.
63. Turrigiano, G. G., Leslie, K. R., Desai, N. S., Rutherford, L. C., & Nelson, S. B. (1998). Activity-dependent scaling of quantal amplitude in neocortical neurons. Nature, 391, 892-896.
64. Turrigiano, G. G., & Nelson, S. B. (2000). Hebb and homeostasis in neuronal plasticity. Curr. Opin. Neurobiol., 10, 358-364.
65. Urban, N. N., & Barrionuevo, G. (1996). Induction of Hebbian and non-Hebbian mossy fiber long-term potentiation by distinct patterns of high-frequency stimulation. J. Neurosci., 16, 4293-4299.
66. van Hemmen, J. L. (2000). Theory of synaptic plasticity. In F. Moss & S. Gielen (Eds.), Handbook of biological physics, Vol. 4: Neuro-informatics, neural modelling (pp. 749-801). Amsterdam: Elsevier.
67. van Hemmen, J. L., Gerstner, W., Herz, A., Kühn, R., Sulzer, B., & Vaas, M. (1990). Encoding and decoding of patterns which are correlated in space and time. In G. Dorffner (Ed.), Konnektionismus in artificial intelligence und kognitionsforschung (pp. 153-162). Berlin: Springer-Verlag.
68. Volgushev, M., Voronin, L. L., Chistiakova, M., & Singer, W. (1994). Induction of LTP and LTD in visual cortex neurons by intracellular tetanization. NeuroReport, 5, 2069-2072.
69. von der Malsburg, C. (1973). Self-organization of orientation sensitive cells in the striate cortex. Kybernetik, 14, 85-100.
70. Wimbauer, S., Gerstner, W., & van Hemmen, J. L. (1994). Emergence of spatio-temporal receptive fields and its application to motion detection. Biol. Cybern., 72, 81-92
71. Wiskott, L., & Sejnowski, T. (1998). Constrained optimization for neural map formation: A unifying framework for weight growth and normalization. Neural Comput., 10, 671-716.
72. Xie, X., & Seung, S. H. (2000). Spike-based learning rules and stabilization of persistent neural activity. In S. A. Solla, T. K. Leen, & K.-R. Müller (Eds.), Advances in neural information processing systems, 12 (pp. 199-205). Cambridge, MA: MIT Press.
73. Zhang, L. I., Tao, H. W., Holt, C. E., Harris, W. A., & Poo, M.-m. (1998). A critical window for cooperation and competition among developing retinotectal synapses. Nature, 395, 37-44.