Chapter 18 Theory of synaptic plasticity

Handbook of Biological Physics

Volumn 4, Issue C, 2001, Pages 771-823

  van Hemmen, J L ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77956716120     PISSN: 13838121     EISSN: None     Source Type: Book Series    
DOI: 10.1016/S1383-8121(01)80021-X     Document Type: Article

References (105)

1. Sherrington, C.S. (1897) in: Textbook of Physiology, ed M. Foster. p. 60.
2. Shepherd, G.M. and Erulkar, S.D., Centenary of the synapse: from Sherrington to the molecular biology of the synapse and beyond. Trends Neurosci. 20, 385-392.
3. In: Shepherd G.M. (Ed). The Synaptic Organization of the Brain. 4th Edn. (1998), Oxford University Press, New York
4. Koch C. Biophysics of Computation: Information Processing in Single Neurons (1999), Oxford University Press, New York
5. In: Abbott L., and Sejnowski T.J. (Eds). Neural Codes and Distributed Representations (1999), MIT Press, Cambridge, MA
6. Sejnowski T.J. Storing covariance with nonlinearly interacting neurons. J. Math. Biol. 4 (1977) 303-321
7. Sejnowski T.J. Statistical constraints on synaptic plasticity. J. Theor. Biol. 69 (1977) 385-389
8. Jessell T.M., and Kandel E.R. Synaptic transmission: a bidirectional and self-modifiable form of cell-cell communication. Neuron 10 Suppl. (1993) 1-30
9. In: Faber D.S., Korn H., Redman S.J., Thompson S.M., and Altman J.S. (Eds). Central Synapses: Quantal Mechanisms and Plasticity (1998), HFSP, Strasbourg
10. Braitenberg V., and Schütz A. Anatomy of the Cortex (1991), Springer, Berlin
11. Ramón y Cajal S. Histologie du Système Nerveux de l'Homme et des Vertébrés (1911), Maloine, Paris. This is L. Azoulay's definitive French translation of the Spanish original. There is meanwhile also an English translation by N. & L.W. Swanson (Oxford University Press, 1995), based on the French one.
12. appeared with Wiley, New York. Lamperti J. Probability. a 2nd Edn. (1966-1996), Benjamin, New York
13. appeared with SIAM, Philadelphia, PA (1996). Lamperti and Breiman are both classics, the latter being much more advanced. Breiman L. Probability. 2nd Edn. (1968), Addison-Wesley, Reading, MA
14. Levitan I.B., and Kaczmarek L.K. The Neuron: Cell and Molecular Biology. 2nd Edn. (1997), Oxford University Press, Oxford
15. see, in particular, Ch. 14 on neurotransmitter release. Kandel E.R., Schwartz J.H., and Jessell T.M. Principles of Neural Science. 4th Edn. (2000), McGraw-Hill, New York
16. In: Faber D.S., and Korn H. (Eds). Neurobiology of the Mauthner Cell (1978), Raven Press, New York
17. Korn H., and Faber D.S. Escape behavior-brainstem and spinal cord circuitry and function. Curr. Opinion Neurobiol. 6 (1996) 826-832
18. and references quoted therein. Kruk P.J., Korn H., and Faber D.S. The effects of geometrical parameters on synaptic transmission: a Monte Carlo simulation study. Biophys. J. 73 (1997) 2874-2890
19. Bonhoeffer, T., private communication. Engert F., and Bonhoeffer T. Dendritic spine changes associated with hippocampal long-term synaptic plasticity. Nature 399 (1999) 66-70
20. Press W.H., Flannery B.P., Teukolsky S.A., and Vetterling W.T. Numerical Recipes (1986), Cambridge University Press. There are numerous editions, also for different programming languages
21. White J.A., Rubinstein J.T., and Kay A.R. Channel noise in neurons. Trends Neurosci. 23 (2000) 131-137
22. Stuart G., Spruston N., Sakmann B., and Häusser M. Action potential initiation and backpropagation in neurons of the mammalian CNS. Trends Neurosci. 20 (1997) 125-131
23. Hille B. Ionic Channels of Excitable Membranes. 2nd Edn. (1992), Sinauer, Sunderland, MA
24. Keener J., and Sneyd J. Mathematical Physiology (1998), Springer, New York
25. Cronin J. Mathematical Aspects of Hodgkin-Huxley Neural Theory (1987), Cambridge University Press, Cambridge
26. Gerstner W., and van Hemmen J.L. Associative memory in a network of 'spiking' neurons. Network: Comput. Neural Syst. 3 (1992) 139-164
27. Kistler W., Gerstner W., and van Hemmen J.L. Reduction of the Hodgkin-Huxley equations to a single-variable threshold model. Neural Comput. 9 (1997) 1015-1045
28. Chapter 12 in this book. Gerstner W. A Framework for Spiking Neuron Models: The Spike Response Model (2000)
29. Hebb D.O. The Organization of Behavior (1949), Wiley, New York
30. Orbach J. the Neuropsychological Theories of Lashley and Hebb (1998), University Press of America, Lanham, MD. This book gives a fascinating account of the indirect interaction between Hebb and K.S. Lashley, his thesis advisor.
31. Herz A.V.M., Sulzer B., Kühn R., and van Hemmen J.L. The Hebb rule: storing static and dynamic objects in an associative neural network. Europhys. Lett. 7 (1988) 663-669
32. Herz A.V.M., Sulzer B., Kühn R., and van Hemmen J.L. Hebbian learning reconsidered: Representation of static and dynamic objects in associative neural nets. Biol. Cybern. 60 (1989) 457-467
33. Van Hemmen J.L., Gerstner W., Herz A.V.M., Kühn R., and Vaas M. Encoding and decoding of patterns which are correlated in space and time. In: Dorffner G. (Ed). Konnektionismus in Artificial Intelligence und Kognitionsforschung (1990), Springer, Berlin 153-162
34. Hopfield J.J. Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. USA. 79 (1982) 2554-2558
35. Amit D.J., Gutfreund H., and Sompolinsky H. Storing infinite numbers of patterns in a spin-glass model of neural networks. Phys. Rev. Lett. 55 (1985) 1530-1533
36. Amit D.J., Gutfreund H., and Sompolinsky H. Statistical mechanics of neural networks near saturation. Ann. Phys. (NY) 173 (1987) 30-67
37. Van Hemmen J.L., and Kühn R. Collective phenomena in neural networks. In: Domany E., van Hemmen J.L., and Schulten K. (Eds). Models of Neural Networks I. 2nd Edn. (1991-1995), Springer, Berlin 1-113
38. Kühn R., and van Hemmen J.L. Temporal association. in: Models of Neural Networks I. 2nd Edn. In: Domany E., van Hemmen J.L., and Schulten K. (Eds) (1991-1995), Springer, Berlin 221-288
39. Hobson J.A., and McCarley R.W. The brain as a dream state generator: an activation-synthesis hypothesis of the dream process. Am. J. Psychiatry 134 (1977) 1335-1348
40. Crick F., and Mitchison G. The function of dream sleep. Nature 304 (1983) 111-114
41. Hopfield J.J., Feinstein D.I., and Palmer R.G. 'Unlearning' has a stabilizing effect in collective memories. Nature 304 (1983) 158-159
42. Van Hemmen J.L. hebbian learning its correlation catastrophe, and unlearning. Network: Comput. Neural Syst. 8 (1997) V1-V17
43. Van Hemmen J.L. Hebbian learning its correlation catastrophe, and unlearning. Network: Comput. Neural Syst. 9 (1998) 153
44. Gerstner W., Ritz R., and van Hemmen J.L. Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns. Biol. Cybern. 69 (1993) 503-515
45. Ritz R., Gerstner W., Fuentes U., and van Hemmen J.L. A biologically motivated and analytically soluble model of collective oscillations in the cortex: II. Application to binding and pattern segmentation. Biol. Cybern 71 (1994) 349-358
46. Carr C.E., and Konishi M. A circuit for detection of interaural time differences in the brain stem of the barn owl. J. Neurosci. 10 (1990) 3227-3246
47. Gerstner W., Kempter R., van Hemmen J.L., and Wagner H. A neuronal learning rule for sub-millisecond temporal coding. Nature 383 (1996) 76-78
48. Kempter R., Gerstner W., van Hemmen J.L., and Wagner H. Extracting oscillations: Neuronal coincidence detection with noisy periodic spike input. Neural Comput. 10 (1998) 1987-2017
49. Several considerations in Sections 4 and 5 stem from this paper. Kempter R., Gerstner W., and van Hemmen J.L. Hebbian learning and spiking neurons. Phys. Rev. E 59 (1999) 4498-4514
50. Markram H., Lübke J., Frotscher M., and Sakmann B. Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275 (1997) 213-215
51. Heerema M., and van Leeuwen W.A. Derivation of Hebb's rule. J. Phys. A: Math. Gen. 32 (1999) 263-286
52. Konishi M. Listening with two ears. Sci. Am. 268 4 (1993) 34-41
53. Buonomano D.V., and Merzenich M.M. Cortical plasticity: from synapses to maps. Annu. Rev. Neurosci. 21 (1998) 149-186
54. Fitzsimonds R.M., and Poo M.-M. Retrograde signaling in the development and modification of synapses. Physiol. Rev. 78 (1998) 143-170
55. Urban N.N., and Barrionuevo G. Induction of Hebbian and non-Hebbian mossy fiber long-term potentiation by distinct patterns of high-frequency stimulation. J. Neurosci. 16 (1996) 4293-4299
56. Christofi G., Nowicky A.V., Bolsover S.R., and Bindman L.J. The postsynaptic induction of nonassociative long-term depression of excitatory synaptic transmission in rat hippocampal slices. J. Neurophysiol. 69 (1993) 219-229
57. Zhang L.I., Tao H.W., Holt C.E., Harris W.A., and Poo M.-m. A critical window for cooperation and competition among developing retinotectal synapses. Nature 395 (1998) 37-44
58. Bi G.-Q., and Poo M.-M. Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci. 18 (1998) 10464-10472
59. Debanne D., Gähwiler B.H., and Thompson S.M. Long-term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures. J. Physiol. 507 (1998) 237-247
60. Bi G.-Q., and Poo M.-M. Distributed synaptic modification in neural networks induced by patterned stimulation. Nature 401 (1999) 792-796
61. Linden D.J. The return of the spike: postsynaptic action potentials and the induction of LTP and LTD. Neuron 22 (1999) 661-666. This is a nice review of the neurobiology underlying the present theory of time-resolved Hebbian learning
62. Caillard O., Ben-Ari Y., and Gaiarsa J.-L. Mechanisms of Induction and Expression of Long-Term Depression at GABAergic Synapses in the Neonatal Rat Hippocampus. J. Neurosci. 19 (1999) 7568-7577
63. Sanders J.A., and Verhulst F. Averaging Methods in Nonlinear Dynamical Systems (1985), Springer, New York
64. Chapter 11 presents an excellent introduction to the method of averaging. Verhulst F. Nonlinear Differential Equations and Dynamical Systems. 2nd Edn. (1996), Springer, Berlin
65. Kistler W.M., and van Hemmen J.L. Modeling synaptic plasticity in conjunction with the timing of pre- and postsynaptic action potentials. Neural Comput. 12 (2000) 385-405
66. Preprint TUM, Garching. Leibold C., Kempter R., and van Hemmen J.L. How synapses of spiking neurons learn a temporal-feature map (2000)
67. Markram H., and Tsodyks M. Redistribution of synaptic efficacy between neocortical pyramidal neurons. Nature 382 (1996) 807-810
68. Tsodyks M., and Markram H. The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. Proc. Natl. Acad. Sci. USA 94 (1997) 719-723
69. Abbott L.F., Varela J.A., Sen K., and Nelson S.B. Synaptic depression and cortical gain control. Science 275 (1997) 220-224
70. Varela J.A., Sen K., Gibson J., Fost J., Abbott L.F., and Nelson S.B. A quantitative description of short-term plasticity at excitatory synapses in layer 2/3 of rat primary visual cortex. J. Neurosci. 17 (1997) 7926-7940
71. Senn W., Segev I., and Tsodyks M. Reading neuronal synchrony with depressing synapses. Neural Comput. 10 (1998) 815-819
72. Senn W., Tsodyks M., and Markram H. An algorithm for modifying neurotransmitter release probability based on pre- and post-synaptic spike timing. Neural Comput. 13 (2001) 35-67
73. Tabak J., Senn W., O'Donovan M.J., and Rinzel J. Modeling of spontaneous activity in developing spinal cord using activity-dependent depression in an excitatory network. J. Neurosci. 20 (2000) 3041-3056
74. Zucker R.S. Short-term synaptic plasticity. Annu. Rev. Neurosci. 12 (1989) 13-31
75. Liley A.W., and North K.A.K. An electrical investigation of effects of repetitive stimulation on mammalian neuromuscular junctions. J. Neurophysiol. 16 (1953) 509-527
76. Magleby K.L., and Zengel J.E. A quantitative description of tetanic and post-tetanic potentiation of transmitter release at the frog neuromuscular junction. J. Neurophysiol. 245 (1975) 183-208
77. Gerstner W., and van Hemmen J.L. Coherence and incoherence in a globally coupled ensemble of pulse emitting units. Phys. Rev. Lett. 71 (1993) 312-315
78. Gerstner W., van Hemmen J.L., and Cowan J.D. What matters in neuronal locking?. Neural Comput. 8 (1993) 1689-1712
79. Kistler W.M., and van Hemmen J.L. Short-term synaptic plasticity and network behavior. Neural Comput. 11 (1999) 1579-1594
80. Section 8.6 gives a simple introduction. Hale J.K., and Koçak H. Dynamics and Bifurcations (1991), Springer, Berlin
81. republished by Dover, Mineola, NY. Hale J.K. Oscillations in Nonlinear Systems (1963-1992), McGraw-Hill, New York
82. Linsker R. From basic network principles to neural architecture: emergence of spatialopponent cells. Proc. Natl. Acad. Sci. USA 83 (1986) 7508-7512
83. Sejnowski T.J., and Tesauro G. The Hebb rule for synaptic plasticity: algorithms and implementations. In: Byrne J.H., and Berry W.O. (Eds). Neural Models of Plasticity: Experimental and Theoretical Approaches, Chapter 6 (1989), Academic Press, San Diego, CA 94-103
84. Kohonen T. Self-Organization and Associative Memory (1984), Springer, Berlin
85. Carr C.E. Processing of temporal information in the brain. Annu. Rev. Neurosci. 16 (1993) 223-243. This wonderful review has been written with great didactic care. It is strongly recommended
86. MacKay D.J.C., and Miller K.D. Analysis of Linsker's application of Hebbian rules to linear networks. Network: Comput. Neural Syst. 1 (1990) 257-297
87. Miller K.D., and MacKay D.J.C. The role of constraints in Hebbian learning. Neural Comput. 6 (1994) 100-126
88. Submitted. Kempter R., Gerstner W., and van Hemmen J.L. Intrinsic rate normalization in spike-based and rate-based Hebbian learning. Neural Comput. (2000)
89. Bellman R. Introduction to Matrix Analysis. 2nd Edn (1970), McGraw-Hill, New York
90. Merzbacher E. Quantum Mechanics (1961), Wiley, New York. The chapter on the spin, where one can find everything on Pauli spin matrices, is strongly recommended reading
91. Dobrunz L.E., and Stevens C.F. Heterogeneity of release probability, facilitation, and depletion at central synapses. Neuron 18 (1997) 995-1008. This paper contains a nice appendix on underlying stochastic notions such as the relation between the readily releasable pool size and the release probability
92. Dobrunz L.E., Huang E.P., and Stevens C.F. Very short-term plasticity in hippocampal synapses. Proc. Natl. Acad. Sci. USA 94 (1997) 14843-14847
93. Dobrunz L.E., and Stevens C.F. Response of hippocampal synapses to natural stimulus patterns. Neuron 22 (1999) 157-166
94. Buonomano B.V. Decoding temporal information: A model based on short-term synaptic plasticity. J. Neurosci. 20 (2000) 1129-1141
95. Tuckwell H.C. Introduction to Theoretical Neurobiology Vol. 2 (1988), Cambridge University Press, New York
96. Ash R.B., and Gardner M.F. Topics in Stochastic Processes (1975), Academic Press, New York
97. Snyder D.L., and Miller M.I. Random Point Processes in Time and Space. 2nd Edn. (1991), Springer, New York
98. (Bernstein's theorem, for Appendix A) and Section 51 (for Appendix B). Gnedenko B.V. The Theory of Probability. 4th Edn. (1968), Chelsea, New York 265
99. Ash R.B. Real Analysis and Probability (1972), Academic Press, New York
100. Durrett R. Probability: Theory and Examples. 2nd Edn. (1996), Duxbury Press, Belmont, MA
101. Etemadi N. An elementary proof of the strong law of large numbers. Z. Wahrsch-einlichkeitstheorie verw. Geb. 55 (1981) 119-122
102. Prohorov Yu.V., and Rozanov Yu.A. Probability Theory (1969), Springer, Berlin
103. Gnedenko B.V., and Kolmogorov A.N. Limit Distributions for Sums of Independent Random Variables. 2nd Edn. (1968), Addison-Wesley, Reading, MA
104. n exists with probability one. Only if the process is ergodic do we get the answer 0 a.e. Halmos gives a succinct and elegant introduction; see also Khinchin, A.I. (1949) Mathematical foundations of Statistical Mechanics, Dover. New York, for excellent physical background information.
105. Scott D.J. Central limit theorems for martingales and for processes with stationary independent increments using the Skorohod representation approach. Adv. Appl. Probab. 5 (1973) 119-137