Stochastic perturbationmethods for spike-timing-dependent plasticity

Neural Computation

Volumn 24, Issue 5, 2012, Pages 1109-1146

  Leen, Todd K ^a   Friel, Robert ^a  

^a Oregon Health and Science University Department of Biomedical Engineering   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; BIOLOGICAL MODEL; COMPUTER SIMULATION; EXCITATORY POSTSYNAPTIC POTENTIAL; LEARNING; NERVE CELL; NERVE CELL PLASTICITY; PHYSIOLOGY; STATISTICS; SYNAPSE; TIME;

ALGORITHMS; COMPUTER SIMULATION; EXCITATORY POSTSYNAPTIC POTENTIALS; LEARNING; MODELS, NEUROLOGICAL; NEURONAL PLASTICITY; NEURONS; STOCHASTIC PROCESSES; SYNAPSES; TIME FACTORS;

EID: 84861128022     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00267     Document Type: Article

References (66)

1. Abramowitz, M.,&Stegun, L. (1972). Handbook of mathematical functions. Washington, DC: U.S. Department of Commerce, National Bureau of Standards.
2. Adrian, F. A. (2008). Exact ensemble dynamics for spike-timing-dependent plasticity. Master's thesis, Oregon Health & Science University.
3. Babadi, B., & Abbott, L. (2010). Intrinsic stability of temporally shifted spiketiming dependent plasticity. PLoS Colmput. Biol., 6(11):e1000961. doi:10,1371/ journal.pcbi.1000961.
4. Bedeaux, D., Lakatos-Lindenberg, K., & Shuler, K. E. (1971). On the relation between master equations and random walks and their solutions. Journal of Mathematical Physics, 12, 2116-2123.
5. Bell, C. (1982). Properties of a modifiable efference copy in an electric fish. J. Neurophysiol., 47, 1043-1056.
6. Bell, C., Bodznick, D., Montgomery, J., & Bastian, J. (1997). The generation and subtraction of sensory expectationswithin cerebellum-like structures. Brain Behav. Evol., 50, 17-31 (suppl. 1).
7. Bell, C., Han, V., Sugawara, Y.,&Grant, K. (1997). Synaptic plasticity in a cerebellumlike structure depends on temporal order. Nature, 387, 278-281.
8. Bell, C., & Szabo, T. (1986). Electroreception in mormyrid fish: Central anatomy. In T. Bullock & W. Heiligenberg (Eds.), Electroreception (pp. 375-421). New York: Wiley.
9. Bender, C. M., & Orszag, S. A. (1999). Advanced mathematical methods for scientists and engineers: Asymptotic methods and perturbation theory. New York: Springer.
10. Bi, Q., & Poo, M. (1998). Precise spike timing determines the direction and extent of synaptic modifications in cultured hippocampal neurons. Journal of Neuroscience, 18, 10464-10472.
11. Bienenstock, E. L., Cooper, L. N., &Munro, P.W. (1982). Theory for the development of neuron selectivity: Orientation specificity and binocular interaction in visual cortex. Journal of Neuroscience, 2, 32-48.
12. Bishop, C. M. (2006). Pattern recognition & machine learning. NewYork: Springer.
13. Blinnikov, S., & Moessner, R. (1998). Expansions for nearly gaussian distribution. Astron. Astrophys. Suppl. Ser., 130, 193-205.
14. Boyd, J. P. (1999). The devil's invention: Asymptotic, superasymptotic and hyperasymptotic series. Acta Applicandae Mathematicae, 56, 1-99.
15. Buice, M. A., Cowan, J. D., & Chow, C. C. (2010). Systematic fluctuation expansion for neural network activity equations. Neural Computation, 22, 377-426.
16. Burkitt, A. N., Meffin, H., & Grayden, D. B. (2004). Spike-timing-dependent plasticity: The relationship to rate-based learning for models with weight dynamics determined by a stable fixed point. Neural Computation, 16, 855-940.
17. Câteau, H., & Fukai, T. (2003). A stochastic method to predict the consequence of arbitrary forms of spike-timing-dependent plasticity. Neural Computation, 15(3), 597-620.
18. Cowan, J. (1991). Stochastic neurodynamics. In R. Lipmann, J. Moody, & D. Touretzky (Eds.), Advances in neural information processing systems, 3. San Mateo, CA:Morgan Kaufmann.
19. Darken, C., & Moody, J. (1991). Note on learning rate schedules for stochastic optimization. In R. Lipmann, J. Moody, & D. Touretzky (Eds.), Advances in neural information processing systems, 3. San Mateo, CA: Morgan Kaufmann.
20. Darken, C.,&Moody, J. (1992). Towards faster stochastic gradient search. In J.Moody, S. Hanson, & R. Lipmann (Eds.), Advances in neural information processing systems, 4. San Mateo, CA: Morgan Kaufmann.
21. Der, R., & Villmannn, T. (1993). Dynamics of self organized feature mapping (Tech. Rep.). Leipzig: Universitat Leipzig, Inst. für Informatik.
22. Fabian, V. (1968). On asymptotic normality in stochastic approximation. Ann. Math. Statist., 39, 1327-1332.
23. Fabian, V. (1973). Asymptotically efficient stochastic approximation: The RM case. Annals of Statistics, 1, 486-495.
24. Gardiner, C. (2009). Stochastic methods: A handbook for the natural and social sciences (4th ed.). Berlin: Springer-Verlag.
25. Gelfand, I., & Shilov, G. (1964). Generalized functions. Orlando, FL: Academic Press.
26. Gray, C., & Singer, W. (1989). Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. Proceedings of the National Academy of Sciences of the U.S.A., 86(5), 1698-1702.
27. Guckenheimer, J., & Holmes, P. (1983). Nonlinear oscillations, dynamical systems, and bifurcations of vector fields. NewYork: Springer-Verlag.
28. Han, V., Grant, K., & Bell, C. (2000). Reversible associative depression and nonassociative potentiation at a parallel fiber synapse. Neuron, 27, 611-622.
29. Hansen, L.K. (1993). Stochastic linear learning: Exact test and training error averages. Neural Networks, 6, 393-396.
30. Haykin, S. (1991). Adaptive filter theory (2nd ed.). Englewood Cliffs, NJ: Prentice Hall.
31. Heskes, T. M., & Kappen, B. (1993). On-line learning processes in artificial neural networks. In J. Taylor (Ed.), Mathematical foundations of neural networks (pp. 199-233). Dordrecht: Elsevier.
32. Ismailov, I., Kalikulov, D., Inoue, T., & Friedlander, M. (2004). The kinetic profile of intracellular calcium predicts long-term potentiation and long-term depression. J. Neuroscience, 24, 9847-9861.
33. Kepecs, A., van Rossum, M. C., Song, S., & Tegney, J. (2002). Spike-timingdependent plasticity:Commonthemes and divergent vistas. Biol.Cybern., 87, 446-448.
34. Kuan, C.-M., & Hornik, K. (1991). Convergence of learning algorithms with constant learning rates. IEEE Transactions on Neural Networks, 2, 484-489.
35. Kushner, H., & Clark, D. (1978). Stochastic approximation methods for constrained and unconstrained systems. New York: Springer-Verlag.
36. Leen, T. K. (1998). Exact and perturbation solutions to the ensemble dynamics. In D. Saad (Ed.), Online learning in neural networks. Cambridge: Cambridge University Press.
37. Leen, T. K., & Orr, G. B. (1994). Optimal stochastic search and adaptive momentum. In J. Cowan, G. Tesauro, & J. Alspector (Eds.), Advances in neural information processing systems, 6. San Francisco: Morgan Kaufmann.
38. Leen, T. K., Schottky, B., & Saad, D. (1998). Two approaches to optimal annealing. In M. Jordan, M. Kearnes, & S. Solla (Eds.), Advances in neural information processing systems, 10. Cambridge, MA: MIT Press.
39. Leen, T., Schottky, B., & Saad, D. (1999). Optimal asymptotic learning rate: Macroscopic versus microscopic dynamics. Physical Review, E, 59, 985-991.
40. Ljung, L. (1977). Analysis of recursive stochastic algorithms. IEEE Trans. Automatic Control, 22, 551-575.
41. Markram, H., Lubke, J., Fortscher, M., & Sakmann, B. (1997). Regulation of synaptic efficacy by conicidence of postsynaptic AP's and EPSP's. Science, 275, 213-215.
42. Masuda, N., & Aihara, K. (2004). Self-organizing dual coding based on spike-timedependent plasticity. Neural Computation, 16, 627-663.
43. Morrison, A., Diesmann, M., & Gerstner, W. (2008). Phenomenological models of synaptic plasticity based on spike timing. Biological Cybernetics, 98, 459-478.
44. Ohira, T., & Cowan, J. D. (1993). Master-equation approach to stochastic neurodynamics. Physical Review E, 48, 2259-2266.
45. Orr, G. B. (1996). Dynamics and algorithms for stochastic search. Unpublished doctoral dissertation, Oregon Graduate Institute.
46. Orr, G. B., & Leen, T. K. (1993). Weight space probability densities in stochastic learning: II. Transients and basin hopping times. In C. L. Giles, S. J. Hanson, & J. D. Cowan (Eds.), Advances in neural information processing systems, 5. San Mateo, CA: Morgan Kaufmann.
47. Orr, G. B., & Leen, T. K. (1997). Using curvature information for fast stochastic search. In M.Mozer, M. Jordan, & T. Petsche (Eds.), Advances in neural information processing systems, 9. Cambridge MA: MIT Press.
48. Pfister, J.-P., & Gerstner, W. (2006a). Beyond pair-based STDP: A phenomenological rule for spike triplet and frequency effects. In Y. Weiss, B. Schölkopf, & J. Platt (Eds.), Advances in neural information processing systems, 18. Cambridge, MA: MIT Press.
49. Pfister, J.-P., & Gerstner, W. (2006b). Triplets of spikes in a model of spike timingdependent plasticity. J. Neuroscience, 26, 9673-9682.
50. Radons, G. (1993). On stochastic dcynamics of supervised learning. J. Phys. A, 26, 3445-3461.
51. Radons, G., Schuster, H., &Werner, D. (1990). Fokker-Planck description of learning in backpropagation networks. In International Neural Network Conference-INNC 90 (pp. II 993-996). Norwell, MA: Kluwer.
52. Risken, H. (1989). The Fokker-Planck equation. Berlin: Springer-Verlag.
53. Robbins, H., & Monro, S. (1951). A stochastic approximation method. Ann. Math. Stat., 22, 400-407.
54. Roberts, P. D. (2000). Modeling inhibitory plasticity in the electrosensory system of mormyid electric fish. Journal of Neurophysiology, 84, 2035-2047.
55. Roberts, P. D., & Bell, C. C. (2000). Computational consequences of temporally asymmetric learning rules: II. Sensory image cancellation. Journal of Computational Neuroscience, 9, 67-83.
56. Roberts, P., & Lafferriere, G. (2005). Notes on modeling plasticity in the ELL. Unpublished research notes.
57. Rubin, J., Lee, D., & Sompolinsky, H. (2001). Equilibrium properties of temporally asymmetric Hebbian plasticity. Phys. Rev. Lett., 86, 364-367.
58. Sejnowski, T. (1977). Statistical constraints on synaptic plasticity. J. Theor. Biol., 69, 385-389.
59. van Kampen, N. (1976). The expansion of the master equation. In I. Prigogine & S. A. Rice (Eds.), Advances in chemical physics, 34. New York:Wiley.
60. van Kampen, N. (2007). Stochastic processes in physics and chemistry (3rd ed.). Amsterdam: Elsevier North-Holland.
61. van Rossum, M., Bi, G., & Turrigiano, G. (2000). Stable Hebbian learning from spike timing-dependent plasticity. Journal of Neuroscience, 20, 8812-8821.
62. Venter, J. H. (1967). An extension of the Robbins-Monro procedure. Annals of Mathematical Statistics, 38, 117-127.
63. White, H. (1989). Learning in artificial neural networks: A statistical perspective. Neural Computation, 1, 425-464.
64. Williams, A., Leen, T. K., & Roberts, P. D. (2004). Random walks for spike-timingdependent plasticity. Physical Review E, 70.
65. Williams, A., Roberts, P. D.,&Leen, T. (2003). Stability of negative-image equilibrium in spike-timing-dependent plasticity. Physical Review E, 68, 021923.
66. Zhang, L. I., Tao, H.W., Holt, C. E., Harris, W. A.,&Poo, M. (1998).Acritical window for cooperation and competition among developing retinotectal synapses. Nature, 395, 37-42.