Supervised learning in spiking neural networks with ReSuMe: Sequence learning, classification, and spike shifting

Neural Computation

Volumn 22, Issue 2, 2010, Pages 467-510

  Ponulak, Filip ^a,b   Kasiński, Andrzej ^a  

^a POZNAN UNIVERSITY OF TECHNOLOGY   (Poland)

^b UNIVERSITY OF FREIBURG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POTENTIAL; ALGORITHM; ANIMAL; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; BRAIN; HUMAN; LETTER; MATHEMATICAL COMPUTING; MATHEMATICAL PHENOMENA; NERVE CELL; NERVE CELL NETWORK; PHYSIOLOGY; REACTION TIME; SIGNAL PROCESSING; SYNAPTIC TRANSMISSION; TIME;

ACTION POTENTIALS; ALGORITHMS; ANIMALS; ARTIFICIAL INTELLIGENCE; BRAIN; HUMANS; MATHEMATICAL COMPUTING; MATHEMATICAL CONCEPTS; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONS; REACTION TIME; SIGNAL PROCESSING, COMPUTER-ASSISTED; SYNAPTIC TRANSMISSION; TIME FACTORS;

EID: 77649334232     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2009.11-08-901     Document Type: Letter

References (98)

1. Belatreche, A., Maguire, L. P., McGinnity, M., & Wu, Q. X. (2003). A method for supervised training of spiking neural networks. In Proceedings of IEEE Cybernetics Intelligence-Challenges and Advances (CICA) 2003 (pp. 39-44). Piscataway, NJ: IEEE.
2. Bell, C. C., Han, V. Z., Sugawara, Y., & Grant, K. (1997). Synaptic plasticity in a cerebellum-like structure depends on temporal order. Nature, 387, 278-281.
3. Belter, D., Ponulak, F., & Rotter, S. (2008). Adaptive movement control with spiking neural networks, part II: Composite control. In Proceedings of Recent Advances in Neuro-Robotics, Symposium: Sensorimotor Control. Freiburg: Freiburg University.
4. Berry, M. J., Warland, D. K., & Meister, M. (1997). The structure and precision of retinal spike trains. Proceedings of the National Academy of Science of USA, 94, 5411-5416.
5. Bi, G.-Q. (2002). Spatiotemporal specificity of synaptic plasticity: Cellular rules and mechanisms. Biological Cybernetics, 87, 319-332.
6. Bi, G.-Q., & Poo, M.-M. (1998). Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type. Journal of Neuroscience, 18(24), 10464-10472.
7. Bohte, S., Kok, J., & Poutré, H. L. (2002). Error-backpropagation in temporally encoded networks of spiking neurons. Neurocomputing, 48, 17-37.
8. Booij, O., & Nguyen, H. T. (2005). A gradient descent rule for spiking neurons emitting multiple spikes. Information Processing Letters, 95(6), 552-558.
9. Borst, A., & Theunissen, F. E. (1999). Information theory and neural coding. Nature Neuroscience, 2(11), 947-957.
10. Bottou, L., & Vapnik, V. (1992). Local learning algorithms. Neural Computation, 4(6), 888-900.
11. Carey, M. R., Medina, J. F., & Lisberger, S. G. (2005). Instructive signals for motor learning from visual cortical area MT. Nature Neuroscience, 8, 813-819.
12. Carnell, A., & Richardson, D. (2005). Linear algebra for time series of spikes. In Proceedings of the European Symposium on Artificial Neural Networks, ESANN'2005 (pp. 363-368). Brussels: D-Facto.
13. CSIM. (2002). CSIM: A neural circuit SIMulator. Graz: IGI LSM Group, Technical University. Available online at http://www.lsm.tugraz.at.
14. Doya, K. (1999). What are the computations of the cerebellum, the basal ganglia and the cerebral cortex. Neural Networks, 12, 961-974.
15. Duda, R. O., Hart, P. E., & Stork, D. G. (2000). Pattern classification (2nd ed.). Hoboken, NJ: Wiley Interscience.
16. Dudman, J. T., Tsay, D., & Siegelbaum, S. A. (2007). A role for distal synaptic inputs: Instructive signals for hippocampal synaptic plasticity. Neuron, 56(5), 866-879.
17. Farries, M., & Fairhall, A. (2007). Reinforcement learning with modulated spike timing-dependent synaptic plasticity. Journal of Neurophysiology, 98, 3648-3665.
18. Florian, R. (2007). Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity. Neural Computation, 19(6), 1468-1502.
19. Florian, R. (2008). Tempotron-like learning with ReSuMe. In Proceedings of the 18th International Conference on Artificial Neural Networks, ICANN'2008 (pp. 368-375). Berlin: Springer-Verlag.
20. Furukawa, S., & Middlebrooks, J. C. (2002). Cortical representation of auditory space: Information-bearing features of spike patterns. Journal of Neurophysiology, 87, 1749-1762.
21. Gaze, R., Keating, M., Szekely, G., & Beazley, L. (1970). Binocular interaction in the formation of specific intertectal neuronal connexions. Proceedings of the Royal Society [Biol], 175, 107-147.
22. Georgopoulos, A. P. (1986). On reaching. Annual Reviews in Neuroscience, 9, 147-170.
23. Gerstner, W., & Kistler, W. (2002). Spiking neuron models: Single neurons, populations, plasticity. Cambridge: Cambridge University Press.
24. Ghosh-Dastidar, S., & Adeli, H. (2007). Improved spiking neural networks for EEG classification and epilepsy and seizure detection. Integrated Computer-Aided Engineering, 14(3), 187-212.
25. Gütig, R., Aharonov, R., Rotter, S., & Sompolinsky, H. (2003). Learning input correlations through non-linear temporally asymmetric Hebbian plasticity. Journal of Neuroscience, 23, 3697-3714.
26. Gütig, R., & Sompolinsky, H. (2006). The tempotron: A neuron that learns spike timing-based decisions. Nature Neuroscience, 9, 420-428.
27. Hebb, D. O. (1949). The organization of behavior.NewYork:Wiley.
28. Hertz, J., Krogh, A., & Palmer, R. (1991). Introduction to the theory of neural networks. Reading, MA: Addison-Wesley.
29. Hodgkin, A. L., & Huxley, A. F. (1952). A quantitative description of membrane current and its application to conduction and excitation in nerve. Journal of Physiology, 117, 500-544.
30. Hopfield, J. J., & Brody, C. D. (2001). What is a moment? Transient synchrony as a collective mechanism for spatiotemporal integration. Proceedings of the National Academy of Sciences of USA, 98, 1282-1287.
31. Humeau, Y., Shaban, H., Bissiere, S., & Lüthi, A. (2003). Presynaptic induction of heterosynaptic associative plasticity in the mammalian brain. Nature, 426, 841-845.
32. Ito, M. (2000a). Mechanisms of motor learning in the cerebellum. Brain Research, 886, 237-245.
33. Ito, M. (2000b). Neural control of cognition and language. In A. Marantz, Y. Miyashita, & W. O'Neil (Eds.), Image, language, brain. Cambridge, MA: MIT Press.
34. Ito, M. (2008). Control of mental activities by internal models in the cerebellum. Nature Reviews Neuroscience, 9, 304-313.
35. Izhikevich, E. M. (2003). Simple model of spiking neurons. IEEE Transaction on Neural Networks, 14(6), 1569-1572.
36. Izhikevich, E. M (2007). Solving the distal reward problem through linkage of STDP and dopamine signaling. Cerebral Cortex, 17(10), 2443-2452.
37. Jaeger, H. (2001). The "echo state" approach to analysing and training recurrent neural networks (Computing Science Tech. Rep. GMD 148). Sankt Augustin: Fraunhofer Institute for Autonomous Intelligent Systems, German National Research Center for Information Technology.
38. Jaeger, H., Maass, W., & Principe, J. (2007). Editorial. Neural Networks, 20, 287-432.
39. Judge, S., & Hasselmo, M. (2004). Theta rhythmic stimulation of stratum lacunosummoleculare in rat hippocampus contributes to associative LTP at a phase offset in stratum radiatum. Journal of Neurophysiology, 92, 1615-1624.
40. Kampa, B. M., Letzkus, J. J., & Stuart, G. J. (2007). Dendritic mechanisms controlling spike-timing-dependent synaptic plasticity. Trends in Neuroscience, 30(9), 456-463.
41. Kasiński, A., & Ponulak, F. (2005). Experimental demonstration of learning properties of a new supervised learning method for the spiking neural networks. In Proceedings of the 15th International Conference on Artificial Neural Networks, ICANN'2005 (pp. 145-153). Berlin: Springer-Verlag.
42. Kasiński, A., & Ponulak, F. (2006). Comparison of supervised learning methods for spike time coding in spiking neural networks. International Journal of Applied Mathematics and Computer Science, 16(1), 101-113.
43. Kawato, M., & Gomi, H. (1992a). A computational model of four regions of the cerebellum based on feedback-error-learning. Biological Cybernetics, 68, 95-103.
44. Kawato, M., & Gomi, H. (1992b). The cerebellum and VOR/OKR learning models. Trends in Neurosciences, 15, 445-453.
45. Kistler, W. (2002). Spike-timing dependent synaptic plasticity: A phenomenological framework. Biological Cybernetics, 87, 416-427.
46. Kistler, W., & van Hemmen, L. J. (2000). Modeling synaptic plasticity in conjunction with the timing of pre-and postsynaptic action potentials. Neural Computation, 12, 385-405.
47. Knudsen, E. I. (1991). Visual instruction of the neural map of auditory space in the developing optic tectum. Science, 5015(253), 85-87.
48. Knudsen, E. I. (1994). Supervised learning in the brain. Journal of Neuroscience, 14(7), 3985-3997.
49. Knudsen, E. I. (2002). Instructed learning in the auditory localization pathway of the barn owl. Nature, 417, 322-328.
50. Kolb, F. P., Rubia, F. J., & Bauswein, E. (1987). Comparative analysis of cerebellar unit discharge patterns in the decerebrate cat during passive movements. Experimental Brain Research, 68(2), 219-233.
51. Kraft, M., Ponulak, F., & Kasiński, A. (2006). FPGA implementation of ReSuMe learning in spiking neural networks. In Proceedings of EPFL LATSIS Symposium 2006, Dynamical Principles for Neuroscience and Intelligent Biomimetic Devices (pp. 97-98). N. p.
52. Kroese, B., & van der Smagt, P. (1996). An introduction to neural networks (8th ed.). Amsterdam: The University of Amsterdam.
53. Legenstein, R., Naeger, C., & Maass, W. (2005). What can a neuron learn with spiketiming-dependent plasticity. Neural Computation, 17, 2337-2382.
54. Legenstein, R., Pecevski, D., & Maass, W. (2008). A learning theory for reward-modulated spike-timing-dependent plasticity with application to biofeedback. PLoS Computational Biology, 4(10), 1-27.
55. Lisberger, S. G. (1995). Learning: A mechanism of learning found?. Current Biology, 5(3), 221-224.
56. Maass, W., & Bishop, C. (Eds.). (1999). Pulsed neural networks. Cambridge, MA: MIT Press.
57. Maass, W., & Markram, H. (2003). Temporal integration in recurrent microcircuits. In M. A. Arbib (Ed.), The handbook of brain theory and neural networks (2nd ed., pp. 1159-1163). Cambridge, MA: MIT Press.
58. Maass, W., Natschlaeger, T., & Markram, H. (2002). Real-time computing without stable states: A new framework for neural computation based on perturbations. Neural Computation, 14(11), 2531-2560.
59. Maass, W., Natschlaeger, T., & Markram, H. (2004). Computational models for generic cortical microcircuits. In J. Feng (Ed.), Computational neuroscience: A comprehensive approach (pp. 575-605). Boca Raton, FL: Chapman and Hall/CRC.
60. Mainen, Z. F., & Sejnowski, T. J. (1995). Reliability of spike timing in neocortical neurons. Science, 268, 1503-1506.
61. Mauk, M. D., & Buonomano, D. V. (2004). The neural basis of temporal processing. Annual Review of Neuroscience, 27, 307-340.
62. Miall, C. R., & Wolpert, D. M. (1996). Forward models for physiological motor control. Neural Networks, 9(8), 1265-1279.
63. Montemurro, M. A., Panzeri, S., Maravall, M., Alenda, A., Bale, M. R., & Brambilla, M., et al. (2007). Role of precise spike timing in coding of dynamic vibrissa stimuli in somatosensory thalamus. Journal of Neurophysiology, 98, 1871-1882.
64. Montgomery, J., Carton, G., & Bodznick, D. (2002). Error-driven motor learning in fish. Biological Bulletin, 203(2), 238-239.
65. Muresan, R. (2002). Complex object recognition using a biologically plausible neural model. In Proceedings of the 2nd WSEAS International Conference on Robotics, Distance Learning and Intelligent Communication Systems. N.p.: WSEAS Press.
66. Natschlaeger, T., Markram, H., & Maass, W. (2003). Computer models and analysis tools for neural microcircuits. In R. Koetter (Ed.), Neuroscience databases. A practical guide (pp. 123-138). Norwell, MA: Kluwer.
67. Pfister, J.-P., Toyoizumi, T., Barber, D., & Gerstner, W. (2006). Optimal spike-timing dependent plasticity for precise action potential firing. Neural Computation, 18, 1318-1348.
68. Ponulak, F. (2005). ReSuMe-new supervised learning method for spiking neural networks (Tech. Rep.). Poznań: Institute of Control and Information Engineering, Poznań University of Technology. Available online at http://d1.cie.put.poznan.pl/~fp/.
69. Ponulak, F. (2006a). ReSuMe-Proof of convergence (Tech. Rep.). Poznań: Institute of Control and Information Engineering, Poznań University of Technology. Available online at: http://d1.cie.put.poznan.pl/~fp/.
70. Ponulak, F. (2006b). Supervised learning in spiking neural networks with ReSuMe method. Unpublished doctoral dissertation, Poznań University of Technology, Poland. Available online at: http://d1.cie.put.poznan.pl/~fp/.
71. Ponulak, F. (2008). Analysis of the ReSuMe learning process for spiking neural networks. International Journal of Applied Mathematics and Computer Science, 18(2), 117-127.
72. Ponulak, F. (2009). Memory capacity of spiking neurons. Manuscript in preparation.
73. Ponulak, F., Belter, D., & Kasiński, A. (2006). Adaptive central pattern generator based on spiking neural networks. In Proceedings of EPFL LATSIS Symposium 2006, Dynamical Principles for Neuroscience and Intelligent Biomimetic Devices (pp. 121-122). N.p.
74. Ponulak, F., Belter, D., & Rotter, S. (2008). Adaptive movement control with spiking neural networks, part I: Feedforward control. In Proceedings of Recent Advances in Neuro-Robotics, Symposium: Sensorimotor Control. Freiburg: Freiburg University.
75. Ponulak, F., & Kasiński, A. (2006a). Generalization properties of SNN trained with ReSuMe. In Proceedings of European Symposium on Artificial Neural Networks, ESANN'2006 (pp. 623-629) Brussels: D-Facto.
76. Ponulak, F., & Kasiński, A. (2006b). ReSuMe learning method for spiking neural networks dedicated to neuroprostheses control. In Proceedings of EPFL LATSIS Symposium 2006, Dynamical Principles for Neuroscience and Intelligent Biomimetic Devices (pp. 119-120). N.p.
77. Rieke, F., Warland, D., de Ruyter van Steveninck, R., & Bialek, W. (1997). Spikes: Exploring the neural code. Cambridge, MA: MIT Press.
78. Roberts, P. D., & Bell, C. C. (2002). Spike timing dependent synaptic plasticity in biological systems. Biological Cybernetics, 87(5-6), 392-403.
79. Rojas, R. (1996). Neural networks: A systematic introduction. Berlin: Springer-Verlag.
80. Rosenblatt, F. (1958). The perceptron: A probabilistic model for information storage and organization in the brain. Psychological Review, 65(6), 386-408.
81. Schneidman, E. (2001). Noise and information in neural codes. Unpublished doctoral dissertation, Hebrew University.
82. Schrauwen, B., & Campenhout, J. V. (2006). Backpropagation for population-temporal coded spiking neural networks. In Proceedings of the International Conference on Neural Networks (pp. 1797-1804) Piscataway, NJ: IEEE.
83. Schreiber, S., Fellous, J., Whitmer, D., Tiesinga, P., & Sejnowski, T. (2003). A new correlation-based measure of spike timing reliability. Neurocomputing, 52-54, 925-931.
84. Shidara, M., Kawano, K., Gomi, H., & Kawato, M. (1993). Inverse-dynamics model of eye movement control by Purkinje cells in the cerebellum. Nature, 365, 50-52.
85. Shmiel, T., Drori, R., Shmiel, O., Ben-Shaul, Y., Nadasdy, Z., Shemesh, M., et al. (2005). Neurons of the cerebral cortex exhibit precise interspike timing in correspondence to behavior. Proceedings of the National Academy of Sciences of USA, 102(51), 18655-18657.
86. Thach, W. T. (1996). On the specific role of the cerebellum in motor learning and cognition: Clues from PET activation and lesion studies in man. Behavioral Brain Science, 19, 411-431.
87. Tiesinga, P., Fellous, J.-M., & Sejnowski, T. J. (2008). Regulation of spike timing in visual cortical circuits. Nature Reviews Neuroscience, 9, 97-107.
88. Tiňo, P., & Mills, A. J. (2005). Learning beyond finite memory in recurrent networks of spiking neurons. In L. Wang, K. Chen, & Y. Ong (Eds.), Advances in natural computation, ICNC'2005 (pp. 666-675). Berlin: Springer-Verlag.
89. Tzounopoulos, T., Rubio, M. E., Keen1and, J. E., & Trussell, L. O. (2007). Coactivation of pre-and postsynaptic signaling mechanisms determines cell-specific spike-timing-dependent plasticity. Neuron, 54(2), 291-301.
90. Udin, S. B. (1985). The role of visual experience in the formation of binocular projections in frogs. Cellular and Molecular Neurobiology, 5, 85-102.
91. Udin, S. B., & Keating, M. (1981). Plasticity in a central nervous pathway in Xenopus: Anatomical changes in the isthmotectal projection after larval eye rotation. Journal on Computational Neurology, 203(4), 575-594.
92. Uzzell V. J., & Chichilnisky, E. J. (2004). Precision of spike trains in primate retinal ganglion cells. Journal of Neurophysiology, 92, 780-789.
93. van Rossum, M. C., O'Brien, B. J., & Smith, R. G. (2003). Effects of noise on the spike timing precision of retinal ganglion cells. Journal of Neurophysiology, 89, 2406-2419.
94. Werbos, P. (1974). Beyond regression: New tools for prediction and analysis. Unpublished doctoral dissertation, Harvard University.
95. Widrow, B. (1962). Generalization and information storage in networks of Adaline "neurons." In M. Yovitz, G. Jacobi, & G. Goldstein (Eds.), Self-organizing systems (pp. 435-461). Spartan Books.
96. Widrow, B., & Hoff, M. E. (1960). Adaptive switching circuits. IRE WESCON Convention Record, 4, 96-104.
97. Wolpert, D. M., Miall, C. R., & Kawato, M. (1998). Internal models in the cerebellum. Trends in Cognitive Sciences, 2, 338-347.
98. Xin, J., & Embrechts, M. J. (2001). Supervised learning with spiking neuron networks. In Proceedings IEEE International Joint Conference on Neural Networks, IJCNN'01 (pp. 1772-1777). Piscataway, NJ: IEEE.