A new supervised learning algorithm for spiking neurons

Neural Computation

Volumn 25, Issue 6, 2013, Pages 1472-1511

  Xu, Yan ^a   Zeng, Xiaoqin ^a   Zhong, Shuiming ^b  

^a HOHAI UNIVERSITY   (China)

^b NANJING UNIVERSITY OF INFORMATION SCIENCE AND TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POTENTIAL; ALGORITHM; BIOLOGICAL MODEL; HUMAN; LEARNING; LETTER; NERVE CELL; PHYSIOLOGY; SYNAPSE;

ACTION POTENTIALS; ALGORITHMS; HUMANS; MODELS, NEUROLOGICAL; NEURONS; SERIAL LEARNING; SYNAPSES;

EID: 84877829714     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00450     Document Type: Letter

References (54)

1. Adrian, E. D., & Zotterman, Y. (1926). The impulses produced by sensory nerve endings: Part II: The response of a single end organ. Journal of Physiology, 61, 151-171.
2. Belatreche, A., Maguire, L. P., McGinnity, M., & Wu, Q. X. (2003). A method for supervised training of spiking neural networks. In Proceedings of IEEE Cybernetics Intelligence-Challenges and Advances (CICA) 2003 (pp. 39-44). Piscataway, NJ: IEEE.
3. Bi, G. Q., & Poo, M. M. (1998). Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type. Journal of Neuroscience, 18, 10464-10472.
4. Bohte, S. M.,Kok, J. N.,&La Poutré, J. A. (2002). Error-backpropagation in temporally encoded networks of spiking neurons. Neurocomputing, 48, 17-37.
5. Bose, N. K., & Liang, P. (1996). Neural network fundamentals with graphs, algorithms and applications. New York: McGraw-Hill.
6. Brea, J., Senn, W., & Pfister, J. P. (2011). Sequence learning with hidden units in spiking neural networks. In J. Shawe-Taylor, R. S. Zemal, P. Bartlett, F. Pereira, & K. Q. Weinberger (Eds.), Advances in neural information processing systems, 24 (pp. 1422-1430). Red Hook, NY: Curran.
7. Broomhead, D. S., & Lowe, D. (1988). Multivariable functional interpolation and adaptive networks. Complex Systems, 2, 321-355.
8. Carnell, A., & Richardson, D. (2005). Linear algebra for time series of spikes. In Proceedings of European Symposium on Artificial Neural Networks, ESANN' 2005 (pp. 363-368). Brussels: d-side.
9. Florian, R. V. (2007). Reinforcement learning through modulation of spike-timingdependent synaptic plasticity. Neural Computation, 19, 1468-1502.
10. Florian, R. V. (2012). The chronotron: A neuron that learns to fire temporally precise spike patterns. PLoS ONE, 7, e40233. doi:10.1371/journal.pone.0040233.
11. Gerstner,W.,&Kistler,W.M. (2002). Spiking neuron models: Single neurons, populations, plasticity. Cambridge: Cambridge University Press.
12. Ghosh-Dastidar, S., & Adeli, H. (2007). Improved spiking neural networks for EEG classification and epilepsy and seizure detection. Integrated Computer-Aided Engineering, 14, 187-212.
13. Ghosh-Dastidar, S., & Adeli, H. (2009). A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection. Neural Networks, 22, 1419-1431.
14. Gütig, R., & Sompolinsky, H. (2006). The tempotron: A neuron that learns spike timing-based decisions. Nature Neuroscience, 9, 420-428.
15. Hebb, D. O. (1949). The organization of behavior. NewYork: Wiley.
16. Hertz, J., Krogh, A., & Palmer, R. (1991). Introduction to the theory of neural networks. Reading, MA: Addison-Wesley.
17. Jaeger, H., Maass,W., & Principe, J. (2007). Special issue on echo state networks and liquid state machines: Editorial. Neural Networks, 20, 287-432.
18. Kandel, E., Schwartz, J., & Jessel, T. (1991). Principles of neural science. New York: Elsevier.
19. Kasínski, A., & Ponulak, F. (2006). Comparison of supervised learning methods for spike time coding in spiking neural networks. International Journal of Applied Mathematics and Computer Science, 16, 101-113.
20. Kistler,W. (2002). Spike-timing dependent synaptic plasticity: A phenomenological framework. Biological Cybernetics, 87, 416-427.
21. Kroese, B., & van der Smagt, P. (1996). An introduction to neural networks. (8th ed.). Amsterdam: University of Amsterdam.
22. Legenstein, R., Naeger, C., & Maass,W. (2005).What can a neuron learn with spiketiming- dependent plasticity? Neural Computation, 17, 2337-2382.
23. Legenstein, R., Pecevski, D., & Maass, W. (2008). A learning theory for rewardmodulated spike timing-dependent plasticity with application to biofeedback. PLoS Computational Biology, 4, 1-27.
24. Maass,W. (1997a). Fast sigmoidal networks via spiking neurons. Neural Computation, 9, 279-304.
25. Maass, W. (1997b). Networks of spiking neurons: The third generation of neural network models. Neural Networks, 10, 1659-1671.
26. Maass,W. (1997c). Noisy spiking neurons with temporal coding have more computational power than sigmoidal neurons. In M. Mozer, M. I. Jordan, & T. Petsche (Eds.), Advances in neural information processing systems, 9 (pp. 211-217). Cambridge, MA: MIT Press.
27. Maass, W., Natschlager, T., & Markram, H. (2002). Real-time computing without stable states: A new framework for neural computation based on perturbations. Neural Computation, 14, 2531-2560.
28. Mainen, Z. F., & Sejnowski, T. J. (1995). Reliability of spike timing in neocortical neurons. Science, 268, 1503-1506.
29. Markram, H., Lübke, J., Frotscher, M., & Sakmann, B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science, 275, 213-215.
30. McKennoch, S., Liu, D., & Bushnell, L. G. (2006). Fastmodifications of the spikeprop algorithm. In Proceedings of the International Joint Conference on Neural Networks (pp. 3970-3977). Piscataway, NJ: IEEE.
31. Minsky, M., & Papert, S. (1969). Perceptrons. Cambridge, MA: MIT Press.
32. Montemurro,M. A., Panzeri, S.,Maravall, M., Alenda, A., Bale, M. R., Brambilla,M., et al. (2007). Role of precise spike timing in coding of dynamic vibrissa stimuli in somatosensory thalamus. Journal of Neurophysiology, 98, 1871-1882.
33. Pfister, J.-P., Toyoizumi, T., Barber, D., & Gerstner,W. (2006). Optimal spike-timingdependent plasticity for precise action potential firing in supervised learning. Neural Computation, 18, 1318-1348.
34. Ponulak, F. (2005). ReSuMe-new supervised learning method for spiking neural networks (Tech. Rep.). Poznan: Institute of Control and Information Engineering, Poznan University of Technology.
35. Ponulak, F., & Kasínski, A. (2010). Supervised learning in spiking neural networks with ReSuMe: Sequence learning, classification and spike-shifting. Neural Computation, 22, 467-510.
36. Rieke, F., Warland, D., de Ruyter van Steveninck, R., & Bialek, W. (1997). Spikes: Exploring the neural code. Cambridge, MA: MIT Press.
37. Rojas, R. (1996). Neural networks: A systematic introduction. Berlin: Springer-Verlag.
38. Ruf, B., & Schmitt, M. (1997). Learning temporally encoded patterns in networks of spiking neurons. Neural Processing Letters, 5, 9-18.
39. Rullen, R. V., Guyonneau, R., & Thorpe, S. J. (2005). Spike times make sense. Trends in Neurosciences, 28, 1-4.
40. Rullen, R. V., & Thorpe, S. J. (2001). Rate coding versus temporal order coding: What the retinal ganglion cells tell the visual cortex. neural computation, 13, 1255-1283.
41. Rumelhart, D. E., Hinton, G. E., &Williams, R. J. (1986). Learning representations by back-propagating errors. Nature, 323, 533-536.
42. Schneidman, E. (2001). Noise and information in neural codes. (doctoral dissertation, Hebrew University, Jerusalem, Israel).
43. Schrauwen, B., & Campenhout, J. V. (2004). Extending spikeprop. In Proceedings of the International Joint Conference on Neural Networks (pp. 471-476). Piscataway, NJ: IEEE.
44. Schrauwen, B., & Campenhout, J. V. (2006). Backpropagation for populationtemporal coded spiking neural networks. In Proceedings of the International Joint Conference on Neural Networks (pp. 1797-1804). Piscataway, NJ: IEEE.
45. Schreiber, S., Fellous, J. M., Whitmer, D., Tiesinga, P., & Sejnowski, T. J. (2003). A new correlation-basedmeasure of spike timing reliability. Neurocomputing, 52-54, 925-931.
46. Shen, X., Lin, X., & DeWilde, P. (2008). Oscillations and spiking pairs: Behavior of a neuronal model with STDP learning. Neural Computation, 20, 2037-2069.
47. Shmiel, T.,Drori,R., Shmiel, O., Ben-Shaul,Y., Nadasdy,Z., Shemesh, M., et al. (2005). Neurons of the cerebral cortex exhibit precise interspike timing in correspondence to behavior. Proceedings of the National Academy of Sciences of USA, 102, 18655-18657.
48. Silva, S. M., & Ruano, A. E. (2005). Application of Levenberg-Marquardt method to the training of spiking neural networks. In Proceedings of the International Conference on Neural Networks and Brain (Vol. 3, pp. 1354-1358). Piscataway, NJ: IEEE.
49. Stickgold, R., Hobson, J.A., Fosse, R.,&Fosse,M. (2001). Sleep, learning, and dreams: Off-line memory reprocessing. Science, 294, 1052-1057.
50. Theunissen, F., & Miller, J. P. (1995). Temporal encoding in nervous systems: A rigorous definition. Journal of Computational Neuroscience, 2, 149-162.
51. Tiesinga, P., Fellous, J.-M., & Sejnowski, T. J. (2008). Regulation of spike timing in visual cortical circuits. Nature Reviews Neuroscience, 9, 97-107.
52. van Rossum, M. C., O'Brien, B. J., & Smith, R. G. (2003). Effects of noise on the spike timing precision of retinal ganglion cells. Journal of Neurophysiology, 89, 2406-2419.
53. Victor, J. D., & Purpura, K. P. (1996). Nature and precision of temporal coding in the visual cortex: A metric-space analysis. Journal of Neurophysiology, 76, 1310-1326.
54. Xin, J., & Embrechts,M. J. (2001). Supervised learning with spiking neural networks. In Proceedings of the International Joint Conference on Neural Networks (Vol. 3, pp. 1772-1777).