Online versus offline learning for spiking neural networks: A review and new strategies

2010 IEEE 9th International Conference on Cybernetic Intelligent Systems, CIS 2010

Volumn , Issue , 2010, Pages

  Wang, Jinling ^a   Belatreche, Ammar ^a   Maguire, Liam ^a   McGinnity, Martin ^a  

^a UNIVERSITY OF ULSTER   (United Kingdom)

Author keywords

on line learning, off line learning; spiking neurons; supervised learning; unsupervised learning, integrate and fire neuron model, spike response model

Indexed keywords

BIOLOGICAL NEURAL NETWORKS; LARGE DATASETS; LARGE NETWORKS; NEW STRATEGY; NONSTATIONARY; OFF-LINE LEARNING; OFFLINE; ONLINE LEARNING; ONLINE LEARNING ALGORITHMS; ONLINE TRAINING; REAL-WORLD APPLICATION; SPIKING NEURAL NETWORKS; SPIKING NEURON; THIRD GENERATION; TRAINING METHODS;

E-LEARNING; INTELLIGENT SYSTEMS; LEARNING ALGORITHMS; ONLINE SYSTEMS;

NEURAL NETWORKS;

EID: 79960367947     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/UKRICIS.2010.5898113     Document Type: Conference Paper

References (59)

1. Maass, W. 1997c, "Networks of spiking neurons: The third generation of neural network models", Neural Networks, vol. 10, no. 9, pp. 1659-1671 (Pubitemid 28057273)
2. Van Rullen, R., Guyonneau, R. & Thorpe, S., J. 2005, "Spike times make sense", TRENDS in Neurosciences, vol. 28, no. 1, pp. 1-4. (Pubitemid 40038795)
3. Maass, W. 1997a, "Fast sigmoidal networks via spiking neurons", Neural Computation, vol. 9, pp. 279-304. (Pubitemid 127635392)
4. Maass, W. 1997b, "Noisy spiking neurons with temporal coding have more computational power than sigmoidal neurons" in Advances in Neural Information Processing Systems, Volume 9, eds. M. Mozer, M. I. Jordan & T. Petsche, MIT press, Cambridge, pp. 211-217.
5. Bohte, S. M. June 2004, "The Evidence for Neural Information processing with Precise Spike-times: A Survey", Natural Computing special issue on selected papers from the FUNN 2003 workshop.
6. Thorpe, S., J., Delorme, A. & VanRullen, R., 2001, "Spike-based strategies for rapid processing", Neural Networks, vol. 14, no. 6-7, pp. 715-726.
7. Saad, D. 1999, On-line learning in neural networks, Cambridge University Press, Cambridge
8. Bohte, S. M., Kok, J. N. & Poutre, H. L. 2000", Spike-prop: errorbackprogation in multi-layer networks of spiking neurons", Proceedings of the European Symposium on Artificial Neural Networks ESANN'2000, ed. M. Verleysen, D-facto, pp. 419-425.
9. Bohte, S. M., Kok, J. N. & Poutre, H. L. 2002, "Error- backprogation in Temporally Encoded Networks of spiking neurons", Neurocomputing, vol. 48, pp. 17-37. (Pubitemid 36221486)
10. Moore, S., christian 2002, Back-Propagation in Spiking Neural Networks MSc thesis, University of Bath.
11. Xin, J. & Embrechts, m., J. 2001", Supervised Learning with Spiking Neuron Networks", In Proceedings IEEE International Joint Conference on Neural Networks, IJCNN'01 Washington D. C., pp. 1772-1777. (Pubitemid 32805167)
12. Schrauwen, B. & Campenhout, J., Van 11 2004", Improving SpikeProp: Enhancements to an Error-Backpropagation Rule for Spiking Neural Networks", In Proceedings of the 15th ProRISC Workshop, 11 2004.
13. Schrauwen, B. & Campenhout, J., Van 2006", Backpropagation for Population-Temporal Coded Spiking Neural Networks". 2006 International Joint Conference on Neural NetworksIEEE, Vancouver, BC, Canada.
14. Tino, P. & Mills, A., J. S. 2005, "Learning Beyond Finite Memory in Recurrent Networks of Spiking Neurons" in Advances in Natural Computation-ICNC 2005, Lecture Notes in Computer Science, eds. L. Wang, K. Chen & Y. S. Ong, Springer-Verlag, pp. 666-675. (Pubitemid 41449812)
15. Wu, Q. X., McGinnity, T. M., Maguire, L. P., Glackin, B. & Belatreche, A. 2006, "Learning under weight constraints in networks of temporal encoding spiking neurons", Neurocomputing, vol. 69, no. 16-18, pp. 1912-1922. (Pubitemid 44362059)
16. Silva, S. M.1. & Ruano, A. E.1. 2007, "Application of the Levenberg-Marquardt method to the training of spiking neural networks", 2006 International Joint Conference on Neural NetworksIEEE, Vancouver, BC, Canada, pp. 3978.
17. McKennoch, S.1., Liu1, D. & Bushnell, L. G.1. 2007, "Fast modifications of the SpikeProp algorithm", 2006 International Joint Conference on Neural NetworksIEEE, Vancouver, BC, Canada, pp. 3970.
18. Xie, X. & Seung, H. S. 2004, "Learning in neural networks by reinforcement of irregular spiking", Physical Review E, vol. 69, no. 4, pp. 041909-1.
19. Booij, O.1. & Hieu tat Nguyen1 2005, "A gradient descent rule for spiking neurons emitting multiple spikes", Information Processing Letters, vol. 95, no. 6, pp. 552-8. (Pubitemid 41145443)
20. Sougne, J., P. 2001, "A learning algorithm for synfire chains" in Connectionist Models of Learning, Development and evolution, eds. R. M. French & J. P. Sougne, Springer Verlag, London, pp. 23-32.
21. Ruf, B. 1998, Computing and Learning with Spiking Neurons - Theory and Simulations, Institute for Theoretical Computer Sciences, Technische university Graz, Austria.
22. Ruf, B. & Schmitt, M. 1997, "Learning temporally encoded patterns in networks of spiking neurons", Neural Processing Letters, vol. 5, no. 1, pp. 9-18. (Pubitemid 127506036)
23. Legenstein, R., Naeger, C. & Maass, W. 2005, "What can a Neuron Learn with Spike-Timing-Dependent Plasticity?", Neural Computation, vol. 17, pp. 2337-2382. (Pubitemid 41337039)
24. Ponulak, F. 2005, ReSuMe - new supervised learning method for Siking Neural Networks, Institute of Control and Information Engineering, Poznan University of Technologh.
25. Ponulak, F. & Kasinski, A. 2005, "A novel approach towards movement control with Spiking Neural Networks", In Proc. of 3rd International Symposium on Adaptive Motion in Animals and MachinesIlmenau.
26. Kasinski, A.1. & Ponulak, F.1. 2005, "Experimental demonstration of learning properties of a new supervised learning method for the spiking neural networks", Proceedings, Part ISpringer-Verlag, Warsaw, Poland, pp. 145.
27. Strain, T. J., McDaid, L. J., Maguire, L. P. & McGinnity, T. M. 2006, "A supervised STDP based training algorithm with dynamic threshold neurons", International Joint Conference on Neural Networks 2006, IJCNN'06, Vancouver, BC, Canada, pp. 3409.
28. Florian, R., V. 2005, "A reinforcement learning algorithm for spiking neural networks", Proceedings of the Seventh International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC'05).
29. Florian, R., V. 2007, "Reinforcement Learning Through Modulation of Spike-Timing-Dependent Synaptic Plasticity ", Neural Comp., vol. 19, pp. 1468-1502.
30. Seung, H. S. 2003, "Learning in Spiking Neural Networks by Reinforcement of Stochastic Synaptic Transmission", Neuron, vol. 40, no. 6, pp. 1063-1073. (Pubitemid 38032784)
31. De Queiroz, M. S., de Berrêdo, R. C. & de Pádua Braga, A. 2006, "Reinforcement learning of a simple control task using the spike response model", Neurocomputing, vol. 70, no. 1-3, pp. 14-20.
32. Alnajjar, F. & Murase, K. 2006, "Use-dependent synaptic connection modification in SNN generating autonomous behavior in a Khepera mobile robot", 2006 IEEE Conference on Robotics, Automation and Mechatronic, pp. 4018757.
33. Amin, H. H. & Fujii, R. H. 2005b, "Sound classification and function approximation using spiking neural networks", International Conference on Intelligent Computing, ICIC 2005, Hefei, China, pp. 621.
34. Amin, H. H.1. & Fujii, R. H.1. 2005a, "Learning algorithm for spiking neural networks", Proceedings, Part I Springer-Verlag, Changsha, China, pp. 456.
35. Belatreche, A., Maguire, L., P., McGinnity, M. & Wu, Q. 2003, "A Method for Supervised Training of Spiking Neural Networks", In Proceedings of IEEE Cybernetics Intelligence - Challenges and Advances (CICA) Reading, UK, pp. 39-44.
36. González-Nalda, P. & Cases, B. 2008, "Topos: Spiking neural networks for temporal pattern recognition in complex real sounds", Neurocomputing, vol. 71, no. 4-6, pp. 721-732.
37. Pavlidis, N. G.1., Tasoulis, O. K.1., Plagianakos, V. P.1., Nikiforidis, G. & Vrahatis, M. N. 2005, "Spiking neural network training using evolutionary algorithms", Proceedings of the International Joint Conference on Neural Networks 2005IEEE, Montreal, Que., Canada, pp. 2190.
38. Johnston, S. P.1., Prasad, G.1., Maguire, L.1. & McGinnity, T. M.1. 2006, "A hybrid learning algorithm fusing STDP with GA based explicit delay learning for spiking neurons", 2006 3rd International IEEE Conference on Intelligent SystemsIEEE, London, UK, pp. 621.
39. Barber, D. 2003", Learning in spiking neural assemblies" in Advances in Neural Information Processing Systems 15, eds. S. Thrun S. Becker & K. Obermayer, MIT press edn, Cambrige MA, pp. 149-156.
40. Pfister, J., Barber, D. & Gerstner, W. 2003, "Optimal Hebbian Learning: A Probabilistic Point of View" in In ICANN/ICONIP 2003, volume 2714 of Lecture Notes in Computer Science, pp. 92-98.
41. Pfister, J., Toyoizumi, T., Barber, D. & Gerstner, W. 2005, "Optimal Spike-Timing Dependent Plasticity for Precise Action Potential Firing, 2005. arXiv:q-bio. NC/0502037. v1. 24 Febr. 2005.
42. Carnell, A. & Richardson, D. 2004, Linear Algebra for Time Series of Spikes.
43. Adibi, P.1., Meybodi, M. R. & Safabakhsh, R. 2005, "Unsupervised learning of synaptic delays based on learning automata in an RBF-like network of spiking neurons for data clustering", Neurocomputing, vol. 64, pp. 335-57. (Pubitemid 40425327)
44. Bi, G. 2002, "Spatiotemporal specificity of synaptic plasticity: cellular rules and mechanisms", Biological Cybernetics, vol. 87, pp. 319-332. (Pubitemid 135689594)
45. Bohte, S. M., Poutré, H. L. & Kok, J. N. 2002, "Unsupervised Clustering With Spiking Neurons By Sparse Temporal Coding and Multilayer RBF Networks", IEEE Trans. Neural Netw., vol. 13, no. 2, pp. 426-435. (Pubitemid 34475043)
46. Bonhoeffer, T., Staiger, V. & Abertsen, A. October 1989, "Synaptic plasticity in rat hippocampal slice culture: local 'hebbian' conjunction of pre-and postsynaptic stimulation leads to distributed synaptic enhancement", Proceedings of National Academy of Science USA, pp. 86:8113-8117.
47. Chechik, G. 2001, "Spike timing dependent plasticity and mutual information in spiking neurons", Neurocomputing, vol. 38-40, pp. 147-152. (Pubitemid 35276633)
48. Gerstner, W., Kempter, R., Hemmen, J.v. & Wagner, H. 1996, "A neuronal learning rule for sub-millisecond temporal coding", Nature, vol. 383, pp. 76-78. (Pubitemid 26296463)
49. Gerstner, W. & Kistler, w. 2002, "Mathematical formulations of Hebbian learning", Biological Cybernetics, vol. 87, pp. 404-415. (Pubitemid 135689601)
50. Gorchetchnikov, A. & Hasselmo, M. E. 2005, "A simple rule for spiketiming-dependent plasticity: local influence of AHP current", Neurocomputing, vol. 65-66, pp. 885-890. (Pubitemid 40613627)
51. Kepecs, A., Rossum, M.v., Song, S. & Tegner, J. 2002, "Spike-timingdependent plasticity: common themes and divergent vistas", Biological Cybernetics, vol. 87, no. 446, pp. 458.
52. Kistler, W. 2002, "Spike-timing dependent synaptic plasticity: a phenomenological framework", Biological Cybernetics, vol. 87, pp. 416-427. (Pubitemid 135689602)
53. Markram, H., Luebke, J. & Frotscher, B. S., M. 1997, "Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs", Science, vol. 275, pp. 213-215. (Pubitemid 27034762)
54. Sasaki, H. & Kubota, N. 2006, "Virus-evolutionary genetic algorithm for fuzzy spiking neural network PI of a mobile robot in a dynamic environment", SICE-ICASE International Joint Conference, Busan, South Korea, pp. 4214.
55. Schæfer, M., Schœnauer, T., Wolff, C., Hartmann, G., Klar, H. & Rückert, U. 2002, "Simulation of spiking neural networks - architectures and implementations", Neurocomputing, vol. 48, no. 1-4, pp. 647-679. (Pubitemid 36221520)
56. Wade, J. J., McDaid, L. J., Santos, J. A., Sayers, H. M. 2008, "SWAT: An unsupervised SNN training algorithm for classification problems", IEEE World Congress on Computational Intelligence, IJCNN 2008, pp. 2648-2655
57. Wysoski, S., Gomes, Benuskova, L. & Kasabov, N. 2006, "On-line Learning with Structural Adaptation in a Network of Spiking Neurons for Visual Pattern Recognition", Artificial Neural Networks - ICANN 2006, 16th International Conference, pp. 61-70. (Pubitemid 44561654)
58. Soltic, S., Wysoski, S. G. & Kasabov, N. K. 2008 "Evolving spiking neural networks for taste recognition", IEEE World Congress on Computational Intelligence, IJCNN 2008, pp. 2091-2097.
59. Alnajjar, F., Bin Mohd Zin, I., Murase, K. 2008, "A Spiking Neural Network with dynamic memory for a real autonomous mobile robot in dynamic environment", IEEE World Congress on Computational Intelligence, pp. 2207-2213.