Supervised learning of logical operations in layered spiking neural networks with spike train encoding

Neural Processing Letters

Volumn 36, Issue 2, 2012, Pages 117-134

  Grüning, André ^a   Sporea, Ioana ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

Logical operation; Spike trains; Spiking neural networks; Supervised learning

Indexed keywords

COMPUTATIONAL PROPERTIES; EXCLUSIVE-OR; HIDDEN LAYERS; INPUT AND OUTPUTS; LAYERED NETWORK; LAYERED NEURAL NETWORK; LOGICAL OPERATIONS; SPIKE TRAIN; SPIKING NEURAL NETWORKS;

LEARNING ALGORITHMS; NETWORK LAYERS; SUPERVISED LEARNING;

NEURAL NETWORKS;

EID: 84867232380     PISSN: 13704621     EISSN: 1573773X     Source Type: Journal    
DOI: 10.1007/s11063-012-9225-1     Document Type: Article

References (35)

1. Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw 5(2):157-166
2. BodénM,Wiles J (2000) Context-free and context-sensitive dynamics in recurrent neural networks. Connect Sci 12(3/4):197-210
3. Bohte S, Kok J, Poutré HL (2002) Spike-prop: error-backpropagation in multi-layer networks of spiking neurons. Neurocomputing 48(1-4):17-37
4. Booij O, tat Nguyen H (2005) A gradient descent rule for spiking neurons emitting multiple spikes. Inf Process Lett 95:552-558
5. Enderton H (2001) A mathematical introduction to logic, 2nd edn. Academic Press, Boston
6. Gerstein GL, Kirkland KL (2001) Neural assemblies: technical issues, analysis, and modeling. Neural Netw 14(6-7). doi:10.1016/S0893-6080(01)00042-9
7. Gerstner W, KistlerW (2002) Spiking neuronmodels: single neurons, populations, plasiticity. Cambridge University Press, Cambridge
8. Glackin C, Maguire L, McDaid L, Sayers H (2011) Repective field optimisation and supervision of a fuzzy spiking neural network. Neural Netw 24:247-256
9. Grüning A (2006) Stack- and queue-like dynamics in recurrent neural networks.Connect Sci 18(1):23-42
10. Izhikevich EM (2007) Solving the distal reward problem through linkage of STDP and Dopamine signalling. Cereb Cortex 17:2443-2452. doi:10.1093/cercor/ bhl152
11. Kasínski A, Ponulak F (2006) Comparison of supervised learning methods for spike time coding in spiking neural networks. Int J Appl Math Comput Sci 16(1):101-113
12. Kasínski A, Ponulak P (2005) Experimental demonstration of learning properties of a new supervised learning method for the spiking neural networks. In: Proceedings of the 15th international conference on artificial neural networks: biological inspirations, Lecture Notes in Computer Sciences, vol 3696, pp 145-153
13. Kistler W, van Hemmen LJ (2000) Modeling synaptic plasticity in conjunction with the timing of preand postsynaptic action potentials. Neural Comput 12:385-405
14. Legenstein R, Naeger C, MaassW (2005) What can a neuron learn with spike-timing-dependent plasticity?. Neural Comput 17(11):2337-2382
15. Legenstein R, Pecevski D, MaassW (2008) A learning theory for reward-modulated spike-timing-dependent plasticity with application to biofeedback. PLoS Comput Biol 3(10):1-27
16. MaassW,Natschläger T, MarkramH (2002) Real-time computingwithout stable states: a newframework for neural computation based on perturbations. Neural Comput 14(11):2531-2560
17. Minsky M, Papert S (1988) Perceptrons: an introduction to computational geometry, expanded edn. MIT Press, Cambridge
18. Nemenman I, Lewen GD, BialekW, de Ruyter van Steveninck RR (2008) Neural coding of natural stimuli: information at sub-millisecond resolution. PLOS Comput Biol 4(3): el000025. doi:10.1371/journal. pcbi.1000025
19. Okun M, Lampl I (2009) Balance of excitation and inhibition. Scholarpedia 4(8):7467. doi:10.4249/ scholarpedia.7467
20. Pfister JP,GerstnerW (2006) Triplets of spikes in amodel of spike timing-dependent plasticity. J Neurosci 26(38):9673-9682. doi:10.1523/JNEUROSCI. 1425-06.2006
21. Polikar R (2006) Ensemble based systems in decision making. IEEE Circuits Syst Mag 6(3):21-45
22. Ponulak F (2008) Analysis of the ReSuMe learning process for spiking neural networks. Int J Appl Math Comput Sci 18(2):117-127. doi:10.2478/v10006- 008-0011-1
23. Ponulak F, Kasínski A (2010) Supervised learning in spiking neural networks with ReSuMe: sequence learning, classification and spike shifting. Neural Comput 22:467-510
24. Rodriguez P (2001) Simple recurrent networks learn context-free and context-sensitive languages by counting. Neural Comput 13:2093-2118
25. Rojas R (1996) Neural networks - a systematic introduction. Springer, Berlin
26. Rostro-Gonzalez H, Vasquez-Betancour JC, Cessac B, Viéville T (2010) Reverse-engineering in spiking neural network parameters: exact determinisitc parameter estimation. Tech. rep., INRIA Sophia Antipolis
27. Rumelhart DE, Hinton GE, Williams RJ (1986) Learning internal representations by error propagation. In: Rumelhart DE, McClelland JL, et al (eds) Parallel distributed processing - explorations in the microstructure of cognition, vol 1 - foundations, MIT Press, Cambridge, Chap. 8, pp 318-362
28. Schrauwen B, Campenhout JV (2004) Extending SpikeProp. In: Proceedings of the international joint conference on neural networks (IJCNN), pp 471-476
29. Shepard JD, Rumbaugh G, Wu J, Chowdhiry S, Plath N, Kuhl D, Huganir RL, Worley PF (2009) Arc mediates homoestatic synaptic scaling of ampa receptors. Neuron 52(3):475-484
30. SiegelmannHT, SontagED (1995) On the computational power of neural nets. J Comput Syst Sci 50:132- 150
31. Sporea I, Grüning A (2011) Reference time in SpikeProp. In: Proceedings of the international joint conference on neural networks (IJCNN), IEEE, San Jose, CA
32. Takase H, Fujita M, Kawanaka H, Tsuruoka S, Kita H, Hayashi T (2009) Obstacle to training SpikeProp networks - cause of surges in the training process. In: Proceedings of IEEE international joint conference on neural networks (IJCNN), Atlanta
33. Tiňno P, Mills AJ (2006) Learning beyond finite memory in recurrent networks of spiking neurons. Neural Comput 18(3):591-613
34. van Rossum MCW (2001) A novel spike distance. Neural Computation 13:751-763
35. Wade JJ, McDaid LJ, Santos JA, Sayers HM (2010) Swat: a spiking neural network training algorithm for classification problems. IEEE Trans Neural Netw 21(11):1817-1829