Supervised learning in multilayer spiking neural networks

Neural Computation

Volumn 25, Issue 2, 2013, Pages 473-509

  Sporea, Ioana ^a   Grüning, André ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ANIMAL; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; HUMAN; LETTER; NERVE CELL; PHYSIOLOGY;

ALGORITHMS; ANIMALS; HUMANS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONS;

EID: 84877839888     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00396     Document Type: Letter

References (48)

1. Bohte, S. (2011). Error-backpropagation in networks of fractionally predictive spiking neurons. In Proceedings of the 21th International Conference on Artificial Neural Networks (pp. 60-68). Berlin: Springer-Verlag.
2. Bohte, S., Kok, J., & Poutré, H. L. (2002). Error backpropagation in temporally encoded networks of spiking neurons. Neurocomputing, 48, 17-37.
3. Bohte, S., & Rombouts, J. (2010). Fractionally predictive spiking neurons. In J. Lafferty, C.K.I. Williams, J. Shawe-Taylor, R. S. Zemel, & A. Culotta (Eds.), Advances in neural information processing, systems, 23 (pp. 253-261). Red Hook, NY: Curran.
4. Booij, O., & Nguyen, H. (2005). A gradient descent rule for spiking neurons emitting multiple spikes. Information Processing Letters, 95, 552-558.
5. deCharms, R. C., & Merzenich, M. M. (1996). Primary cortical representation of sounds by the coordination of action-potential timing. Nature, 381, 610-613.
6. Elias, J. G., & Northmore, D.P.M. (2002). Building silicon nervous systems with dendritic tree neuromorphs. In W. Maass & C. M. Bishop (Eds.), Pulsed neural networks. Cambridge, MA: MIT Press.
7. Fisher, R. A. (1936). The use of multiple Measurements in taxonomic problems. Annals of Eugenics, 7, 179-188.
8. Fitzsimonds, R. M., Song, H., & Poo, M. (1997). Propagation of activity dependent synaptic depression in simple neural networks. Nature, 388, 439-448.
9. Fujita, M., Takase, H., Kita, H., & Hayashi, T. (2008). Shape of error surfaces in SpikeProp. In Proceedings of IEEE International Joint Conference on Neural Networks (pp. 840-844). Piscataway, NJ: IEEE.
10. Gerstner, W. (2001). A framework for spiking neuron models: The spike response model. In F. Moss & S. Gielen (Eds.), The handbook of biological physics, Vol. 4 (pp. 469-516). Amsterdam: North-Holland.
11. Gerstner,W.,&Kistler,W.M. (2002). Spiking neuron models: Single neurons, populations, plasticity. Cambridge: Cambridge University Press.
12. Ghosh-Dastidar, S., & Adeli, H. (2009). A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection. Neural Networks, 22, 1419-1431.
13. Glackin, C.,Maguire, L., McDaid, L.,&Sayers, H. (2011).Receptive field optimisation and supervision of a fuzzy spiking neural network. Neural Networks, 24, 247-256.
14. Grüning, A. (2007). Elman backpropagation as reinforcement for simple recurrent networks. Neural Computation, 19, 3108-3131.
15. Grüning, A., & Sporea, I. (2012). Supervised learning of logical operations in layered spiking neural networks with spike train encoding. Neural Processing Letters, 36, 117-134. doi:10.1007/s11063-012-9225-1.
16. Gütig, R., & Sompolinsky, H. (2006). The tempotron: A neuron that learns spike timing-based decisions. Nature Neuroscience, 9, 420-428.
17. Harris, K. D. (2008). Stability of the fittest: Organizing learning through retroaxonal signals. Trends in Neuroscience, 31, 130-136.
18. Hebb, D. O. (1949). The organization of behavior. NewYork: Wiley.
19. Johansson, R. S., & Birznieks, I. (2004). First spikes in ensembles of human tactile afferents code complex spatial fingertip events. Nature Neuroscience, 7, 170-177.
20. Legenstein, R., Naeger, C., & Maass,W. (2005).What can a neuron learn with spiketiming- dependent plasticity? Neural Computation, 17, 2337-2382.
21. Knudsen, E. I. (1994). Supervised learning in the brain. Journal of Neuroscience, 14, 3985-3997.
22. Knudsen, E. I. (2002). Instructed learning in the auditory localization pathway of the barn owl. Nature, 417(6886), 322-328.
23. Maass, W. (1997a). Networks of spiking neurons: The third generation of neural network models. Transactions of the Society for Computer Simulation International, 14, 1659-1671.
24. Maass,W. (1997b). Fast sigmoidal networks via spiking neurons. Neural Computation, 9, 279-304.
25. Mauk, M. D., & Buonomano, D. V. (2004). The neural basis of temporal processing. Annual Rev. Neuroscience, 27, 304-340.
26. McKennoch, S., Voegtlin, T., & Bushnell, L. (2009). Spike-timing error backpropagation in theta neuron networks. Neural Computation, 21, 9-45.
27. Neuenschwander, S., & Singer,W. (1996). Long-range synchronization of oscillatory light responses in the cat retina and lateral geniculate nucleus. Nature, 379, 728- 733.
28. Ponulak, F. (2006). ReSuMe-Proof of convergence. http://d1.cie.put.poznan.pl/dav/fp/FP_ConvergenceProof_TechRep.pdf
29. Ponulak, F. (2008). Analysis of the ReSuMe learning process for spiking neural networks. International Journal of Applied Mathematics and Computer Science, 18, 117-127.
30. Ponulak, F., & Kasiński, A. (2010). Supervised learning in spiking neural networks with ReSuMe: Sequence learning, classification, and spike shifting. Neural Computation, 22, 467-510.
31. Roelfsema, P. R., & van Ooyen, A. (2005). Attention-gated reinforcement learning of internal representations for classification. Neural Computation, 17, 1-39.
32. Rojas, R. (1996). Neural networks: A systematic introduction. Berlin: Springer-Verlag.
33. Rostro-Gonzalez, H., Vasquez-Betancour, J. C., Cessac, B., & Viéville, T. (2010). Reverse-engineering in spiking neural network parameters: Exact deterministic parameter estimation. Sophia Antipolis, France: INRIA.
34. Ruf, B., & Schmitt, M. (1997). Learning temporally encoded patterns in networks of spiking neurons. Neural Processing Letters, 5(1), 9-18.
35. Rumelhart, D. E., Hinton, G. E.,&Williams, R. J. (1986). Learning internal representations by error propagation. In D. E. Rumelhart & J. L. McClelland (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition. Cambridge, MA: MIT Press.
36. Schrauwen, B., & van Campenhout, J. (2004). Improving spike-prop: Enhancements to an error-backpropagation rule for spiking neural networks. In Proceedings of the 15th ProRISC Workshop.
37. Shepard, J. D., Rumbaugh, G., Wu, J., Chowdhiry, S., Plath, N., Kuhl, D., et al. (2006). Arc mediates homoeostatic synaptic scaling of AMPA receptors. Neuron, 52, 475-484.
38. Sporea, I., & Grüning, A. (2011). Reference time in SpikeProp. In Proceedings of IEEE International Joint Conference Neural Networks (pp. 1090-1092). Piscataway, NJ: IEEE.
39. Takase, H., Fujita, M., Kawanaka, H., Tsuruoka, S., Kita, H., & Hayashi, T. (2009). Obstacle to training SpikeProp networks: Cause of surges in training process. In Proceedings of IEEE International Joint Conference Neural Networks (pp. 3062-3066). Piscataway, NJ: IEEE.
40. Tao, H.W., Zhang, L. I, Bi, G. Q., & Poo, M. (2000). Selective presynaptic propagation of long-term potentiation in defined neural Networks. Journal of Neuroscience, 20, 3233-3243.
41. Thorpe, S. T., & Imbert, M. (1989). Biological constraints on connectionistmodelling. In , R. Pfeifer, Z. Schreter, F. Fogelman-Souli, & L. Steels (Eds.), Connectionism in perspective (pp. 63-92). New York: Elsevier Science.
42. Tiňo, P., & Mills, A. J. (2005). Learning beyond finite memory in recurrent networks of spiking neurons. In L. Wang, K. Chen, & Y. Ong (Eds.), Advances in natural computation (pp. 666-675). Berlin: Springer-Verlag.
43. Urbanczik, R., & Senn, W. (2009). Reinforcement learning in populations of spiking neurons. Nature Neuroscience, 12, 250-252.
44. van Rossum, M. C. (2001). A novel spike distance. Neural Computation, 13, 751-763.
45. Wade, J. J., McDaid, L. J., Santos, J. A., & Sayers, H. M. (2010). SWAT: A spiking neural network training algorithm for classification problems. IEEE Transactions on Neural Networks, 21, 1817-1829.
46. Watt, A. J., & Desai, N. S. (2010). Homeostatic plasticity and STDP: Keeping a neuron's cool in a fluctuating world. Frontiers in Synaptic Neuroscience, 2(5).
47. Wehr, M., & Laurent, G. (1996). Odour encoding by temporal sequences of firing in oscillating neural assemblies. Nature, 384, 162-166.
48. Xin, J.,&Embrechts,M. J. (2001). Supervised learning with spiking neuron networks. In Proceedings of IEEE International Joint Conference Neural Networks (pp. 1772- 1777). Piscataway, NJ: IEEE.