Span: Spike pattern association neuron for learning spatio-temporal spike patterns

International Journal of Neural Systems

Volumn 22, Issue 4, 2012, Pages

  Mohemmed, Ammar ^a   Schliebs, Stefan ^a   Matsuda, Satoshi ^b   Kasabov, Nikola ^a,c  

^a AUCKLAND UNIVERSITY OF TECHNOLOGY   (New Zealand)

^b NIHON UNIVERSITY   (Japan)

^c Institute of Neuroinformatics Zurich   (Switzerland)

Author keywords

learning; spike pattern association; Spiking Neural Network; temporal coding

Indexed keywords

ANALOG SIGNALS; CLASSIFICATION PERFORMANCE; EXPERIMENTAL ANALYSIS; INHERENT COMPLEXITY; INPUT/OUTPUT; LEARNING; LEARNING CAPABILITIES; LEARNING PHASE; MATHEMATICAL OPERATIONS; MEMORY CAPACITY; SPATIO-TEMPORAL; SPATIOTEMPORAL INFORMATION; SPIKE PATTERNS; SPIKE TRAIN; SPIKING NEURAL NETWORKS; SPIKING NEURON; SYNAPTIC WEIGHT; TEMPORAL CODING;

INTELLIGENT AGENTS; MATHEMATICAL TRANSFORMATIONS; NEURAL NETWORKS; NEURONS;

LEARNING ALGORITHMS;

ACTION POTENTIAL; ALGORITHM; ANIMAL; ARTICLE; ARTIFICIAL INTELLIGENCE; BIOLOGICAL MODEL; LEARNING; NERVE CELL; NERVE CELL NETWORK; PHYSIOLOGY; TIME;

ACTION POTENTIALS; ALGORITHMS; ANIMALS; ARTIFICIAL INTELLIGENCE; ASSOCIATION LEARNING; MODELS, NEUROLOGICAL; NERVE NET; NEURONS; TIME FACTORS;

EID: 84864362117     PISSN: 01290657     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0129065712500128     Document Type: Article

References (62)

1. W. Gerstner and W. M. Kistler, Spiking Neuron Models: Single Neurons, Populations, Plasticity (Cambridge University Press, Cambridge, MA, 2002).
2. W. Maass, Networks of spiking neurons: The third generation of neural network models, Neural Networks 10(9) (1997) 1659-1671. (Pubitemid 28057273)
3. W. Maass and C. M. Bishop (eds.), Pulsed Neural Networks (MIT Press, Cambridge, MA, USA, 1999).
4. W. Maass, Computing with spiking neurons, in Pulsed Neural Networks (MIT Press, Cambridge, MA, USA, 1999), pp. 55-85.
5. S. Ghosh-Dastidar and H. Adeli, Spiking neural networks, Int. J. Neural Syst. 19(4) (2009) 295-308.
6. W. Maass and A. M. Zador, Dynamic stochastic synapses as computational units, Neural Comput. 11(4) (1999) 903-917.
7. M. Tsodyks, K. Pawelzik and H. Markram, Neural networks with dynamic synapses, Neural Comput. 10(4) (1998) 821-835. (Pubitemid 128463179)
8. S. M. Bohte, The evidence for neural information processing with precise spike-times: A survey, Nat. Comput. 3 (2004) 195-206. (Pubitemid 39127653)
9. R. VanRullen, R. Guyonneau and S. J. Thorpe, Spike times make sense, Trends Neurosci. 28(1) (2005) 1-4. (Pubitemid 40038795)
10. P. Tiesinga, J. Fellous and T. J. Sejnowski, Regulation of spike timing in visual cortical circuits, Nat. Rev. Neurosci. 9(2) (2008) 97-107.
11. D. A. Butts, C. Weng, J. Jin, C. Yeh, N. A. Lesica, J. Alonso and G. B. Stanley, Temporal precision in the neural code and the timescales of natural vision, Nature 449(7158) (2007) 92-95. (Pubitemid 47373774)
12. B. Szatmry and E. M. Izhikevich, Spike-timing theory of working memory, PLoS Comput. Biol. 6(8) (2010) 1-11.
13. J. Hopfield, Pattern recognition computation using action potential timing for stimulus representation, Nature 376 (1995) 33-36.
14. S. M. Bohte, J. N. Kok and J. A. L. Poutré, Errorbackpropagation in temporally encoded networks of spiking neurons, Neurocomputing 48(1-4) (2002) 17-37. (Pubitemid 36221486)
15. A. K. Vidybida, Testing of information condensation in a model reverberating spiking neural network, Int. J. Neural Syst. 21(3) (2011) 187-198.
16. N. Kasabov, R. Schliebs and H. Kojima, Probabilistic computational neurogenetic modelling: From cognitive systems to alzheimers disease, IEEE Trans. Auton. Mental Develop.
17. A. Jahangiri and D. M. Durand, Phase resetting analysis of high potassium epileptiform activity in ca3 region of the rat hippocampus, Int. J. Neural Syst. 21(2) (2011) 127-138.
18. N. R. Luque, J. A. Garrido, R. R. Carrillo, S. Tolu and E. Ros, Adaptive cerebellar spiking model embedded in the control loop: Context switching and robustness against noise, Int. J. Neural Syst. 21(5) (2011) 385-401.
19. U. R. Acharya, E. C. Chua, K. C. Chua, L. C. Min and T. Tamura, Analysis and automatic identification of sleep stages using higher order spectra, Int. J. Neural Syst. 20(6) (2010) 509-521.
20. J. Iglesias and A. E. P. Villa, Emergence of preferred firing sequences in large spiking neural networks during simulated neuronal development, Int. J. Neural Syst. 18(4) (2008) 267-277.
21. M. O'Halloran, B. McGinley, R. C. Conceicao, F. Morgan, E. Jones and M. Glavin, Spiking neural networks for breast cancer classification in a dielectrically heterogeneous breas, Prog. Electromagn. Res. C 113 (2011) 413-428.
22. T. J. Strain, L. J. McDaid, T. M. McGinnity, L. P. Maguire and H. M. Sayers, An stdp training algorithm for a spiking neural network with dynamic threshold neurons, Int. J. Neural Syst. 20(6) (2010) 463-480.
23. S. G.Wysoski, L. Benuskova and N. Kasabov, Evolving spiking neural networks for audiovisual information processing, Neural Networks 23 (2010) 819-835.
24. S. Ghosh-Dastidar and H. Adeli, A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection, Neural Networks 22(10) (2009) 1419-1431.
25. J. Peandrez-Carrasco, C. Serrano, B. Acha, T. Serrano-Gotarredona and B. Linares-Barranco, Spike-based convolutional network for real-time processing, in Proc. 2010 20th Int. Conf. Pattern Recognition, ICPR '10 (IEEE Computer Society, Washington, DC, USA, 2010), pp. 3085-3088.
26. S. Soltic and N. K. Kasabov, Knowledge extraction from evolving spiking neural networks with rank order population coding, Int. J. Neural Syst. 20(6) (2010) 437-445.
27. S. P. Johnston, G. Prasad, L. Maguire and T. M. McGinnity, An fpga hardware/software codesign towards evolvable spiking neural networks for robotics application, Int. J. Neural Syst. 20(6) (2010) 447-461.
28. E. Nichols, L. J. McDaid and N. H. Siddique, Case study on a self-organizing spiking neural network for robot navigation, Int. J. Neural Syst. 20(6) (2010) 501-508.
29. I. Uysal, H. Sathyendra and J. Harris, Towards spike-based speech processing: A biologically plausible approach to simple acoustic classification, Int. J. Appl. Math. Comput. Sci. 18 (2008) 129-137.
30. S. Deneve, Bayesian spiking neurons i: Inference, Neural Comput. 20(1) (2008) 91-117.
31. S. Ghosh-Dastidar and H. Adeli, Improved spiking neural networks for eeg classification and epilepsy and seizure detection, Integrated. Comput.-Aided Eng. 14 (2007) 187-212. (Pubitemid 47191475)
32. L. Bako, Real-time classification of datasets with hardware embedded neuromorphic neural networks, Brief. Bioinform. 11(3) (2010) 348-363.
33. W. Maass, T. Natschläger and H. Markram, Realtime computing without stable states: A new framework for neural computation based on perturbations, Neural Comput. 14(11) (2002) 2531-2560.
34. S. J. Thorpe, R. Guyonneau, N. Guilbaud, J.-M. Allegraud and R. VanRullen, SpikeNet: real-time visual processing with one spike per neuron, Neurocomputing 58-60 (2004) 857-864. (Pubitemid 38684343)
35. S. M. Bohte, J. N. Kok and J. A. L. Poutré, Spike-Prop: backpropagation for networks of spiking neurons, in ESANN (2000), pp. 419-424.
36. D. E. Rumelhart, G. E. Hinton and R. J. Williams, Learning representations by back-propagating errors, Nature 323 (1986) 533-536. (Pubitemid 16025374)
37. J. Xin and M. Embrechts, Supervised learning with spiking neural networks, Int. Joint Conf. Neural Networks, IJCNN '01, Vol. 3 (IEEE Press, 2001), pp. 1772-1777. (Pubitemid 32805167)
38. B. Schrauwen and J. van Campenhout, Improving SpikeProp: Enhancements to an error-backpropagation rule for spiking neural networks, Proc. 15th ProRISC Workshop (2004).
39. R. Gutig and H. Sompolinsky, The tempotron: A neuron that learns spike timing-based decisions, Nat. Neurosci. 9(3) (2006) 420-428. (Pubitemid 43290972)
40. F. Ponulak and A. Kasiński, Supervised learning in spiking neural networks with ReSuMe: Sequence learning, classification, and spike shifting, Neural Comput. 22(2) (2010) 467-510.
41. R. V. Florian, The chronotron: A neuron that learns to fire temporally-precise spike patterns (2010) http://precedings.nature.com/documents/ 5190/ version/1.
42. F. Ponulak, ReSuMe -new supervised learning method for spiking neural networks, Technical report, Institute of Control and Information Engineering, Poznań University of Technology, Poznań, Poland (2005).
43. R. Legenstein, C. Naeger and W. Maass, What can a neuron learn with spike-timing-dependent plasticity? Neural Comput. 17(11) (2005) 2337-2382. (Pubitemid 41337039)
44. C. Bell, V. Z. Han, Y. Sugawara and K. Grant, Synaptic plasticity in a cerebellum-like structure depends on temporal order, Nature 387 (1997) 278-281. (Pubitemid 27220761)
45. B. Widrow and M. Lehr, 30 years of adaptive neural networks: Perceptron, madaline, and backpropagation, Proc. IEEE 78(9) (1990) 1415-1442.
46. F. Ponulak and A. Kasinski, ReSuMe learning method for spiking neural networks dedicated to neuroprostheses control, Proc. EPFL LATSIS Symposium 2006, Dynamical Principles for Neuroscience and Intelligent Biomimetic Devices, Lusanne, Switzerland (2006) 119-120.
47. R. V. Florian, Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity, Neural Comput. 19(6) (2007) 1468-1502.
48. J. D. Victor and K. P. Purpura, Metric-space analysis of spike trains: Theory, algorithms and application, Network: Comput. Neural Syst. 8(2) (1997) 127-164. (Pubitemid 127719538)
49. M. C. van Rossum, A novel spike distance, Neural Comput. 13(4) (2001) 751-763. (Pubitemid 33594302)
50. A. Mohemmed, S. Schliebs, S. Matsuda, K. Dhoble and N. Kasabov, Optimization of spiking neural networks with dynamic synapses for spike sequence generation using PSO, in Int. Joint Conf. Neural Networks, IJCNN 2011, San Jose, California, USA (2011) IEEE Press, 2969-2974.
51. A. Mohemmed, S. Schliebs, S. Matsuda and N. Kasabov, Method for training a spiking neuron to associate input-output spike trains, to appear in Engineering Applications of Neural Networks, EANN 2011 (Springer Verlag, Corfu, Greece, 2011).
52. E. Nordlie, M.-O. Gewaltig and H. E. Plesser, Towards reproducible descriptions of neuronal network models, PLoS Comput. Biol. 5(8) (2009) e1000 456.
53. M.-O. Gewaltig and M. Diesmann, Nest (neural simulation tool), Scholarpedia 2(4) (2007) 1430.
54. B. Schrauwen and J. V. Campenhout, Linking nonbinned spike train kernels to several existing spike train metrics, Neurocomputing 70 (2007) 1247-1253. (Pubitemid 46336787)
55. F. Ponulak, Analysis of the resume learning process for spiking neural networks, Appl. Math. Comput. Sci. 18(2) (2008) 117-127.
56. A. Mohemmed and N. Kasabov, Incremental learning algorithm for spike pattern classification, WCCI 2012 IEEE World Congress on Computational Intelligence, June 10-15, 2012 (Brisbane, Australia, 2012), pp. 1227-1232.
57. N. Kasabov, To spike or not to spike: A probabilistic spiking neuron model, Neural Netw. 23(1) (2010) 16-19.
58. N. Kasabov, Evolving spiking neural networks and neurogenetic systems for spatio-and spectrotemporal data modelling and pattern recognition, IEEE WCCI 2012, LNCS, Vol. 7311, eds. J. Liu et al. (Springer-Verlag, Berlin, Heidelberg, 2012), pp. 234-260.
59. K. Dhoble, N. Nuntalid, G. Indivery and N. Kasabov, On-line spatiotemporal pattern recognition with evolving spiking neural networks utilising address event representation, rank oder-and temporal spike learning, WCCI 2012 IEEE World Congress on Computational Intelligence, June 10-15, 2012 (Brisbane, Australia, 2012), pp. 554-560.
60. X. Wang, Z. G. Hou, A. Zou, M. Tan and L. Cheng, A behavior controller for mobile robot based on spiking neural networks, Neurocomputing 71(4-6) (2008) 655-666. (Pubitemid 351168455)
61. S. Moradi and G. Indiveri, A VLSI network of spiking neurons with an asynchronous static random access memory, in Biomedical Circuits and Systems Conference BIOCAS (IEEE Press, 2011).
62. G. Indiviery and T. Horiuchi, Frontiers in neuromorphic engineering, Frontiers in Neuroscience 5 (2011) 118.