Hebbian learning with winner take all for spiking neural networks

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2009, Pages 1054-1060

  Gupta, Ankur ^a   Long, Lyle N ^b  

^a The Center for Nanotechnology Education and Utilization   (United States)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BACKPROPAGATION LEARNING ALGORITHM; COMPETITIVE LEARNING; GABOR FILTER; HEBBIAN LEARNING; LEARNING METHODS; MAMMALIAN BRAIN; OBJECT-ORIENTED CODE; OUTPUT NEURONS; SPIKING NEURAL NETWORKS; SPIKING NEURON; SYNAPTIC MODIFICATION; SYNAPTIC WEIGHT; TEST SETS; TUNING CURVE; WINNER TAKE ALLS;

BELLS; BODY FLUIDS; EDUCATION; MAMMALS; NEURAL NETWORKS; NEURONS;

LEARNING ALGORITHMS;

EID: 70449421908     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2009.5178751     Document Type: Conference Paper

References (46)

1. J. Vreeken, "Spiking neural networks, an introduction, " Institute for Information and Computing Sciences, Utrecht University Technical Report UU-CS-2003-008, 2002.
2. T. Natschlager and B. Ruf, "Spatial and temporal pattern analysis via spiking neurons, "Network: Comput. Neural Syst., vol. 9, pp. 319-332, 1998.
3. C. Panchev and S. Wermter, "Spike timing dependent synaptic plasticity: from single spikes to spike trains, " Neurocomputing, vol. 58-60, pp. 365-371, 2004.
4. C. Panchev and S. Wermter, "Temporal sequence detection with spiking neurons: Towards recognizing robot language instruction, " Connection Science, vol. 18, pp. 1-22, 2006.
5. C. Panchev, "Spatio-temporal and multimodal processing in a spiking neural mind of a robot, " Ph. D. dissertation, University of Sunderland, United Kingdom, May 2005.
6. A. R. Baig, "Spatial-temporal artificial neurons applied to online cursive handwritten character recognition, " in European Symposium on Artificial Neural Networks, Bruges (Belgium), April 2004, pp. 561- 566.
7. A. Gupta and L. N. Long, "Character recognition using spiking neural networks, " in International Joint Conference on Neural Networks, August 2007, pp. 53-58.
8. T. Masquelier and S. J. Thorpe, "Unsupervised Learning of Visual Features through Spike Timing Dependent Plasticity, " PLoS Comput Biol, vol. 3, pp. 247-57, 2007.
9. BRAIN, Available: http://brain. unr.edu/ncsDocs/
10. GENESIS, Available: http://www.genesis-sim.org/GENESIS/
11. NEURON, Available: http://www.neuron. valc.edu/ncuron/
12. R. Brette and e. al, "Simulation of networks of spiking neurons: A review of tools and strategies, " Journal of computational neuroscience, 2006.
13. SPIKENET, Available: http://www.sccn. ucsd.edu/~arno/spikenet/
14. SPIKENET TECH, Available: http://www.spikenet-technology.com/
15. R. Van Rullen, J. Gautrais, A. Delorme, and S. Thorpe, "Face processing using one spike per neurone, " Biosystems, vol. 48, pp. 229- 239, 1998.
16. L. N. Long and A. Gupta, "Scalable massively parallel artificial neural networks, " Journal of Aerospace Computing, Information, and Communication, vol. 5, 2008.
17. P. Werbos, The Roots of Backpropagation: From Ordered Derivatives to Neural Networks and Political Forecasting. New York: John Wiley & Sons, 1994.
18. B. Berninger and G. Q. Bi, "Synaptic modification in neural circuits:a timely action, " BioEssays, vol. 24, pp. 212-222, 2002.
19. Y. Dan and M. Poo, "Spike time dependent plasticity of neural circuits, " Neuron, vol. 44, pp. 23-30, 2004.
20. S. Song, K. D. Miller, and L. F. Abbott, "Competitive Hebbian learning through spike-timing-dependent synaptic plasticity, " vol. 3, pp. 919-926, 2000.
21. L. N. Long and A. Gupta, "Biologically-Inspired Spiking Neural Networks with Hebbian Learning for Vision Processing, " in 46th AIAA Aerospace Sciences Meeting, Reno, NV, 2008.
22. L. N. Long, "Scalable Biologically Inspired Neural Networks with Spike Time Based Learning, " in Invited Paper, IEEE Symposium on Learning and Adaptive Behavior in Robotic Systems, Edinburgh Scotland, 2008.
23. A. L. Hodgkin and A. F. Huxley, "A quantitative description of ion currents and its applications to conduction and excitation in nerve membranes, " Journal of Physiology, vol. 117, pp. 500-544, 1952.
24. W. Gerstner and W. M. Kistler, Spiking Neuron Models: Single Neurons, Populations, Plasticity: Cambridge University Press, 2002.
25. E. M. Izhikevich, "Which model to use for cortical neurons?, " IEEE transactions on neural networks, vol. 15, 2004.
26. D. O. Hebb, The Organization of Behavior: A Neuropsychological Theory: Erlbaum Pub., 1949.
27. G.-q. Bi and M.-m. Poo, "Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type, " Journal of Neuroscience, vol. 18, pp. 10464-72, 1998.
28. L. I. Zhang, H. W. Tao, C. E. Holt, W. A. Harris, and M.-m. Poo, "A critical window for cooperation and competition among developing retinotectal synapses, " vol. 395, pp. 37-44, 1998.
29. W. B. Levy and O. Steward, "Temporal contiguity requirements for long-term associative potentiation/depression in the hippocampus, " Neuroscience, vol. 8, pp. 791-97, 1983.
30. H. Markram, J. Lubke, M. Frotscher, and B. Sakmann, "Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs, " Science, vol. 275, pp. 213-15, 1997.
31. P. Földiák, "Forming sparse representations by local anti-Hebbian learning, " Biol. Cybern., vol. 64, pp. 165-170, 1990.
32. D. J. Field, Scale-invariance and self similar "wavelet" transforms: An analysis of natural scenes and mammalian visual systems. Oxford, England: Oxford University Press, 1993.
33. D. J. Field, "What is the goal of sensory coding?, " Neural Computation, vol. 6, pp. 559-601, 1994.
34. D. I. Perrett, E. T. Rolls, and W. Caan, "Visual neurons responsive to faces in the monkey temporal cortex, " Exp. Brain Research, vol. 47, pp. 329-342, 1982.
35. W. Maass, "Neural Computation with Winner-Take-All as the only Nonlinear Operation, " in Advances in Neural Information Processing Systems, 1999.
36. J. Lazzaro, S. Ryckebusch, M. A. Mahowald, and C. A. Mead, "Winner-take-all networks of O (N) complexity, " in Advances in Neural information Processing Systems, San Francisco, CA, 1989, pp. 703-771.
37. D. Z. Jin and H. S. Seung, "Fast computation with spikes in a recurrent neural network, " Phys Rev E Stat Nonlin Soft Matter Phys, vol. 65, p. 051922, 2002.
38. M. Oster and S. C. Liu, "A Winner-take-all Spiking Network with Spiking Inputs, " in 11th IEEE International Conference on Electronics, Circuits and Systems (ICECS) pp. 203- 206, 2004.
39. R. J. Douglas and K. A. C. Martin, Neuronal Circuits of the Neocortex vol. 27, 2004.
40. D. Yang, C++ and Object-oriented Numeric Computing for Scientists and Engineers. New York: Springer, 2001.
41. IBM Roadrunner, Available: http://www.lanl.gov/orgs/hpc/roadrunncr
42. G. N. Henry, P. O. Bishop, R. M. Tupper, and B. Dreher, "Orientation specificity and response variability of cells in the striate cortex, " Vision Research, vol. 13, pp. 1771-1779, 1973.
43. D. H. Hubel and T. N. Wiesel, "Receptive fields and functional architecture of monkey striate cortex, " Journal of Physiology, vol. 195, pp. 215-243, 1968.
44. D. H. Hubel and T. N. Wiesel, "Receptive fields of single neurons in the cat's striate cortex, " Journal of Physiology, vol. 148, pp. 574-591, 1959.
45. A. Georgopoulos, J. Kalaska, R. Caminiti, and J. Massey, "On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex, " J. Neurosci, vol. 2, pp. 1527-1537, 1982.
46. J. H. Maunsell and D. C. Van Essen, "Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation, " J Neurophysiol, vol. 49, pp. 1127-1147, 1983.