Optimization methods for spiking neurons and networks

IEEE Transactions on Neural Networks

Volumn 21, Issue 12, 2010, Pages 1950-1962

  Russell, Alexander ^a   Orchard, Garrick ^a   Dong, Yi ^b   Mihalaş, Ştefan ^b   Niebur, Ernst ^b   Tapson, Jonathan ^c   Etienne Cummings, Ralph ^a  

^a Johns Hopkins University   (United States)

^b JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c UNIVERSITY OF CAPE TOWN   (South Africa)

Author keywords

Genetic algorithm; maximum likelihood; optimization; spiking neuron

Indexed keywords

ACTION POTENTIALS; HARDWARE IMPLEMENTATIONS; INTEGRATE AND FIRES; LARGE CIRCUITS; LOCOMOTION CONTROL; MAXIMUM LIKELIHOOD METHODS; NEURAL CIRCUITS; NEURON MODEL; NEUROPROSTHETICS; NON-LINEAR RELATIONSHIPS; OPTIMIZATION METHOD; RE-CONFIGURABLE; SINGLE NEURON; SINGLE-NEURON SYSTEMS; SOFTWARE SIMULATION; SPIKING NEURON; VERY LARGE SCALE INTEGRATION CHIPS; VISUAL SENSORY;

COMPUTER SOFTWARE; ELECTROPHYSIOLOGY; GENETIC ALGORITHMS; HARDWARE; LEARNING ALGORITHMS; LOCOMOTIVES; MAXIMUM LIKELIHOOD; OPTIMIZATION; RAILROAD CARS; RECONFIGURABLE HARDWARE; ROBOTICS; TIMING CIRCUITS;

NEURAL NETWORKS;

ACTION POTENTIAL; ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; COMPUTER SIMULATION; NERVE CELL; NONLINEAR SYSTEM; PHYSIOLOGY;

ACTION POTENTIALS; ALGORITHMS; COMPUTER SIMULATION; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONS; NONLINEAR DYNAMICS;

EID: 78650040575     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2010.2083685     Document Type: Article

References (44)

1. A. L. Hodgkin and A. F. Huxley, "A quantitative description of membrane current and its application to conduction and excitation in nerve," J. Physiol., vol. 117, no. 4, pp. 500-544, Aug. 1952.
2. C. Moris and H. Lecar, "Voltage oscillations in the barnacle giant muscle fiber," J. Biophys., vol. 35, no. 1, pp. 193-213, Jul. 1981.
3. E. Izhikevich, "Which neuron model to use?" IEEE Trans. Neural Netw., vol. 15, no. 5, pp. 1036-1070, Sep. 2004.
4. L. Paninski, J. W. Pillow, and E. P. Simoncelli, "Maximum likelihood estimation of a stochastic integrate-and-fire neural encoding model," Neural Comput., vol. 16, no. 12, pp. 2533-2561, Dec. 2004. (Pubitemid 39604009)
5. S. Mihalas and E. Niebur, "A generalized linear integrate-and-fire neural model produces diverse spiking behaviors," Neural Comput., vol. 21, no. 3, pp. 704-718, Mar. 2009.
6. S. G. Wysoski, L. Benuskova, and N. Kasabov, "Fast and adaptive network of spiking neurons for multi-view visual pattern recognition," Neurocomputing, vol. 71, nos. 13-15, pp. 2563-2575, Aug. 2008.
7. F. O. Folowosele, R. J. Vogelstein, and R. Etienne-Cummings, "Spikebased MAX network for nonlinear pooling in hierarchical vision processing," in Proc. IEEE Conf. Biomed. Circuits Syst., Montreal, QC, Canada, Nov. 2007, pp. 79-82.
8. V. Chan, A. van Schaik, and S. Liu, "Spike response properties of an AER EAR," in Proc. IEEE Int. Symp. Circuits Syst., Island of Kos, Greece, May 2006, pp. 859-862.
9. S. Bensmaia, S. S. Kim, A. Sripati, and R. J. Vogelstein, "Conveying tactile feedback using a model of mechanotransduction," in Proc. IEEE Conf. Biomed. Circuits Syst., Baltimore, MD, Nov. 2008, pp. 137-140.
10. M. A. Lewis, R. Etienne-Cummings, M. J. Hartmann, Z. R. Xu, and A. H. Cohen, "An in silico central pattern generator: Silicon oscillator, coupling, entrainment, and physical computation," Biol. Cybern., vol. 88, no. 2, pp. 137-151, Feb. 2003.
11. G. Cymbalyukand, G. Patel, R. Calabrese, S. DeWeerth, and A. Cohen, "Modeling alternation to synchrony with inhibitory coupling: A VLSI approach," Neural Comput., vol. 12, no. 10, pp. 2259-2278, Oct. 2000.
12. P. Arena, L. Fortuna, M. Frasca, and L. Patane, "A CNN-based chip for robot locomotion control," IEEE Trans. Circuits Syst. I, vol. 52, no. 9, pp. 1862-1871, Sep. 2005.
13. H. Inada and K. Ishii, "Bipedal walk using a central pattern generator," Int. Congr. Ser., vol. 1269, pp. 185-188, Aug. 2004.
14. A. Russell, G. Orchard, and R. Etienne-Cummings, "Configuring of spiking central pattern generator networks for bipedal walking using genetic algorithms," in Proc. IEEE Int. Symp. Circuits Syst., New Orleans, LA, May 2007, pp. 1525-1528.
15. A. F. Russell, G. Orchard, K. Mazurek, F. Tenore, and R. Etienne- Cummings, "Configuring silicon neural networks using genetic algorithms," in Proc. IEEE Int. Symp. Circuits Syst., Seattle, WA, May 2008, pp. 1048-1051.
16. H. de Garis, "Genetic programming: Modular neural evolution for Darwin machines," in Proc. IEEE Int. Joint. Conf. Neural Netw., Washington D.C., Jan. 1990, pp. 511-516.
17. M. A. Lewis, A. H. Fagg, and A. Solidium, "Genetic programming approach to the construction of a neural network for control of a walking robot," in Proc. IEEE Int. Conf. Robot. Autom., Nice, France, May 1992, pp. 2618-2623.
18. N. Oros, V. Steuber, N. Davey, L. Canamero, and R. Adams, "Evolution of bilateral symmetry in agents controlled by spiking neural networks," in Proc. IEEE Symp. Artif. Life, Nashville, TN, Apr. 2009, pp. 116-123.
19. Y. Jin, R. Wen, and B. Sendhoff, "Evolutionary multiobjective optimization of spiking neural networks," in Proc. 17th Int. Conf. Artif. Neural Netw., vol. 1. Porto, Portugal, Sep. 2007, pp. 370-379.
20. P. Arena, L. Fortuna, M. Frasca, and L. Patané, "Learning anticipation via spiking networks: Application to navigation control," IEEE Trans. Neural Netw., vol. 20, no. 2, pp. 202-216, Feb. 2009.
21. P. Rowcliffe and J. Feng, "Training spiking neuronal networks with applications in engineering tasks," IEEE Trans. Neural Netw., vol. 19, no. 9, pp. 1626-1640, Sep. 2008.
22. D. R. Ladle, E. Pecho-Vrieseling, and S. Arber, "Assembly of motor circuits in the spinal cord: Driven to function by genetic and experiencedependent mechanisms," Neuron, vol. 56, no. 2, pp. 270-283, Oct. 2007.
23. M. G. Hanson and L. T. Landmesser, "Characterization of the circuits that generate spontaneous episodes of activity in the early embryonic mouse spinal cord," J. Neurosci., vol. 23, no. 2, pp. 587-600, Jan. 2003.
24. L. D. Milner and L. T. Landmesser, "Cholinergic and GABAergic inputs drive patterned spontaneous motoneuron activity before target contact," J. Neurosci., vol. 19, no. 8, pp. 3007-3022, Apr. 1999.
25. S. Karlin and H. Taylor, A Second Course in Stochastic Processes. New York: Academic, 1981.
26. J. Tapson, C. Jin, A. van Schaik, and R. Etienne-Cummings, "A firstorder nonhomogeneous Markov model for the response of spiking neurons stimulated by small phase-continuous signals," Neural Comput., vol. 21, no. 6, pp. 1554-1588, Jun. 2009.
27. C. W. Gardiner, Handbook of Stochastic Methods for Physics, Chemistry and the Natural Sciences. Berlin, Germany: Springer-Verlag, 1985.
28. S. V. Patankar, Numerical Heat Transfer and Fluid Flow. New York: Taylor & Francis, 1980.
29. J. Crank and P. Nicolson, "A practical method for numerical evaluation of solutions of partial differential equations of the heat-conduction type," Math. Proc. Cambridge Philos. Soc., vol. 43, no. 1, pp. 50-67, 1947.
30. W. Gerstner and R. Naud, "How good are neuron models?" Science, vol. 326, no. 5951, pp. 379-380, Oct. 2009.
31. D. P. M. Northmore and J. G. Elias, "Evolving synaptic connections for a silicon neuromorph," in Proc. 1st IEEE Conf. Evol. Comput., vol. 2. Orlando, FL, Jun. 1994, pp. 753-758.
32. N. Kasabov, "Evolving intelligence in humans and machines: Integrative evolving connectionist systems approach," IEEE Comput. Intell. Mag., vol. 3, no. 3, pp. 23-37, Aug. 2008.
33. S. Wysoski, L. Benuskova, and N. Kasabov, "On-line learning with structural adaptation in a network of spiking neurons for visual pattern recognition," in Proc. ICANN, vol. 4131. Athens, Greece, Sep. 2006, pp. 61-70. (Pubitemid 44561654)
34. P. S. G. Stein, S. Grillner, A. I. Selverston, and D. G. Stuart, Neurons Networks and Motor Behavior. Cambridge, MA: MIT Press, 1997.
35. M. A. Lewis, F. Tenore, and R. Etienne-Cummings, "CPG design using inhibitory networks," in Proc. IEEE Int. Conf. Robot. Autom., Barcelona, Spain, Apr. 2005, pp. 3682-3687.
36. Z. Lu, S. Ma, B. Li, and Y. Wang, "Serpentine locomotion of a snakelike robot controlled by cyclic inhibitory CPG model," in Proc. IEEE Int. Conf. Intell. Robots Syst., Sha Tin, Hong Kong, China, Aug. 2005, pp. 96-101.
37. H. J. Chiel, R. D. Beer, and J. C. Gallagher, "Evolution and analysis of model CPGs for walking: I. Dynamical modules," J. Comput. Neurosci., vol. 7, no. 2, pp. 99-118, Sep.-Oct. 1999.
38. S. Still, B. Schöllkopf, K. Hepp, and R. J. Douglas, "Four-legged walking gait control using a neuromorphic chip interfaced to a support vector learning algorithm," Whistler, BC, Canada, Dec. 2000, pp. 741- 747.
39. D. Goldberg, Genetic Algorithms in Search Optimization and Machine Learning. Reading, MA: Addison-Wesley, 1989.
40. F. Tenore, R. Etienne-Cummings, and M. A. Lewis, "A programmable array of silicon neurons for the control of legged locomotion," in Proc. IEEE Int. Symp. Circuits Syst., Vancouver, BC, Canada, May 2004, pp. 349-352.
41. C. L. Vaughan, Dynamics of Human Gait. Champaign, IL: Human Kinetic, 1992.
42. G. Kumar, V. Aggarwal, N. V. Thakor, M. H. Schieber, and M. V. Kothare, "Optimal parameter estimation of the Izhikevich single neuron model using experimental inter-spike interval (ISI) data," in Proc. Amer. Control Conf., Baltimore, MD, Jul. 2010, pp. 3586-3591.
43. F. Folowosele, T. J. Hamilton, A. Harrison, A. Cassidy, A. G. Andreou, S. Mihalas, E. Niebur, and R. Etienne-Cummings, "A switched capacitor implementation of the generalized linear integrate-and-fire neuron," in Proc. IEEE Int. Symp. Circuits Syst., Tapei, Taiwan, May 2009, pp. 2149-2152.
44. J. D. Victor and K. P. Purpura, "Nature and precision of temporal coding in visual cortex: A metric-space analysis," J. Neurophys., vol. 76, no. 2, pp. 1310-1326, Aug. 1996.