Hardware implementation of a bio-plausible neuron model for evolution and growth of spiking neural networks on FPGA

Proceedings of the 2008 NASA/ESA Conference on Adaptive Hardware and Systems, AHS 2008

Volumn , Issue , 2008, Pages 236-243

  Shayani, Hooman ^a   Bentley, Peter J ^a   Tyrrell, Andrew M ^b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF YORK   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE SYSTEMS; ARTIFICIAL INTELLIGENCE; FIELD PROGRAMMABLE GATE ARRAYS (FPGA); HARDWARE; MILITARY OPERATIONS; PIECEWISE LINEAR TECHNIQUES;

HARDWARE IMPLEMENTATIONS; INTEGRATE-AND-FIRE; NEURON MODELS; PIECE-WISE LINEAR APPROXIMATION; SPIKING NEURAL NETWORKS;

NEURAL NETWORKS;

EID: 51949097982     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/AHS.2008.13     Document Type: Conference Paper

References (36)

1. D. H. Wolpert and W. G. Macready, "No Free Lunch Theorems for Optimization," IEEE Transactions on Evolutionary Computation, vol. 1, no. 1, pp. 67-82, Apr. 1997.
2. J. Timmis, M. Amos, W. Banzhaf, and A. Tyrrell, "Going back to our roots": second generation biocomputing," 2005. [Online]. Available: http://www.citebase.org/cgi-bin/citations?id=oai:arXiv.org:cs/0512071
3. X. Yao, "Evolving artificial neural networks," Proceedings of the IEEE, vol. 87, no. 9, pp. 1423-1447, 1999.
4. H. Jaeger, "Reservoir riddles: suggestions for echo state network research," in Neural Networks, 2005. IJCNN '05. Proceedings. 2005 IEEE International Joint Conference on, vol. 3, 31 July-4 Aug. 2005, pp. 1460-1462vol.3.
5. K. O. Stanley and R. Miikkulainen, "Evolving Neural Networks through Augmenting Topologies," Evolutionary Computation, vol. 10, no. 2, pp. 99-127, 2002.
6. K. Stanley and R. Miikkulainen, "Competitive coevolution through evolutionary complexification," Journal of Artificial Intelligence Research, vol. 21, no. 1, pp. 63-100, 2004.
7. K. Stanley, "Real-time neuroevolution in the NERO video game," IEEE transactions on evolutionary computation, vol. 9, no. 6, pp. 653-, 2005.
8. _, "Compositional pattern producing networks: A novel abstraction of development," Genetic programming and evolvable machines, vol. 8, no. 2, pp. 131-, 2007.
9. D. Floreano, Y. Epars, J. Zufferey, and C. Mattiussi, "Evolution of Spiking Neural Circuits in Autonomous Mobile Robots," International Journal of Intelligent Systems, vol. 20, p. 100, 2005.
10. D. V. Buonomano and M. M. Merzenich, "Temporal Information Transformed into a Spatial Code by a Neural Network with Realistic Properties," Science, vol. 267, no. 5200, pp. 1028-1030, Feb. 1995.
11. Maass, Natschlager, and Markram, "Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations," NEURCOMP: Neural Computation, vol. 14, pp. 2531-2560, 2002.
12. H. Jaeger and H. Haas, "Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication," Science, vol. 304, no. 5667, pp. 78-80, 2004. [Online]. Available: http://www.sciencemag.org/ cgi/content/abstract/304/5667/78
13. J. Steil, "Backpropagation-decorrelation: online recurrent learning with O(N) complexity," in Neural Networks, 2004. Proceedings. 2004 IEEE International Joint Conference on, vol. 2, 25-29 July 2004, pp. 843-848vol.2.
14. B. Schrauwen, D. Verstraeten, and J. Van Campenhout, "An overview of reservoir computing: theory, applications and implementations," in Proceedings of the 15th European Symposium on Artificial Neural Networks, 2007, p. 471482.
15. M. Lukosevicius and H. Jaeger, "Overview of Reservoir Recipes," School of Engineering and Science, Jacobs University, Bremen, Germany, Tech. Rep. 11, July 2007.
16. J. Steil, "Online reservoir adaptation by intrinsic plasticity for backpropagation-decorrelation and echo state learning," Neural Networks, vol. 20, no. 3, pp. 353-364, 2007.
17. T. van der Zant, V. Becanovíc, K. Ishii, H. Kobialka, and P. Ploger, "Finding good echo state networks to control an underwater robot using evolutionary computations," in Proceedings of the 5th IFAC symposium on Intelligent Autonomous Vehicles (IAV04), 2004.
18. J. Miller, "Evolving Developmental Programs for Adaptation, Morphogenesis, and Self-Repair," in Advances in Artificial Life. 7th European Conference on Artificial Life, ser. Lecture Notes in Artificial Intelligence, W. Banzhaf, T. Christaller, P. Dittrich, J. T. Kim, and J. Ziegler, Eds. Dortmund, Germany: Springer, 2003, pp. 256-265.
19. T. Gordon and P. Bentley, "Development brings scalability to hardware evolution," in Evolvable Hardware, 2005. Proceedings. 2005 NASA/DoD Conference on, 2005, pp. 272-279.
20. _, "Bias and scalability in evolutionary development," in Proceedings of the 2005 conference on Genetic and evolutionary computation. ACM Press New York, NY, USA, 2005, pp. 83-90.
21. H. Liu, J. Miller, and A. Tyrrell, "Intrinsic evolvable hardware implementation of a robust biological development model for digital systems," in Evolvable Hardware, 2005. Proceedings. 2005 NASA/DoD Conference on, 2005, pp. 87-92. [Online]. Available: http://doi. ieeecomputersociety.org/10.1109/EH.2005.32
22. P. Bentley, "Investigations Into Graceful Degradation of Evolutionary Developmental Software," Natural Computing, vol. 4, no. 4, pp. 417-437, 2005. [Online]. Available: http://dx.doi.org/10.1007/s11047- 005-3666-7
23. D. Federici, "A regenerating spiking neural network," Neural Networks, vol. 18, no. 5-6, pp. 746-754, 2005. [Online]. Available: http://dx.doi.org/10.1016/j.neunet.2005.06.006
24. A. N. Hampton and C. Adami, "Evolution of Robust Developmental Neural Networks," in Artificial Life IX: Proceedings of the Ninth International Conference on the Simulation and Synthesis of Living Systems, 2004. [Online]. Available: http://www.citebase.org/cgibin/citations?id=oai: arXiv.org:nlin/0405011
25. D. Roggen, D. Federici, and D. Floreano, "Evolutionary morphogenesis for multi-cellular systems," Genetic Programming and Evolvable Machines, vol. 8, no. 1, pp. 61-96, 2007.
26. J. Moreno, Y. Thoma, E. Sanchez, J. Eriksson, J. Iglesias, and A. Villa, "The POEtic Electronic Tissue and Its Role in the Emulation of Large-Scale Biologically Inspired Spiking Neural Networks Models," Complexus, vol. 3, no. 1-3, pp. 32-47, 2006. [Online]. Available: http://www.karger.com/ DOI/10.1159/000094186
27. A. Upegui, C. A. Pena-Reyes, and E. Sanchez, "An FPGA platform for on-line topology exploration of spiking neural networks," Microprocessors and Microsystems, vol. 29, no. 5, pp. 211-223, Jun. 2005.
28. W. Gerstner and W. Kistler, Spiking Neuron Models: Single Neurons, Populations, Plasticity. Cambridge University Press, 2002.
29. E. M. Izhikevich, Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting (Computational Neuroscience). The MIT Press, November 2007. [Online]. Available: http://www.amazon.fr/exec/obidos/ASIN/ 0262090430/citeulike04-21
30. B. Schrauwen and J. van Campenhout, "Parallel hardware implementation of a broad class of spiking neurons using serial arithmetic," in Proceedings of ESANN, 2006, pp. 623-628.
31. H. Shayani, P. Bentley, and A. Tyrrell, "An FPGA-based Model Suitable for Evolution and Development of Spiking Neural Networks," in Proc of 16th European Symposium on Artificial Neural Networks, Advances in Computational Intelligence and Learning, 2008.
32. A. Upegui and E. Sanchez, "Evolving Hardware with Self-reconfigurable Connectivity in Xilinx FPGAs," in Adaptive Hardware and Systems, 2006. AHS 2006. First NASA/ESA Conference on, 2006, pp. 153-162.
33. E. Izhikevich, "Simple model of spiking neurons," Neural Networks, IEEE Transactions on, vol. 14, no. 6, pp. 1569-1572, Nov. 2003.
34. _, "Which model to use for cortical spiking neurons?" Neural Networks, IEEE Transactions on, vol. 15, no. 5, pp. 1063-1070, Sept. 2004.
35. ML505/ML506 Evaluation Platform User Guide, Xilinx, Oct 2007.
36. D. Roggen, S. Hofmann, Y. Thoma, and D. Floreano, "Hardware spiking neural network with run-time reconfigurable connectivity in an autonomous robot," in Evolvable Hardware, 2003. Proceedings. NASA/DoD Conference on, 2003, pp. 189-198.