On the probabilistic optimization of spiking neural networks

International Journal of Neural Systems

Volumn 20, Issue 6, 2010, Pages 481-500

  Schliebs, Stefan ^a   Kasabov, Nikola ^a   Defoin Platel, Michaël ^b  

^a AUCKLAND UNIVERSITY OF TECHNOLOGY   (New Zealand)

^b ROTHAMSTED RESEARCH   (United Kingdom)

Author keywords

Estimation of Distribution Algorithms; evolutionary algorithms; heterogeneous optimization algorithms; Multi Model EDA; Spiking Neural Network

Indexed keywords

APPROPRIATE TOPOLOGY; BENCH-MARK PROBLEMS; ESTIMATION OF DISTRIBUTION ALGORITHMS; EXPERIMENTAL ANALYSIS; HETEROGENEOUS OPTIMIZATION ALGORITHMS; INTERNAL PARAMETERS; LIGHT WEIGHT; LITERATURE REVIEWS; MULTI-MODEL; OPTIMIZATION ALGORITHMS; OPTIMIZATION METHOD; PRACTICAL GUIDELINES; PROBABILISTIC OPTIMIZATION; SEARCH SPACES; SPIKING NEURAL NETWORKS;

ESTIMATION; HEURISTIC ALGORITHMS; INTELLIGENT AGENTS; MATHEMATICAL MODELS; NEURAL NETWORKS; OPTIMIZATION; PARAMETERIZATION;

EVOLUTIONARY ALGORITHMS;

ACTION POTENTIAL; ALGORITHM; ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; CYTOLOGY; HUMAN; NERVE CELL; NERVE CELL NETWORK; PHYSIOLOGY; STATISTICAL MODEL;

ACTION POTENTIALS; ALGORITHMS; ANIMALS; HUMANS; MODELS, NEUROLOGICAL; MODELS, STATISTICAL; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONS;

EID: 78649588368     PISSN: 01290657     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0129065710002565     Document Type: Article

References (59)

1. W. Maass, Computing with spiking neurons, in Pulsed Neural Networks (MIT Press, Cambridge, MA, USA, 1999), pp. 55-85.
2. W. Gerstner and W. M. Kistler, Spiking Neuron Models: Single Neurons, Populations, Plasticity (Cambridge University Press, Cambridge, MA, 2002).
3. S. Ghosh-Dastidar and H. Adeli, Third generation neural networks: Spiking neural networks, in W. Yu and E. Sanchez (eds.), Advances in Computational Intelligence, Vol. 116 of Advances in Soft Computing, Springer Berlin/Heidelberg (2009), pp. 167-178.
4. S. Ghosh-Dastidar and H. Adeli, Spiking neural networks, Int. J. Neural Syst. 19(4) (2009) 295-308.
5. D. Verstraeten, B. Schrauwen and D. Stroobandt, Isolated word recognition using a liquid state machine, in ESANN (2005), pp. 435-440.
6. S. M. Bohte, J. N. Kok and J. A. L. Poutré, Error-backpropagation in temporally encoded networks of spiking neurons, Neurocomputing 48(1-4) (2002) 17-37.
7. F. Ponulak, ReSuMe-new supervised learning method for spiking neural networks, Tech. Rep., Institute of Control and Information Engineering, Poznań University of Technology, Poznań, Poland (2005).
8. A. Knoblauch, Neural associative memory for brain modeling and information retrieval. Inf. Process. Lett. 95(6) (2005) 537-544.
9. N. Iannella and L. Kindermann, Finding iterative roots with a spiking neural network, Information Processing Letters 95(6) (2005) 545-551.
10. J. Iglesias and A. E. Villa, Emergence of preferred firing sequences in large spiking neural networks during simulated neuronal development, Int. J. Neural Syst. 18(4) (2008) 267-277.
11. J. L. Rosselló, V. Canals, A. Morro and J. Verd, Chaos-based mixed signal implementation of spiking neurons. Int. J. Neural Syst. 19(6) (2009) 465-471.
12. S. Ghosh-Dastidar and H. Adeli, Improved spiking neural networks for EEG classification and epilepsy and seizure detection, Integr. Comput.-Aided Eng. 14(3) (2007) 187-212.
13. S. Ghosh-Dastidar and H. Adeli, A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection, Neural Networks 22(10) (2009) 1419-1431.
14. N. Pavlidis, D. K. Tasoulis, V. P. Plagianakos, G. Nikiforidis and M. N. Vrahatis, Spiking neural network training using evolutionary algorithms, in Proc. of International Joint Conference on Neural Networks (IJCNN'05) (2005), pp. 2190-2194.
15. C. Taylor and A. Agah, Evolving neural network topologies for object recognition, in Automation Congress, 2006. WAC'06, IEEE, Budapest, Hungary (2006), pp. 1-6.
16. S. Schliebs, M. Defoin-Platel, S. Worner and N. Kasabov, Integrated feature and parameter optimization for an evolving spiking neural network: Exploring heterogeneous probabilistic models, Neural Networks 22(5-6) (2009) 623-632.
17. K. Hintz and J. Spofford, Evolving a neural network, in 5th IEEE International Symposium on Intelligent Control, Vol. 1 (1990), pp. 479-484.
18. V. Maniezzo, Genetic evolution of the topology and weight distribution of neural networks, IEEE Transactions on Neural Networks 5(1) (1994) 39-53.
19. F. Leung, H. Lam, S. Ling and P. Tam, Tuning of the structure and parameters of a neural network using an improved genetic algorithm, IEEE Transactions on Neural Networks 14(1) (2003) 79-88.
20. D. White and P. A. Ligomenides, GANNet: A genetic algorithm for optimizing topology and weights in neural network design, in IWANN'93: Proceedings of the International Workshop on Artificial Neural N etworks, Springer-Verlag, London, UK (1993), pp. 322-327.
21. E. Alba, J. F. A. Montes and J. M. Troya, Full automatic ANN design: A genetic approach, in IWANN'93: Proceedings of the International Workshop on Artificial Neural Networks, Springer-Verlag, London, UK (1993), pp. 399-404.
22. S. Oliker, M. Furst and O. Maimon, Design architectures and training of neural networks with a distributed genetic algorithm, in IEEE International Conference on Neural Networks, Vol. 1 (1993), pp. 199-202.
23. S. Hung and H. Adeli, A parallel genetic/neural network learning algorithm for MIMD shared memory machines, Neural Networks, IEEE Transactions 5(6) (1994) 900-909.
24. M. Valko, N. C. Marques and M. Castelani, Evolutionary feature selection for spiking neural network pattern classifiers, in B. et al. (ed.), Proceedings of 2005 Portuguese Conference on Artificial Intelligence, IEEE Press (2005), pp. 24-32.
25. M. Castellani and N. Marques, FeaSANNT - An embedded evolutionary feature selection approach for neural network classifiers, VIMation Journal 1 (2008) 46-53.
26. M. Castellani and H. Rowlands, Evolutionary artificial neural network design and training for wood veneer classification, Engineering Applications of Artificial Intelligence 22(4-5) (2009) 732-741.
27. M. Castellani, ANNE - A new algorithm for evolution of artificial neural network classifier systems, in IEEE Congress on Evolutionary Computation, CEC'06 (2006), pp. 3294-3301.
28. D. Rivero, J. Dorado, E. Fernández-Blanco and A. Pazos, A genetic algorithm for ANN design, training and simplification, in IWANN'09: Proceedings of the 10th International Work-Conference on Artificial Neural Networks, Springer-Verlag, Berlin, Heidelberg (2009), pp. 391-398.
29. B. A. Garro, H. Sossa and R. A. Vazquez, Design of artificial neural networks using a modified particle swarm optimization algorithm, International Joint Conference on Neural Networks, IEEE - INNS -ENNS (2009), pp. 938-945.
30. J. Ocenasek and J. Schwarz, Estimation of distribution algorithm for mixed continuous-discrete optimization problems, in 2nd Euro-International Symposium on Computational Intelligence, IOS Press, Kosice, Slovakia (2002), pp. 227-232.
31. S. Kern, S. Müller, N. Hansen, D. Büche, J. Ocenasek and P. Koumoutsakos, Learning probability distributions in continuous evolutionary algorithms - a comparative review, Natural Computing 3(1) (2004) 77-112.
32. J. Ocenasek, Parallel estimation of distribution algorithms. Ph.D. thesis, Faculty of Information Technology, Brno University of Technology, Brno, Czech Rep. (2002).
33. K. Socha, ACO for continuous and mixed-variable optimization, Ant Colony, Optimization and Swarm Intelligence (2004), pp. 25-36.
34. O. Cordón, I. Fernández de Viana, F. Herrera and L. Moreno, A new ACO model integrating evolutionary computation concepts: The best-worst ant system, in M. Dorigo, M. Middendoff and T. Stützle (eds.), From Ant Colonies to Artificial Ants: Proceedings of the Second International Workshop on Ant Algorithms, Springer, Brussels, Belgium (2000), pp. 22-29.
35. N. Monmarché, E. Ramat, G. Dromel, M. Sli-mane and G. Venturini, On the similarities between AS, BSC and PBIL: Toward the birth of a new meta-heuristic, Rapport Interne 215, Laboratoire d'Informatique de l'Université de Tours, E3i Tours (1999).
36. S. Schliebs, M. Defoin-Platel and N. Kasabov, Integrated feature and parameter optimization for an evolving spiking neural network, in M. Köppen, N. K. Kasabov and G. G. Coghill (eds.), Advances in Neuro-Information Processing, 15th International Conference, Vol. 5506 of Lecture Notes in Computer Science, Springer, Heidelberg, Germany (2009), pp. 1229-1236.
37. M. Defoin-Platel, S. Schliebs and N. Kasabov, A versatile quantum-inspired evolutionary algorithm, in IEEE Congress on Evolutionary Computation, CEC'07, IEEE Press, Singapore (2007), pp. 423-430.
38. S. G. Wysoski, L. Benuskova and N. Kasabov, Online learning with structural adaptation in a network of spiking neurons for visual pattern recognition, in Artificial Neural Networks ICANN 2006, Springer, Berlin/Heidelberg (2006), pp. 61-70. (Pubitemid 44561654)
39. M. Defoin-Platel, S. Schliebs and N. Kasabov, Quantum-inspired evolutionary algorithm: A multimodel EDA, Evolutionary Computation, IEEE Transactions 13(6) (2009) 1218-1232.
40. R. Kohavi and G. H. John, Wrappers for feature subset selection, Artificial Intelligence 97(1-2) (1997) 273-324.
41. S. Schliebs, M. Defoin-Platel, S. Worner and N. Kasabov, Quantum-inspired feature and parameter optimisation of evolving spiking neural networks with a case study from ecological modeling, in International Joint Conference on Neural Networks, IEEE - INNS - ENNS, IEEE Computer Society, Los Alamitos, CA, USA (2009), pp. 2833-2840.
42. S. Schliebs, M. Defoin-Platel and N. Kasabov, Analyzing the dynamics of the simultaneous feature and parameter optimization of an evolving spiking neural network, in International Joint Conference on Neural Networks, IEEE - INNS - ENNS, IEEE Computer Society, Barcelona, Spain (2010).
43. S. Schliebs, Heterogeneous Probabilistic Models for Optimisation and Modelling of Evolving Spiking Neural Networks. Ph.D. thesis, Auckland University of Technology (2010). http://hdl.handle.net/10292/963.
44. P. Larrañaga and J. A. Lozano, Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation, Kluwer Academic Publishers, Boston (2002).
45. J. Geweke, Efficient simulation from the multivariate normal and student-t distributions subject to linear constraints and the evaluation of constraint probabilities, in Computing Science and Statistics: Proceedings of the 23rd Symposium on the Interface, American Statistical Association, New York, Seattle, Washington (1991), pp. 571-578.
46. K.-H. Han and J.-H. Kim, On setting the parameters of quantum-inspired evolutionary algorithm for practical application, in Congress on Evolutionary Computation, CEC'03, Vol. 1, IEEE Press, Canberra, Australia (2003), pp. 178-194.
47. D. Thierens, D. Goldberg and A. Pereira, Domino convergence, drift, and the temporal-salience structure of problems, in Evolutionary Computation Proceedings, 1998. IEEE World Congress on Computational Intelligence, IEEE Press (1998), pp. 535-540.
48. W. M. Rudnick, Genetic Algorithms and Fitness Variance with an Application to the Automated Design of Artificial Neural Networks. Ph.D. thesis, Oregon Graduate Institute of Science & Technology, Beaverton, OR, USA (1992).
49. ε gate, and two phase scheme, IEEE Transactions on Evolutionary Computation 8(2) (2004) 156-169.
50. H. Mühlenbein and G. Paass, From recombination of genes to the estimation of distributions I. binary parameters, in PPSN (1996), pp. 178-187. (Pubitemid 126128306)
51. S. Baluja, Population-based incremental learning: A method for integrating genetic search based function optimization and competitive learning, Tech. Rep. CMU-CS-94-163, Carnegie Mellon University, Pittsburgh, PA (1994).
52. G. R. Harik, F. G. Lobo and D. E. Goldberg, The compact genetic algorithm, IEEE Transactions on Evolutionary Computation 3(4) (1999) 287-297.
53. Z. Michalewicz and C. Z. Janikow, Genetic algorithms for numerical optimization, Statistics and Computing 1(2) (1991) 75-91.
54. A. Auger and N. Hansen, Performance evaluation of an advanced local search evolutionary algorithm, in IEEE Congress on Evolutionary Computation, IEEE Press, Vol. 2 (2005), pp. 1777-1784.
55. P. N. Suganthan, N. Hansen, J. J. Liang, K. Deb, Y. P. Chen, A. Auger and S. Tiwari, Problem definitions and evaluation criteria for the CEC 2005 special session on real parameter optimization, Tech. Rep., Nanyang Technological University, Singapore (2005).
56. M. A. Potter and K. A. D. Jong, Cooperative coevo-lution, An architecture for evolving coadapted subcomponents, Evolutionary Computation 8 (2000) 1-29.
57. N. Kasabov, To spike or not to spike: A probabilistic spiking neuron model, Neural Networks 23(1) (2010) 16-19.
58. L. Benuskova and N. Kasabov, Computational Neu-rogenetic Modeling, Springer, NY (2007).
59. L. Benuskova, V. Jain, S. G. Wysoski and N. Kasabov, Computational neurogenetic modeling: A pathway to new discoveries in genetic neuro-science, Intl. Journal of Neural Systems 16(3) (2006) 215-227.