Synergies between evolutionary and neural computation

ESANN 2005 Proceedings - 13th European Symposium on Artificial Neural Networks

Volumn , Issue , 2007, Pages 241-252

  Igel, Christian ^a   Sendhoff, Bernhard ^b  

^a RUHR UNIVERSITY BOCHUM   (Germany)

^b HONDA RESEARCH INSTITUTE EUROPE GMBH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BIOLOGICAL INFORMATION PROCESSING; NEURAL COMPUTATIONS; RECENT TRENDS; TOPOLOGY OPTIMISATION; TURBOMACHINERY COMPONENTS;

DATA PROCESSING; NEURAL NETWORKS;

MACHINE DESIGN;

EID: 84886998830     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (75)

1. H. A. Abbass. An evolutionary artificial neural networks approach for breast cancer diagnosis. Artificial Intelligence in Medicine, 25(3):265-281, 2002.
2. H. A. Abbass. Speeding up backpropagation using multiobjective evolutionary algorithms. Neural Computation, 15(11):2705-2726, 2003.
3. K. Arai, S. Das, E. L. Keller, and E. Aiyoshi. A distributed model of the saccade system: simulations of temporally perturbed saccades using position and velocity feedback. Neural Networks, 12:1359-1375, 1999.
4. M. A. Arbib. Towards a neurally-inspired computer architecture. Natural Computing, 2(1):1-46, 2003.
5. H.-G. Beyer, H.-P. Schwefel, and I. Wegener. How to analyse evolutionary algorithms. Theoretical Computer Science, 287:101-130, 2002.
6. J. A. Bullinaria. Evolving efficient learning algorithms for binary mappings. Neural Networks, 16:793-800, 2003.
7. J. A. Bullinaria. Evolving neural networks: Is it really worth the effort? In 13th European Symposium on Artificial Neural Networks (ESANN 2005), 2005.
8. A. Chandra and X. Yao. Evolutionary framework for the construction of diverse hybrid ensembles. In 13th European Symposium on Artificial Neural Networks (ESANN 2005), 2005.
9. K. Chellapilla and D. B. Fogel. Evolution, neural networks, games, and intelligence. Proceedings of the IEEE, 87(9):1471-1496, 1999.
10. C. A. Coello Coello, D. A. Van Veldhuizen, and G. B. Lamont. Evolutionary Algorithms for Solving Multi-Objective Problems. Kluwer Academic Publishers, 2002.
11. I. Das and J. E. Dennis. A closer look at drawbacks of minimizing weighted sums of objectives for pareto set generation in multicriteria optimization problems. Structural Optimization, 14(1):63-69, 1997.
12. K. Deb. Multi-Objective Optimization Using Evolutionary Algorithms. Wiley, 2001.
13. S. Droste, T. Jansen, and I. Wegener. On the analysis of the (1+1) evolutionary algorithm. Theoretical Computer Science, 276:51-81, 2002.
14. D. R. Eads, D. Hill, S. Davis, S. J. Perkins, J. Ma, R. B. Porter, and J. P. Theiler. Genetic algorithms and support vector machines for time series classification. In B. Bosacchi et al., editors, Applications and Science of Neural Networks, Fuzzy Systems, and Evolutionary Computation V., volume 4787 of Proceedings of the SPIE, pages 74-85, 2002.
15. D. B. Fogel, editor. Evolutionary Computation: The Fossile Record. IEEE Press, 1998.
16. D. B. Fogel, T. J. Hays, S. L. Hahn, and J. Quon. A self-learning evolutionary chess program. Proceedings of the IEEE, 92(12):1947-1954, 2004.
17. C. M. Friedrich and C. Moraga. An evolutionary method to find good building-blocks for architectures of artificial neural networks. In Sixth International Conference on Information Processing and Management of Uncertainty in Knowledge Based Systems (IPMU'96), volume 2, pages 951-956, 1996.
18. F. Friedrichs and C. Igel. Evolutionary tuning of multiple SVM parameters. In M. Verleysen, editor, 12th European Symposium on Artificial Neural Networks (ESANN 2004), pages 519-524. Evere, Belgium: d-side publications, 2004.
19. H. Fröhlich, O. Chapelle, and B. Schölkopf. Feature selection for support vector machines by means of genetic algorithms. In 15th IEEE International Conference on Tools with AI (ICTAI 2003), pages 142-148. IEEE Computer Society, 2003.
20. K. Fukushima. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biological Cybernetics, 39:139-202, 1980.
21. A. Gepperth and S. Roth. Applications of multi-objective structure optimization. In 13th European Symposium on Artificial Neural Networks (ESANN 2005), 2005.
22. L. Graening, Y. Jin, and B. Sendhoff. Efficient evolutionary optimization using individualbased evolution control and neural networks: A comparative study. In 13th European Symposium on Artificial Neural Networks (ESANN 2005), 2005.
23. J. J. Grefenstette and J. M. Fitzpatrick. Genetic search with approximate fitness evaluations. In J. J. Grefenstette, editor, International Conference on Genetic Algorithms and Their Applications, pages 112-120. Lawrence Erlbaum Associates, 1985.
24. F. Gruau. Automatic definition of modular neural networks. Adaptive Behavior, 3(2):151-183, 1995.
25. M. Hüsken, J. E. Gayko, and B. Sendhoff. Optimization for problem classes - neural networks that learn to learn. In X.Yao, editor, IEEE Symposium on Combinations of Evolutionary Computation and Neural Networks. IEEE Press, 2000. 98-109.
26. M. Hüsken, C. Igel, and M. Toussaint. Task-dependent evolution of modularity in neural networks. Connection Science, 14(3):219-229, 2002.
27. M. Hüsken, Y. Jin, and B. Sendhoff. Structure optimization of neural networks for aerodynamic optimization. Soft Computing, 9(1):21-28, 2005.
28. C. Igel. Neuroevolution for reinforcement learning using evolution strategies. In R. Sarker et al., editors, Congress on Evolutionary Computation (CEC 2003), volume 4, pages 2588-2595. IEEE Press, 2003.
29. C. Igel. Multiobjective model selection for support vector machines. In C. A. Coello Coello et al., editors, Proceedings of the Third International Conference on Evolutionary Multi- Criterion Optimization (EMO 2005), volume 3410 of LNAI, pages 534-546. Springer- Verlag, 2005.
30. C. Igel and M. Kreutz. Operator adaptation in evolutionary computation and its application to structure optimization of neural networks. Neurocomputing, 55(1-2):347-361, 2003.
31. C. Igel and P. Stagge. Effects of phenotypic redundancy in structure optimization. IEEE Transactions on Evolutionary Computation, 6(1):74-85, 2002.
32. C. Igel, W. von Seelen, W. Erlhagen, and D. Jancke. Evolving field models for inhibition effects in early vision. Neurocomputing, 44-46(C):467-472, 2002.
33. C. Igel, S. Wiegand, and F. Friedrichs. Evolutionary optimization of neural systems: The use of self-adptation. In M. G. de Bruin et al., editors, Trends and Applications in Constructive Approximation, number 151 in International Series of Numerical Mathematics. Birkhäuser Verlag, 2005. In press.
34. J. Jäagersküpper. Rigorous runtime analysis of the (1+1) ES: 1/5-rule and ellipsoidal fitness landscapes. In Foundations of Genetic Algorithms (FOGA VIII), LNCS. Springer- Verlag, 2005.
35. Y. Jin. A comprehensive survey of fitness approximation in evolutionary computation. Soft Computing, 9(1):3-12, 2005.
36. Y. Jin, T. Okabe, and B. Sendhoff. Neural network regularization and ensembling using multi-objective evolutionary algorithms. In Congress on Evolutionary Computation (CEC'04), pages 1-8. IEEE Press, 2004.
37. Y. Jin, M. Olhofer, and B. Sendhoff. A framework for evolutionary optimization with approximate fitness functions. IEEE Transactions on Evolutionary Computation, 6(5):481-494, 2002.
38. Y. Jin and B. Sendhoff. Reducing fitness evaluations using clustering techniques and neural network ensembles. In K. Deb et al., editors, Proceedings of the Genetic and Evolutionary Computation Conference - GECCO, volume 1 of LNCS, pages 688-699. Springer, 2004.
39. K. Jong, E. Marchiori, and A. van der Vaart. Analysis of proteomic pattern data for cancer detection. In G. R. Raidl et al., editors, Applications of Evolutionary Computing, number 3005 in LNCS, pages 41-51. Springer-Verlag, 2004.
40. R. R. Kampfner and M. Conrad. Computational modeling of evolutionary learning processes in the brain. Bulletin of Mathematical Biology, 45(6):931-968, 1983.
41. Y. Kassahun and G. Sommer. Efficient reinforcement learning through evolutionary acquisition of neural topologies. In 13th European Symposium on Artificial Neural Networks (ESANN 2005), 2005.
42. H. Kitano. Designing neural networks using genetic algorithms with graph generation system. Complex Systems, 4:461-476, 1990.
43. V. R. Konda and J. N. Tsitsiklis. On actor-critic algorithms. SIAM Journal on Control and Optimization, 42(4):1143-1166, 2003.
44. H. Lipson and J. B. Pollack. Automatic design and manufacture of robotic lifeforms. Nature, 406:974-978, 2000.
45. Y. Liu, X. Yao, and T. Higuchi. Evolutionary ensembles with negative correlation learning. IEEE Transactions on Evolutionary Computation, 4(4):380-387, 2000.
46. M. Mahner and M. Kary. What exactly are genomes, genotypes and phenotypes? And what about phenomes? Journal of Theoretical Biology, 186(1):55-63, 1997.
47. A. Mark, H. Wersing, and B. Sendhoff. A decision making framework for game playing using evolutionary optimization and learning. In Y. Shi, editor, Congress on Evolutionary Computation (CEC), volume 1, pages 373-380. IEEE Press, 2004.
48. G. Miller and P. Todd. Designing neural networks using genetic algorithms. In J. D. Schaffer, editor, Proceeding of the 3rd International Conference on Genetic Algorithms, pages 379-384. Morgan Kaufmann, 1989.
49. M. T. Miller, A. K. Jerebko, J. D. Malley, and R. M. Summers. Feature selection for computer-aided polyp detection using genetic algorithms. In A. V. Clough and A. A. Amini, editors, Medical Imaging 2003: Physiology and Function: Methods, Systems, and Applications, volume 5031 of Proceedings of the SPIE, pages 102-110, 2003.
50. D. E. Moriarty, A. C. Schultz, and J. J. Grefenstette. Evolutionary Algorithms for Reinforcement Learning. Journal of Artificial Intelligence Research, 11:199-229, 1999.
51. S. Nolfi. Evolution and learning in neural networks. In M. A. Arbib, editor, The Handbook of Brain Theory and Neural Networks, pages 415-418. MIT Press, 2 edition, 2002.
52. S. Nolfi and D. Floreano. Evolutionary Robotics: The Biology, Intelligence, and Techno logy of Self-Organizing Machines. Intelligent Robotics and Autonomous Agents. MIT Press, 2000.
53. Z. Pan, T. Sabisch, R. Adams, and H. Bolouri. Staged training of neocognitron by evolutionary algorithms. In P. J. Angeline et al., editors, Proceedings of the Congress on Evolutionary Computation, volume 3, pages 1965-1972. IEEE Press, 1999.
54. M. Papadrakakis, N. Lagaros, and Y. Tsompanakis. Optimization of large-scale 3D trusses using evolution strategies and neural networks. International Journal of Space Structures, 14(3):211-223, 1999.
55. F. Pasemann, U. Steinmetz, M. Hülse, and B. Lara. Robot control and the evolution of modular neurodynamics. Theory in Biosciences, 120(3-4):311-326, 2001.
56. M. Patel, V. Honavar, and K. Balakrishnan, editors. Advances in the Evolutionary Synthesis of Intelligent Agents. MIT Press, 2001.
57. S. Pierret. Turbomachinery blade design using a Navier-Stokes solver and artificial neural network. ASME Journal of Turbomachinery, 121(3):326-332, 1999.
58. E. T. Rolls and S. M. Stringer. On the design of neural networks in the brain by genetic evolution. Progress in Neurobiology, 6(61):557-579, 2000.
59. G. Rudolph. Convergence Properties of Evolutionary Algorithms. Kovač, Hamburg, 1997.
60. T. P. Runarsson and S. Sigurdsson. Asynchronous parallel evolutionary model selection for support vector machines. Neural Information Processing - Letters and Reviews, 3(3):59-68, 2004.
61. G. Schneider, H. Wersing, B. Sendhoff, and E. Körner. Coupling of evolution and learning to optimize a hierarchical object recognition model. In X. Yao et al., editors, Parallel Problem Solving from Nature (PPSN), LNCS, pages 662-671. Springer Verlag, 2004.
62. G. Schneider, H. Wersing, B. Sendhoff, and E. Körner. Evolutionary optimization of an hierarchical object recognition model. IEEE Transactions on Systems, Man and Cybernetics, Part B, 2004. Accepted.
63. S. Schneider, C. Igel, C. Klaes, H. Dinse, and J. Wiemer. Evolutionary adaptation of nonlinear dynamical systems in computational neuroscience. Journal of Genetic Programming and Evolvable Machines, 5(2):215-227, 2004.
64. B. Sendhoff. Evolution of Structures - Optimization of Artificial Neural Structures for Information Processing. Shaker Verlag, Aachen, 1998.
65. B. Sendhoff and M. Kreutz. A model for the dynamic interaction between evolution and learning. Neural Processing Letters, 10(3):181-193, 1999.
66. A. J. C. Sharkey. On combining artificial neural nets. Connection Science, 8(3-4):299-313, 1996.
67. D. Shi and C. L. Tan. GA-based supervised learning of neocognitron. In International Joint Conference on Neural Network (IJCNN 2000). IEEE Press, 2000.
68. J. Šíma. Training a single sigmoidal neuron is hard. Neural Computation, 14:2709-2728, 2002.
69. O. Sporns, G. Tononi, and G. M. Edelman. Theoretical neuroanatomy: relating anatomical and functional connectivity in graphs and cortical connection matrices. Cerebral Cortex, 10(2):127-141, 2000.
70. R. Sutton, D. McAllester, S. Singh, and Y. Mansour. Policy gradient methods for reinforcement learning with function approximation. In S. A. Solla et al., editors, Advances in Neural Information Processing Systems 12, pages 1057-1063. MIT Press, 2000.
71. M.-Y. Teo, L.-P. Khoo, and S.-K. Sim. Application of genetic algorithms to optimise neocognitron network parameters. Neural Network World, 7(3):293-304, 1997.
72. J. Walker, S. Garrett, and M. Wilson. Evolving controllers for real robots: A survey of the literature. Adaptive Behavior, 11:179-203, 2003.
73. H. Wersing and E. Körner. Learning optimized features for hierarchical models of invariant recognition. Neural Computation, 15(7):1559-1588, 2003.
74. S. Wiegand, C. Igel, and U. Handmann. Evolutionary multi-objective optimization of neural networks for face detection. International Journal of Computational Intelligence and Applications, 4(3):237-253, 2004.
75. X. Yao. Evolving artificial neural networks. Proceedings of the IEEE, 87(9):1423-1447, 1999.