Genetic representation and evolvability of modular neural controllers

IEEE Computational Intelligence Magazine

Volumn 5, Issue 3, 2010, Pages 10-19

  Dürr, Peter ^a   Floreano, Dario ^a   Claudio, Mattiussi ^a  

^a EPFL   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

EVOLUTIONARY ALGORITHMS; NETWORK ARCHITECTURE; NEURAL NETWORKS; ROBOTICS;

ALGORITHM PERFORMANCE; AUTOMATIC SYNTHESIS; GENETIC REPRESENTATIONS; INTER-DEPENDENT CONTROLS; MODULAR NETWORK ARCHITECTURES; NEURAL CONTROLLER; PLASTIC NEURAL NETWORKS; STATE OF THE ART;

CONTROL SYSTEM SYNTHESIS;

EID: 77954726303     PISSN: 1556603X     EISSN: None     Source Type: Journal    
DOI: 10.1109/MCI.2010.937319     Document Type: Article

References (65)

1. T. Bäck. (1996). Evolutionary Algorithms in Theory and Practice: Evolution Strategies, Evolutionary Programming, Genetic Algorithms. Oxford Univ. Press.
2. S. Nolfi and D. Floreano, Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines. Cambridge, MA: MIT Press, 2004.
3. K. A. De Jong, "Evolving intelligent agents: A 50 year quest," IEEE Comput. Intell. Mag., vol.3, no.1, pp. 12-17, 2008.
4. X. Yao, "Evolving artificial neural networks," Proc. IEEE, vol.87, pp. 1423-1447, 1999.
5. D. Floreano, P. Dürr, and C. Mattiussi, "Neuroevolution: from architectures to learning," Evol. Intell., vol.1, no.1, pp. 47-62, Mar. 2008.
6. J. Gallagher, R. Beer, and K. Espenschied, "Application of evolved locomotion controllers to a hexapod robot," Robot. Auton. Syst., 1996.
7. D. Floreano and F. Mondada, "Evolution of homing navigation in a real mobile robot," IEEE Trans. Syst., Man, Cybern., vol.26, no.3, pp. 396-407, 1996.
8. S. Baluja, "Evolution of an artificial neural network based autonomous land vehicle controller," IEEE Trans. Syst., Man, Cybern., 1996.
9. S. Nolfi and D. Parisi, "Evolving non-trivial behaviors on real robots: A garbage collecting robot," Robot. Auton. Syst., 1997.
10. F. Gruau and K. Quatramaran, "Cellular encoding for interactive evolutionary robotics," in Proc. 4th European Conf. Artificial Life, 1997.
11. A. Ijspeert and J. Kodjabachian, "Evolution and development of a central pattern generator for the swimming of a lamprey," Artif. Life, 1999.
12. B. V. Haller, A. Ijspeert, and D. Floreano, "Co-evolution of structures and controllers for Neubot underwater modular robots," Adv. Artif. Life, 2005.
13. J. Zufferey, D. Floreano, and M. V. Leeuwen, "Evolving vision-based flying robots," in Proc. 2nd Int. Workshop Biologically Motivated Computer Vision (BMCV'2002), 2002, pp. 592-600.
14. F. Gomez and R. Miikkulainen, "Active guidance for a finless rocket using neuroevolution," in Proc. Genetic and Evolutionary Computation Conf., 2003.
15. Y. Sit and R. Miikkulainen, "Learning basic navigation for personal satellite assistant using neuroevolution," in Proc. 2005 Conf. Genetic and Evolutionary Computation, 2005.
16. D. Floreano and C. Mattiussi, Bio-Inspired Artificial Intelligence: Theories, Methods, and Technologies. Cambridge, MA: MIT Press, 2008.
17. P. Dürr, C. Mattiussi, A. Soltoggio, and D. Floreano, "Evolvability of neuromodulated learning for robots," in Proc. 2008 ECSIS Symp. Learning and Adaptive Behavior in Robotic Systems, 2008, pp. 41-46.
18. R. De Nardi, J. Togelius, O. E. Holl, and S. M. Lucas, "Neural networks for helicopter control: Why modularity matters," in Proc. IEEE Congr. Evolutionary Computation, 2006.
19. S. Nolfi. (1997). Using emergent modularity to develop control systems for mobile robots.
20. J. Reeder, R. Miguez, J. Sparks, M. Georgiopoulos, and G. Anagnostopoulos. (2008, Dec.). Interactively evolved modular neural networks for game agent control. Proc. 2008 IEEE Symp. Computational Intelligence and Games, pp. 167-174.
21. A. Christensen and M. Dorigo. (2006). Incremental evolution of robot controllers for a highly integrated task. From Animals to Animats 9 (Lecture Notes in Computer Science). Berlin: Springer-Verlag 4095, pp. 473-484.
22. G. P. Wagner. (1996, Feb.). Homologues, natural kinds and the evolution of modularity. Integr. Comp. Biol. 36(1), pp. 36-43.
23. G. P. Wagner and L. Altenberg, "Perspective: Complex adaptations and the evolution of evolvability," Evolution, vol.50, no.3, pp. 967-976, 1996.
24. T. F. Hansen, "Is modularity necessary for evolvability? Remarks on the relationship between pleiotropy and evolvability," Biosystems, vol.69, no.2-3, pp. 83-94, 2003.
25. R. Calabretta, S. Nolfi, D. Parisi, and G. P. Wagner, Emergence of Functional Modularity in Robots. Cambridge, MA: MIT Press, 1998.
26. R. Calabretta, S. Nolfi, D. Parisi, and G. P. Wagner, "A case study of the evolution of modularity: Towards a bridge between evolutionary biology, artificial life, neuro- and cognitive science," in Proc. 6th Int. Conf. Artificial Life, 1998, pp. 275-284.
27. R. Calabretta, S. Nolfi, D. Parisi, and G. P. Wagner, "Duplication of modules facilitates the evolution of functional specialization," Artif. Life, vol.6, no.1, pp. 69-84, 2000.
28. A. Di Ferdinando, R. Calabretta, and D. Parisi, "Evolving modular architectures for neural networks," in Proc. 6th Neural Computation and Psychology Workshop: Evolution, Learning, and Development, R. French and J. Sougné, Eds. London: Springer-Verlag, 2001, pp. 253-262.
29. R. Calabretta, A. Di Fernando, G. P. Wagner, and D. Parisi, "What does it take to evolve behaviorally complex organisms?," BioSystems, vol.69, pp. 245-262, 2002.
30. M. A. Potter and K. A. De Jong. (2000, Jan.). Cooperative coevolution: An architecture for evolving coadapted subcomponents. Evol. Comput. 8(1), pp. 1-29.
31. D. Moriarty and R. Miikkulainen. (1997). Forming neural networks through eff icient and adaptive coevolution. Evol. Comput. 5(4), pp. 373-399.
32. J. Reisinger, K. O. Stanley, and R. Miikkulainen, "Evolving reusable neural modules," in Proc. Genetic and Evolutionary Computation Conf. (GECCO-2004). Berlin: Springer- Verlag, 2004, pp. 69-81.
33. V. R. Khare, X. Yao, B. Sendhoff, Y. Jin, and H. Wersing, "Co-evolutionary modular neural networks for automatic problem decomposition," in Proc. 2005 IEEE Congr. Evolutionary Computation, CEC 2005. Edinburgh, U.K.: IEEE Press, 2005, pp. 2691-2698.
34. V. Khare, X. Yao, and B. Sendhoff. (2006). Multi-network evolutionary systems and automatic decomposition of complex problems. Int. J. General Syst. 35(3), pp. 259-274.
35. X. Yao and M. M. Islam, "Evolving artificial neural network ensembles," IEEE Comput. Intell. Mag., vol.3, no.1, pp. 31-42, 2008.
36. N. García-Pedrajas, C. Hervás-Martínez, and J. Muñoz Pérez. (2002, Dec.). Multiobjective cooperative coevolution of artificial neural networks (multi-objective cooperative networks). Neural Netw. 15(10), pp. 1259-1278.
37. N. García-Pedrajas, C. Hervás-Martínez, and D. Ortiz-Boyer. (2005, June). Cooperative coevolution of artificial neural network ensembles for pattern classification. IEEE Trans. Evol. Comput. 9(3), pp. 271-302.
38. C. Mattiussi, D. Marbach, P. Dürr, and D. Floreano. (2008). The age of analog networks. AI Mag. 29(3), pp. 63-76.
39. H. Kitano, "Designing neural networks by genetic algorithms using graph generation system," Complex Syst. J., vol.4, pp. 461-476, 1990.
40. F. Gruau. (1995). Automatic definition of modular neural networks. Adaptive Behav. 3(2), pp. 151-183.
41. F. Gruau, D. Whitley, and L. Pyeatt, "A comparison between cellular encoding and direct encoding for genetic neural networks," in Proc. 1st Annu. Conf. Genetic Programming 1996, J. R. Koza, D. E. Goldberg, D. B. Fogel, and R. L. Riolo, Eds. CA, Stanford University, 1996, pp. 81-89.
42. F. J. Gomez and R. Miikkulainen, "Solving non-markovian control tasks with neuro-evolution," in Proc. Int. Joint Conf. Artificial Intelligence (IJCAI), 1999, pp. 1356-1361.
43. K. O. Stanley and R. Miikkulainen. (2002). Evolving neural networks through augmenting topologies. Evol. Comput. 10(2), pp. 99-127.
44. J. Bongard. (2002). Evolving modular genetic regulatory networks. Proc. 2002 Congr. Evolutionary Computation, vol.2, pp. 1872-1877.
45. P. Dürr, C. Mattiussi, and D. Floreano. (2006). Neuroevolution with analog genetic encoding. Parallel Problem Solving from Nature-PPSN iX (LNCS) 9, pp. 671-680.
46. A. Soltoggio, P. Dürr, C. Mattiussi, and D. Floreano, "Evolving neuromodulatory topologies for reinforcement learning-like problems," in Proc. IEEE Congr. Evolutionary Computation (CEC), 2007.
47. J. Reisinger and R. Miikkulainen, "Acquiring evolvability through adaptive representations," in Proc. Genetic and Evolutionary Computation Conf. (GECCO 2007), 2007.
48. C. Mattiussi and D. Floreano, "Analog genetic encoding for the evolution of circuits and networks," IEEE Trans. Evol. Comput., 2007.
49. D. Marbach, C. Mattiussi, and D. Floreano. (2007). Bio-mimetic evolutionary reverse engineering of genetic regulatory networks. Proc. 5th European Conf. Evolutionary Computation, Machine Learning and Data Mining in Bioinformatics (EvoBIO 2007), pp. 155-165.
50. D. Marbach, C. Mattiussi, and D. Floreano. (2009). Replaying the evolutionary tape: Biomimetic reverse engineering of gene networks. Ann. New York Acad. Sci. 1158, pp. 234-245.
51. D. Gusfield. (1997). Algorithms on Strings, Trees, and Sequences. Cambridge, U.K., Cambridge Univ. Press.
52. F. Mondada, M. Bonani, X. Raemy, J. Pugh, C. Cianci, A. Klaptocz, S. Magnenat, J.-C. Zufferey, D. Floreano, and A. Martinoli, "The e-puck, a robot designed for education in engineering," in Proc. 9th Conf. Autonomous Robot Systems and Competitions, 2006, pp. 59-65.
53. S. Magnenat, M. Waibel, and A. Beyeler. (2009). Enki-An open source fast 2D robot simulator.
54. B. M. Yamauchi and R. D. Beer, "Sequential behavior and learning in evolved dynamical neural networks," Adaptive Behav., vol.2, pp. 219-246, 1994.
55. J. Blynel, "Evolving reinforcement learning-like abilities for robots," in Evolvable Systems: From Biology to Hardware. 2003, pp. 320-331.
56. Y.-T. Wang, "Synaptic plasticity in learning and memory," Int. J. Develop. Neurosci., vol.24, no.8, pp. 492-493, 2006.
57. A. Soltoggio, J. A. Bullinaria, C. Mattiussi, P. Dürr, and D. Floreano, "Evolutionary advantages of neuromodulated plasticity in dynamic, reward- based scenarios," in Proc. 11th Int. Conf. Artificial Life (Alife XI), 2008, S. Bullock, J. Noble, R. Watson, and M. A. Bedau, Eds. 2008, pp. 569-576.
58. C. Mattiussi, P. Dürr, and D. Floreano. (2007). Center of mass encoding: A selfadaptive representation with adjustable redundancy for real-valued parameters. Proc. Genetic and Evolutionary Computation Conf.
59. R. Mcgill, J. W. Tukey, and W. A. Larsen, "Variations of box plots," The Amer. Statist., vol.32, no.1, pp. 12-16, 1978.
60. C. Mattiussi. (2005). Evolutionary synthesis of analog networks. Ph.D. dissertation, Lausanne, Switzerland.
61. V. Kvasnicka and J. Pospíchal. (2002, Jan.). Emergence of modularity in genotypephenotype mappings. Artif. Life 8(4), pp. 295-310.
62. J. Sarma and K. De Jong, "An analysis of the effects of neightborhood size and shape on local selection algorithms," in Parallel Problem Solving from Nature-PPSN IV. 1996, pp. 236-244.
63. D. Whitley, S. Rana, and R. B. Heckendorn. (1998). The island model genetic algorithm: On separability, population size and convergence. J. Comput. Inform. Technol. 7, pp. 33-47.
64. P. Moscato. (1989). On evolution, search, optimization, genetic algorithms and martial arts: Towards memetic algorithms.
65. Y. S. Ong, M. H. Lim, N. Zhu, and K. W. Wong. (2006). Classification of adaptive memetic algorithms: A comparative study. IEEE Trans. Syst., Man, Cybern. B 36(1), pp. 141-152.