Evolutionary morphogenesis for multi-cellular systems

Genetic Programming and Evolvable Machines

Volumn 8, Issue 1, 2007, Pages 61-96

  Roggen, Daniel ^a,b   Federici, Diego ^c,d   Floreano, Dario ^a  

^a EPFL   (Switzerland)

^b ETH ZURICH   (Switzerland)

^c NORWEGIAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Norway)

^d GOOGLE   (Switzerland)

Author keywords

Developmental system; Evolutionary computation; Evolvable hardware; Genotype to phenotype mapping; Neural network

Indexed keywords

FAULT RATES; MORPHOGENESIS; MORPHOGENETIC SYSTEMS; PHENOTYPE MAPPING;

CELLS; COMPUTATIONAL METHODS; COMPUTER HARDWARE; EVOLUTIONARY ALGORITHMS; FAULT TOLERANCE; NEURAL NETWORKS;

GENE ENCODING;

EID: 33847752625     PISSN: 13892576     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10710-006-9019-1     Document Type: Article

References (92)

1. L. Altenberg, "The evolution of evolvability," in. Advances in Genetic Programming, K. Kinnear (ed.), MIT Press: Cambridge, MA, 1994, pp. 47-74.
2. P. J. Angeline, "Morphogenic evolutionary computations: Introduction, issues and examples," in The Fourth Annual Conference on Evolutionary Programming, J. R. McDonnel, R. G. Reynolds and D. B. Fogel (eds.), MIT Press: Cambridge, MA, 1995, pp. 387-401.
3. J. C. Astor and C. Adami, "A developmental model for the evolution of artificial neural networks," Artificial Life, vol. 6, pp. 189-218, 2000.
4. W. Banzhaf and J. Miller, "The challenge of complexity," in Frontiers of Evolutionary Computation, volume 11 of Genetic Algorithms And Evolutionary Computation Series, A. Menon (ed.), Kluwer Academic Publishers: Boston, MA, USA, chapter 11, 2004, pp. 73-99.
5. P. J. Bentley, "Fractal proteins," Genetic Programming and Evolvable Machines, vol. 5, pp.71-101, 2004.
6. P. J. Bentley and S. Kumar, "Three ways to grow designs: A comparison of embryogenies for an evolutionary design problem," in Proceeding of Genetic and Evolutionary Computation Conference, W. Banzhaf, J. Daida, A. E. Eiben, M. H. Garzon, V. Honavar, M. Jakiela, and R. E. Smith (eds.), Morgan Kaufmann: San Francisco, CA, 1999, pp. 35-43.
7. E. J. W. Boers and H. Kuiper, "Biological metaphors and the design of modular artificial neural networks," Master's thesis, Department of Computer Science and Experimental and Theoretical Psychology, Leiden University: The Netherlands, 1992.
8. J. C. Bongard and R. Pfeifer, "Evolving complete agents using artificial ontogeny," in Morpho-Functional Machines: The New Species (Designing Embodied Intelligence), F. Hara and R. Pfeifer, (eds.), Springer-Verlag: Heidelberg, 2003, pp. 237-258.
9. C. A. Coello, A. H. Aguirre, and B. P. Buckles, "Evolutionary multiobjective design of combinational logic circuits," in 2nd NASA/DoD Worksliop on Evolvable Hardware, J. Lohn et al. (eds.), IEEE Computer Society Press: Los Alamitos, CA, 2000, pp. 161-170.
10. E. Coen, The Art of Genes, Oxford University Press: Oxford, 1999.
11. H. de Garis, Genetic Programming: GenNets, Artificial Nervous Systems, Artificial Embryos. PhD thesis, Brussels University, 1992.
12. H. de Garis, "Growing an artificial brain with a million neural net modules inside a trillion cell cellular automaton machine," in Proceedings of the Fourth International Symposium on Micro Machine and Computer Science, 1993, pp. 211-214.
13. H. de Garis, L. de Penning, A. Buller, and D. Decesare, "Early experiments on the CAM-brain machine (CBM)," in 1st NASA/DoD Workshop on Evolvable Hardware, A. Stoica et al. (eds.), IEEE Computer Society Press: Los Alamitos, CA, 2001, pp. 211-219.
14. F. Dellaert and R. Beer, "A developmental model for the evolution of complete autonomous agents," in Proceedings of the 4th International Conference on Simulation of Adaptive Behavior, P. Maes, M. J. Mataric, J.-A. Meyer, J. Pollack and S. Wilson (eds.), MIT Press-Bradford Books: Cambridge, MA, 1996, pp. 393-401.
15. E. A. Di Paolo, "Spike timing dependent plasticity for evolved robots," Adaptive Behavior, vol. 10, pp. 243-263, 2002.
16. P. Eggenberger, "Cell interactions as a control tool of developmental processes for evolutionary robotics," in Proceedings of the 4th International Conference on Simulation of Adaptive Behavior, P. Maes, M. J. Mataric, J.-A. Meyer, J. Pollack, and S. Wilson (eds.), MIT Press-Bradford Books: Cambridge, MA, 1996, pp. 440-448.
17. P. Eggenberger, "Creation of neural networks based on developmental and evolutionary principles," in Proceedings of the International Conference on Artificial Neural Networks ICANN'97, W. Gerstner, A. Germond, M. Hasler, and J.-D. Nicoud (eds.), Springer-Verlag: Heidelberg, 1997, pp. 337-342.
18. P. Eggenberger, "Evolving morphologies of simulated 3D organisms based on differential gene expression," in Proceedings of the 4th European Conference on Artificial Life (ECAL97), P. Husbands and I. Harvey (eds.), MIT Press: Cambridge, MA, 1997, pp. 205-213.
19. D. Federici, "Evolving a neurocontroller through a process of embryogeny," in Proceedings of the 8th International Conference on Simulation of Adaptive Behavior, S. Schaal, A. Ijspeert, A. Billard, S. Vijayakumar, J. Hallam, and J.-A. Meyer (eds.), MIT Press-Bradford Book: Cambridge, MA, 2004, pp. 373-382.
20. D. Federici, "Using embryonic stages to increase the evolvability of development," in Proceedings of WORLDS Workshop at GECCO 2004, 2004.
21. D. Floreano and C. Mattiussi, "Evolution of spiking neural controllers for autonomous vision-based robots," in Evolutionary Robotics IV, T. Gomi (ed.), Springer-Verlag: Heidelberg, 2001, pp. 38-61.
22. D. Floreano and F. Mondada, "Automatic creation of an autonomous agent: Genetic evolution of a neural-network driven robot," in Proceedings of the 3rd International Conference on Simulation of Adaptive Behavior, D. Cliff, P. Husbands, J. Meyer, and S. W. Wilson (eds.), MIT Press-Bradford Books: Cambridge, MA, 1994, pp. 421-430.
23. D. Floreano, N. Schoeni, G. Caprari, and J. Blynel, "Evolutionary bits'n'spikes," in Proceedings of Artificial Life VIII, R. K. Standish, M. A. Bedau, and H. A. Abbass (eds.), MIT Press: Cambridge, MA, 2002, pp. 335-344.
24. W. Gerstner and W. Kistler, Spiking Neuron Models, Cambridge University Press, 2002.
25. D. E. Goldberg, Genetic Algorithms in Search Optimization & Machine Learning, Addison-Wesley: Reading, MA, 1989.
26. R. C. Gonzalez and R. E. Woods, Digital Image Processing, Addison-Wesley: Reading, MA, 1993.
27. T. Gordon, "Exploring models of development for evolutionary circuit design," in Congress on Evolutionary Computation (CEC2003), IEEE Press, 2003, pp. 2050-2057.
28. T. Gordon and P. Bentley, "Bias and scalability in evolutionary development," in Proceedings of the 2005 Genetic and Evolutionary Computation Conference, ACM Press, 2005, pp. 83-90.
29. T. Gordon and P. Bentley, "Development brings scalability to hardware evolution," in 2005 NASA/DoD Conference on Evolvable Hardware, J. Lohn et al. (ed.), IEEE Computer Society Press: Los Alamitos, CA, 2005, pp. 272-279.
30. F. Gruau, Neural Network Synthesis using Cellular Encoding and the Genetic Algorithm. PhD thesis, Laboratoire de l'Informatique du Parallélisme, Ecole Normale Supérieure de Lyon, France, 1994.
31. P. C. Haddow, G. Tufte, and P. van Remortel, "Shrinking the Genotype: L-systems for EHW?," in Proceedings of the 4th International Conference on Evolvable Systems (ICES 2001), Y. Liu et al. (eds.), Springer-Verlag: Heidelberg, 2001, pp. 128-139.
32. P. C. Haddow and P. van Remortel, "From here to there: Future robust EHW technologies for large digital designs," in 3rd NASA/DoD Workshop on Evolvable Hardware, D. Keymeulen et al. (eds.), IEEE Computer Society Press: Los Alamitos, CA, 2001, pp. 232-239.
33. G. Hartmann, G. Frank, G. Schäfer, and M. Wolff, "SPIKE 128K-An accelerator for dynamic simulation of large pulse-coded networks," in Proceedings of MicroNeuro 97, Dresden, 1997, pp. 130-139.
34. T. Higuchi, et al., "Evolving hardware with genetic learning: A first step towards building a Darwin machine," in Proceedings of the 2nd International Conference on Simulation of Adaptive Behaviour, J.-A. Meyer, H. Roitblat, and S. Wilson (eds.), MIT Press-Bradford Books: Cambridge, MA, 1993, pp. 417-424.
35. T. Higuchi, M. Iwata, D. Keymeulen, H. Sakanashi, M. Murakawa, I. Kajitani, E. Takahashi, K. Toda, M. Salami, N. Kajihara, and N. Otsu, "Real-world applications of analog and digital evolvable hardware," IEEE Transactions on Evolutionary Computation, vol. 3, pp. 220-235, 1999.
36. G. S. Hornby and J. B. Pollack, "Evolving L-systems to generate virtual creatures," Computers and Graphics, vol. 25, pp. 1041-1048, 2001.
37. G. Indiveri and R. Douglas, "ROBOTIC VISION: Neuromorphic vision sensors," Science, vol. 288, pp. 1189-1190, 2000.
38. N. Jakobi, Harnessing morphogenesis. Technical Report CSRP 423, School of Cognitive and Computing Sciences, University of Sussex, 1995.
39. I. Kajitani, T. Hoshino, D. Nishikawa, H. Yokoi, S. Nakaya, T. Yamauchi, T. Inuo, N. Kajihara, M. Iwata, D. Keymeulen, and T. Higuchi, "A gate-level EHW chip: implementing GA operations and reconfigurable hardware on a single LSI," in Proceedings of the 2nd International Conference on Evolvable Systems (ICES 98), M. Sipper et al. (eds.), Springer-Verlag, Heidelberg, 1998, pp. 1-12.
40. T. Kalganova, "Bidirectional incremental evolution in extrinsic evolvable hardware," in 2nd NASA/DoD Workshop on Evolvable Hardware, J. Lohn et al. (eds.), IEEE Computer Society Press: Los Alamitos, CA, 2000, pp. 65-74.
41. S. A. Kauffman, "Metabolic stability and epigenesis in randomly constructed genetic nets," Journal of Theoretical Biology, vol. 22, pp. 437-467, 1969.
42. S. Kazadi, Y. Qi, I. Park, N. Huang, P. Hwu, B. Kwan, W. Lue, and H. Li, "Insufficiency of piecewise evolution," in 3rd NASA/DoD Workshop on Evolvable Hardware, D. Keymeulen et al. (eds.), IEEE Computer Society Press: Los Alamitos, CA, 2001, pp. 223-231.
43. D. Keymeulen, R. Zebulum, Y. Jin, and A. Stoica, "Fault-tolerant evolvable hardware using field-programmable transistor arrays," IEEE Transactions on Reliability, vol. 49, pp. 305-316, 2000.
44. H. Kitano, "Designing neural networks using genetic algorithms with graph generation system," Complex Systems, vol. 4, pp. 461-476, 1990.
45. H. Kitano, "Challenges of evolvable systems: Analysis and future directions," in Proceedings of the 1st International Conference on Evolvable Systems (ICES 96), T. Higuchi et al. (eds.), Springer-Verlag: Heidelberg, 1996, pp. 125-135.
46. J. Kodjabachian and J.-A. Meyer, "Evolution and development of control architectures in animats," Robotics and Autonomous Systems, vol. 16, pp. 161-182, 1995.
47. A. Koopman and D. Roggen, "Evolving genetic regulatory networks for hardware fault tolerance," in Proceedings of Parallel Problem Solving from Nature VIII, X. Yao, E. Burke, J. A. Lozano, J. Smith, J. J. Merelo-Guervós, J. A. Bullinaria, J. Rowe, P. Tiňo, A. Kabń, and H.-P. Schwefel (eds.), Springer-Verlag: Heidelberg, 2004, pp. 561-570.
48. J. R. Koza, Genetic Programming, MIT Press, Cambridge, MA, 1992.
49. S. Kumar and P. J. Bentley, "Biologically inspired evolutionary development," in Proceedings of the 5th International Conference on Evolvable Systems (ICES 2003), A. M. Tyrrell et al. (eds.), Springer-Verlag: Heidelberg, 2003, pp. 57-68.
50. S. Kumar and P. J. Bentley, On Growth, Form and Computers, Academic Press: London, UK, 2003.
51. P. K. Lehre and P. C. Haddow, "Developmental mappings and phenotypic complexity," in Congress on Evolutionary Computation (CEC2003), IEEE Press, 2003, pp. 62-68.
52. A. Lindenmayer, "Mathematical models for cellular interactions in development," Journal of Theoretical Biology, vol. 18, pp. 280-299, 1968.
53. H. Liu, J. Miller, and A. Tyrrell, "A biological development model for the design of robust multiplier," in Applications of Evolutionary Computing: EvoHot, G. Drechsler, R. Squillero (eds.), Springer-Verlag: Heidelberg, 2005, pp. 195-204.
54. H. Liu, J. F. Miller, and A. M. Tyrrell, "An intrinsic robust transient fault-tolerant developmental model for digital systems," in Proceedings of WORLDS workshop at GECCO 2004, 2004.
55. S. Luke and L. Spector, "Evolving graphs and networks with edge encoding: Preliminary report," in Late Breaking Papers at the Genetic Programming 1996 Conference, J. R. Koza (ed.), 1996, pp. 117-124.
56. D. Mange, M. Sipper, A. Stauffer, and G. Tempesti, "Toward robust integrated circuits: The embryonics approach," in Proceedings of the IEEE, vol. 88, pp. 516-541, 2000.
57. P. Marchai, C. Piguet, D. Mange, A. Stauffer, and S. Durand, "Embryological development on silicon," in Proceedings of Artificial Life IV, R. Brooks and P. Maes (eds.), MIT Press, 1994, pp. 365-370.
58. C. Mattiussi and D. Floreano, "Evolution of analog networks using local string alignment on highly reorganizable genomes," in 2004 NASA/DoD Conference on Evolvable Hardware, R. Zebulum et al. (eds.), IEEE Computer Society Press: Los Alamitos, CA, 2004, pp. 30-37.
59. J. F. Miller, "Evolving developmental programs for adaptation, morphogenesis, and self-repair," in Proceedings of 7th European Conference on Artificial Life, W. Banzhaf, T. Christaller, P. Dittrich, J. T. Kim, and J. Ziegler (eds.), Springer-Verlag: Heidelberg, 2003, pp. 256-265.
60. E. Mjolsness, D. H. Sharp, and B. K. Alpert, "Scaling, machine learning, and genetic neural nets," Advances in Applied Mathematics, vol. 10, pp. 137-163, 1989.
61. F. Mondada, E. Franzi, and P. Ienne, "Mobile robot miniaturisation: A tool for investigation in control algorithms," in Proceedings of the 3rd International Symposium on Experimental Robotics, Springer-Verlag: Heidelberg, 1994, pp. 501-513.
62. C. L. Nehaniv, "Evolvability," BioSystems, vol. 69, pp. 77-81, 2003.
63. S. Nolfi and D. Parisi, Growing neural networks. Technical report, Institute of Psychology, Rome, 1992.
64. T. Quick, C. L. Nehaniv, K. Dautenhahn, and O. Roberts, "Evolving embodied genetic regulatory network-driven control systems," in Proceedings of the 7th European Conference on Artificial Life (ECAL2003), W. Banzhaf, T. Christaller, P. Dittrich, J. T. Kim, and J. Ziegler (eds.), Springer-Verlag: Heidelberg, 2003, pp. 266-277
65. D. Roggen, Multi-Cellular Reconfigurable Circuits: Evolution, Morphogenesis and Learning, PhD thesis, EPFL, Lausanne, Switzerland, 2005.
66. D. Roggen and D. Federici, "Multi-cellular development: is there scalability and robustness to gain?," in Proceedings of Parallel Problem Solving from Nature VIII, X. Yao, E. Burke, J. A. Lozano, J. Smith, J. J. Merelo-Guervós, J. A. Bullinaria, J. Rowe, P. Tiňo, A. Kabń, and H.-P. Schwefel (eds.), Springer-Verlag: Heidelberg, 2004, pp. 391-400.
67. D. Roggen and D. Floreano, "Hardware morphogenetic developmental system," Technical report, Laboratory of Intelligent Systems, EPFL, Lausanne, Switzerland, http://lis.epfl.ch/publications.php, 2004.
68. D. Roggen, D. Floreano, and C. Mattiussi, "A morphogenetic evolutionary system: Phylogenesis of the POEtic tissue," in Proceedings of the 5th International Conference on Evolvable Systems (ICES 2003), A. M. Tyrrell et al. (eds), Springer-Verlag: Heidelberg, 2003, pp. 153-164.
69. D. Roggen, S. Hofmann, Y. Thoma, and D. Floreano, "Hardware spiking neural network with runtime reconfigurable collectivity in an autonomous robot," in 2003 NASA/DoD Conference on Evolvable Hardware, J. Lohn et al. (eds.), IEEE Computer Society Press: Los Alamitos, CA, 2003, pp. 189-198.
70. A. G. Rust,Developmental Self-Organisation in Artificial Neural Networks. PhD thesis, Dept. of Computer Science, University of Hertfordshire, 1998.
71. D. Salomon, Data Compression: The Complete Reference, Springer-Verlag: Heidelberg, 2004.
72. T. Schoenauer, S. Atasoy, N. Mehrtash, and H. Klar, "NeuroPipe-Chip: A digital neuro-processor for spiking neural networks," IEEE Transactions on Neural Networks, vol. 13, pp. 205-213, 2002.
73. K. Sims, "Evolving 3D morphology and behavior by competition," in Proceedings of the Artificial Life IV, R. Brooks and P. Maes (eds.), MIT Press: Cambridge, MA, 1994, pp. 28-39.
74. T. Smith, P. Husbands, and M. O'Shea, "Not measuring evolvability: Initial investigation of an evolutionary robotics search space," in Congress on Evolutionary Computation (CEC2001), IEEE Press, 2001, pp. 9-16.
75. K. Stanley and R. Miikkulainen, "Evolving neural networks through augmenting topologies," Evolutionary Computation, vol. 10, pp. 99-127, 2002.
76. K. Stanley and R. Miikkulainen, "A taxonomy for artificial embryogeny," Artificial Life, vol. 9, pp. 93-130, 2003.
77. F. Streichert, C. Spieth, H. Ulmer, and A. Zell, "How to evolve the head-tail pattern from reaction-diffusion systems," in 2004 NASA/DoD Conference on Evolvable Hardware, R. Zebulum et al. (eds.), IEEE Computer Society Press: Los Alamitos, CA, 2004, pp. 261-268.
78. G. Tempesti, D. Mange, E. Petraglio, A. Stauffer, and Y. Thoma, "Developmental processes in silicon: An engineering perspective," in 2003 NASA/DoD Conference on Evolvable Hardware, J. Lohn et al. (eds.), IEEE Computer Society Press: Los Alamitos, CA, 2003, pp. 255-264.
79. A. Thompson, "An evolved circuit, intrinsic in silicon, entwined with physics," in Proceedings of the 1st International Conference on Evolvable Systems (ICES 96), T. Higuchi et al. (eds.), Springer-Verlag: Heidelberg, 1996, pp. 390-405.
80. A. Thompson, I. Harvey, and P. Husbands, "Unconstrained evolution and hard consequences," in Towards Evolvable Hardware, E. Sanchez and M. Tomassini (eds.), Springer-Verlag: Heidelberg, 1996, pp. 136-165.
81. O. Torres, J. Eriksson, J. M. Moreno, and A. Villa, "Hardware optimization of a novel spiking neuron model for the POEtic tissue," in Proceedings of the IWANN'03, J. Mira (ed.), Springer-Verlag: Heidelberg, 2003, pp. 113-120.
82. G. Tufte and P. C. Haddow, "Biologically-inspired: A rule-based self-reconfiguration of a virtex chip," in Proceedings of the 4th International Conference on Computational Science (ICCS 2004), M. Bubak, G. D. van Albada, P. M. A. Sloot, et al. (eds.), Springer-Verlag: Heidelberg, 2004, pp. 1249-125.
83. A. M. Turing, "The chemical basis of morphogenesis," Philosophical Transactions of the Royal Society of London, B, vol. 237, pp. 37-72, 1952.
84. A. M. Tyrrell, E. Sanchez, D. Floreano, G. Tempesti, D. Mange, J.-M. Moreno, J. Rosenberg, and A. Villa, "POEtic tissue: An integrated architecture for bio-inspired hardware," in Proceedings of the 5th International Conference on Evolvable Systems (ICES 2003), A. M. Tyrrell et al. (eds.), Springer-Verlag: Heidelberg, 2003, pp. 129-140.
85. J. Vaario, S. Ohsuga, and K. Hori, "Connectionist modeling using Lindenmayer systems," in Information Modeling and Knowledge Bases: Foundations, Theory, and Applications, Ohsuga et al. (eds.), IOS Press, 1991, pp. 496-510.
86. V. K. Vassilev, D. Job, and J. F. Miller, "Towards the automatic design of more efficient digital circuits," in 2nd NASA/DoD Workshop on Evolvable Hardware, J. Lohn et al. (eds.), IEEE Computer Society Press: Los Alamitos, CA, 2000, pp. 151-160.
87. V. K. Vassilev and J. F. Miller, "Scalability problems of digital circuit evolution: Evolvability and efficient designs," in 2nd NASA/DoD Workshop on Evolvable Hardware, J. Lohn et al. (eds.), IEEE Computer Society Press: Los Alamitos, CA, 2000, pp. 55-64.
88. G. P. Wagner and L. Altenberg, "Complex adaptations and the evolution of evolvability," Evolution, vol. 50, pp. 967-976, 1996.
89. L. Wolpert, "Do we understand development?," Science, vol. 266, pp. 571-572, 1994.
90. L. Wolpert, Principles of Development, Oxford University Press: Oxford, 1998.
91. X. Yao, "A review of evolutionary artificial neural networks," International Journal of Intelligent Systems, vol. 4, pp. 203-222, 1993.
92. X. Yao and T. Higuchi, "Promises and challenges of evolvable hardware," IEEE Transactions on Systems, Man, and Cybernetics, vol 29, pp. 87-97, 1999.