An enhanced hypercube-based encoding for evolving the placement, density, and connectivity of neurons

Artificial Life

Volumn 18, Issue 4, 2012, Pages 331-363

  Risi, Sebastian ^a   Stanley, Kenneth O ^a  

^a University of Central Florida   (United States)

Author keywords

Artificial neural networks; Compositional pattern producing networks; Generative and developmental systems; HyperNEAT; Indirect encoding; Neuroevolution

Indexed keywords

AIR NAVIGATION; BIOINFORMATICS; ENCODING (SYMBOLS); EVOLUTIONARY ALGORITHMS; GEOMETRY; NEURONS; SIGNAL ENCODING; TOPOGRAPHY;

COMPOSITIONAL PATTERN-PRODUCING NETWORKS; GENERATIVE AND DEVELOPMENTAL SYSTEMS; HYPERNEAT; INDIRECT ENCODING; NEURO EVOLUTIONS;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; EVOLUTION; HUMAN; LEARNING; METABOLISM; NERVE CELL; NERVE CELL NETWORK;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOLOGICAL EVOLUTION; COMPUTER SIMULATION; HUMANS; LEARNING; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONS;

EID: 85047688002     PISSN: 10645462     EISSN: 15309185     Source Type: Journal    
DOI: 10.1162/ARTL_a_00071     Document Type: Article

References (67)

1. Aaltonen, T., et al. (2010). Measurement of the top quark mass with dilepton events selected using neuroevolution at CDF. Physical Review D, 81, 030102.
2. Angeline, P. J. (1995). Morphogenic evolutionary computations: Introduction, issues and examples. In J. R. McDonnell, R. G. Reynolds, & D. B. Fogel (Eds.), Evolutionary Programming IV: The Fourth Annual Conference on Evolutionary Programming (pp. 387-401).
3. Angeline, P. J., Saunders, G. M., & Pollack, J. B. (1994). An evolutionary algorithm that constructs recurrent neural networks. IEEE Transactions on Neural Networks, 5(1), 54-65.
4. Astor, J. S., & Adami, C. (2000). A developmental model for the evolution of artificial neural networks. Artificial Life, 6(3), 189-218.
5. Bentley, P. J., & Kumar, S. (1999). The ways to grow designs: A comparison of embryogenies for an evolutionary design problem. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-1999) (pp. 35-43).
6. Bongard, J. (2002). Evolving modular genetic regulatory networks. In Proceedings of the 2002 Congress on Evolutionary Computation (CEC-2002), Vol. 2 (pp. 1872-1877).
7. Clune, J., Beckmann, B. E., McKinley, P., & Ofria, C. (2010). Investigating whether HyperNEAT produces modular neural networks. In GECCO 10: Proceedings of the Genetic and Evolutionary Computation Conference (pp. 635-642).
8. Clune, J., Beckmann, B. E., Ofria, C., & Pennock, R. T. (2009). Evolving coordinated quadruped gaits with the HyperNEAT generative encoding. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC-2009) Special Section on Evolutionary Robotics.
9. Clune, J., Stanley, K., Pennock, R., & Ofria, C. (2011). On the performance of indirect encoding across the continuum of regularity. IEEE Transactions on Evolutionary Computation, 15(3), 346-367.
10. Cybenko, G. (1989). Approximation by superpositions of a sigmoidal function. Mathematics of Control, Signals, and Systems, 2(4), 303-314.
11. D'Ambrosio, D., & Stanley, K. O. (2007). A novel generative encoding for exploiting neural network sensor and output geometry. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2007).
12. Drchal, J., Koutnk, J., & Šnorek, M. (2009). HyperNEAT controlled robots learn to drive on roads in simulated environment. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC 2009).
13. Dürr, P., Mattiussi, C., & Floreano, D. (2010). Genetic representation and evolvability of modular neural controllers. IEEE Computational Intelligence Magazine, 5(3), 10-19.
14. Eggenberger, P. (1997). Creation of neural networks based on developmental and evolutionary principles. In W. Gerstner, A. Germond, M. Hasler, & J.-D. Nicoud (Eds.), Seventh International Conference on Artificial Neural Networks (ICANN-97) (pp. 337-342).
15. Eggenberger, P. (1997). Evolving morphologies of simulated 3D organisms based on differential gene expression. In Fourth European Conference on Artificial Life (pp. 205-213).
16. Finkel, R., & Bentley, J. (1974). Quad trees: A data structure for retrieval on composite keys. Acta Informatica, 4(1), 1-9.
17. Floreano, D., Dürr, P., & Mattiussi, C. (2008). Neuroevolution: From architectures to learning. Evolutionary Intelligence, 1(1), 47-62.
18. Gauci, J., & Stanley, K. O. (2008). A case study on the critical role of geometric regularity in machine learning. In Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence (AAAI-2008).
19. Gauci, J., & Stanley, K. O. (2010). Autonomous evolution of topographic regularities in artificial neural networks. Neural Computation, 22, 1860-1898.
20. Gomez, F. J., & Miikkulainen, R. (1999). Solving non-Markovian control tasks with neuroevolution. In Proceedings of the 16th International Joint Conference on Artificial Intelligence (pp. 1356-1361).
21. Green, C. (2003-2006). SharpNEAT homepage. http://sharpneat.sourceforge. net/.
22. Gruau, F., Whitley, D., & Pyeatt, L. (1996). A comparison between cellular encoding and direct encoding for genetic neural networks. In Genetic Programming 1996: Proceedings of the First Annual Conference (pp. 81-89).
23. Hansen, T. F. (2003). Is modularity necessary for evolvability? Remarks on the relationship between pleiotropy and evolvability. Biosystems, 69(2-3), 83-94.
24. Harding, S., Miller, J. F., & Banzhaf, W. (2010). Developments in Cartesian genetic programming: Self-modifying CGP. Genetic Programming and Evolvable Machines, 11(3-4), 397-439.
25. Harvey, I. (1993). The artificial evolution of adaptive behavior. Ph.D. thesis, School of Cognitive and Computing Sciences, University of Sussex, UK.
26. Hornby, G. S., & Pollack, J. B. (2002). Creating high-level components with a generative representation for body-brain evolution. Artificial Life, 8(3), 223-246.
27. Jakobi, N. (1995). Harnessing morphogenesis. In Proceedings of Information Processing in Cells and Tissues (pp. 29-41).
28. Kandel, E. R., Schwartz, J. H., & Jessell, T. M. (Eds.). (1991). Principles of neural science (3rd ed.). Amsterdam: Elsevier.
29. Kashtan, N., & Alon, U. (2005). Spontaneous evolution of modularity and network motifs. Proceedings of the National Academy of Sciences of the United States of America, 102(39), 13773.
30. Khan, G. M., Miller, J. F., & Halliday, D. M. (2011). Evolution of Cartesian genetic programs for development of learning neural architecture. Evolutionary Computation, 19(3), 469-523.
31. Kirschner, M., & Gerhart, J. (1998). Evolvability. Proceedings of the National Academy of Sciences of the United States of America, 95(15), 8420.
32. Lehman, J., & Stanley, K. O. (2008). Exploiting open-endedness to solve problems through the search for novelty. In S. Bullock, J. Noble, R. Watson, & M. Bedau (Eds.), Proceedings of the Eleventh International Conference on Artificial Life (Alife XI).
33. Lehman, J., & Stanley, K. O. (2011). Improving evolvability through novelty search and self-adaptation. In Proceedings of the 2011 IEEE Congress on Evolutionary Computation (pp. 2693-2700).
34. Lehman, J., & Stanley, K. O. (2011). Abandoning objectives: Evolution through the search for novelty alone. Evolutionary Computation, 19(2), 189-223.
35. Lipson, H. (2007). Principles of modularity, regularity, and hierarchy for scalable systems. Journal of Biological Physics and Chemistry, 7(4), 125.
36. Martin, A. P. (1999). Increasing genomic complexity by gene duplication and the origin of vertebrates. The American Naturalist, 154(2), 111-128.
37. Miller, J. F. (2004). Evolving a self-repairing, self-regulating, French flag organism. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2004).
38. Miller, J. F., & Thomson, P. (2000). Cartesian genetic programming. In Proceedings of the Third European Conference on Genetic Programming (pp. 121-132).
39. Mjolsness, E., Sharp, D. H., & Reinitz, J. (1991). A connectionist model of development. Journal of Theoretical Biology, 152, 429-453.
40. Nolfi, S., & Parisi, D. (1992). Growing neural networks. In C. G. Langton (Ed.), Proceedings of the Workshop on Artificial Life (ALIFE 92).
41. Pigliucci, M. (2008). Is evolvability evolvable? Nature Reviews Genetics, 9(1), 75-82.
42. Reil, T., & Husbands, P. (2002). Evolution of central pattern generators for bipedal walking in a real-time physics environment. IEEE Transactions on Evolutionary Computation, 6(2), 159-168.
43. Reisinger, J., Stanley, K. O., & Miikkulainen, R. (2005). Towards an empirical measure of evolvability. In Genetic and Evolutionary Computation Conference (GECCO2005) workshop program (pp. 257-264).
44. Risi, S., Lehman, J., & Stanley, K. O. (2010). Evolving the placement and density of neurons in the HyperNEAT substrate. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2010) (pp. 563-570).
45. Risi, S., & Stanley, K. O. (2010). Indirectly encoding neural plasticity as a pattern of local rules. In S. Doncieux, B. Girard, A. Guillot, J. Hallam, J.-A. Meyer, & J.-B. Mouret (Eds.), From Animals to Animats 11, Proceedings of the 11th International Conference on Simulation of Adaptive Behavior (pp. 533-543). Berlin: Springer.
46. Risi, S., & Stanley, K. O. (2011). Enhancing ES-HyperNEAT to evolve more complex regular neural networks. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2011) (pp. 1539-1546).
47. Rosenfeld, A. (1980). Quadtrees and pyramids for pattern recognition and image processing. In Proceedings of the 5th International Conference on Pattern Recognition (pp. 802-809).
48. Saravanan, N., & Fogel, D. B. (1995). Evolving neural control systems. IEEE Expert: Intelligent Systems and Their Applications, 10(3), 23-27.
49. Secretan, J., Beato, N., D'Ambrosio, D. B., Rodriguez, A., Campbell, A., Folsom-Kovarik, J. T., & Stanley, K. O. (2011). Picbreeder: A case study in collaborative evolutionary exploration of design space. Evolutionary Computation, 19(3), 373-403.
50. Secretan, J., Beato, N., D'Ambrosio, D. B., Rodriguez, A., Campbell, A., & Stanley, K. O. (2008). Picbreeder: Evolving pictures collaboratively online. In CHI 08: Proceedings of the Twenty-sixth Annual SIGCHI Conference on Human Factors in Computing Systems (pp. 1759-1768).
51. Sporns, O. (2002). Network analysis, complexity, and brain function. Complexity, 8(1), 56-60.
52. Stanley, K. O. (2007). Compositional pattern producing networks: A novel abstraction of development. Genetic Programming and Evolvable Machines, 8(2), 131-162.
53. Stanley, K. O., Bryant, B. D., & Miikkulainen, R. (2003). Evolving adaptive neural networks with and without adaptive synapses. In Proceedings of the 2003 IEEE Congress on Evolutionary Computation (CEC-2003).
54. Stanley, K. O., Bryant, B. D., & Miikkulainen, R. (2005). Real-time neuroevolution in the NERO video game. IEEE Transactions on Evolutionary Computation, 9(6), 653-668.
55. Stanley, K. O., D'Ambrosio, D. B., & Gauci, J. (2009). A hypercube-based indirect encoding for evolving large-scale neural networks. Artificial Life, 15(2), 185-212.
56. Stanley, K. O., & Miikkulainen, R. (2002). Evolving neural networks through augmenting topologies. Evolutionary Computation, 10, 99-127.
57. Stanley, K. O., & Miikkulainen, R. (2003). A taxonomy for artificial embryogeny. Artificial Life, 9(2), 93-130.
58. Stanley, K. O., & Miikkulainen, R. (2004). Competitive coevolution through evolutionary complexification. Journal of Artificial Intelligence Research, 21, 63-100.
59. Strobach, P. (1991). Quadtree-structured recursive plane decomposition coding of images. Signal Processing, 39, 1380-1397.
60. Taylor, M. E., Whiteson, S., & Stone, P. (2006). Comparing evolutionary and temporal difference methods in a reinforcement learning domain. In GECCO 2006: Proceedings of the Genetic and Evolutionary Computation Conference (pp. 1321-1328).
61. Verbancsics, P., & Stanley, K. O. (2010). Evolving static representations for task transfer. Journal of Machine Learning Research, 99, 1737-1769.
62. Verbancsics, P., & Stanley, K. O. (2011). Constraining connectivity to encourage modularity in HyperNEAT. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2011).
63. Wagner, G. P., & Altenberg, L. (1996). Perspective: Complex adaptations and the evolution of evolvability. Evolution, 50(3), 967-976.
64. Watson, J. D., Hopkins, N. H., Roberts, J. W., Steitz, J. A., & Weiner, A. M. (1987). Molecular biology of the gene (4th ed.). Menlo Park, CA: Benjamin Cummings.
65. Whiteson, S., & Stone, P. (2006). Evolutionary function approximation for reinforcement learning. Journal of Machine Learning Research, 7, 877-917.
66. Yao, X. (1999). Evolving artificial neural networks. Proceedings of the IEEE, 87(9), 1423-1447.
67. Zigmond, M. J., Bloom, F. E., Landis, S. C., Roberts, J. L., & Squire, L. R. (Eds.). (1999). Fundamental neuroscience. London: Academic Press.