On the performance of indirect encoding across the continuum of regularity

IEEE Transactions on Evolutionary Computation

Volumn 15, Issue 3, 2011, Pages 346-367

  Clune, Jeff ^a,b   Stanley, Kenneth O ^c   Pennock, Robert T ^a   Ofria, Charles ^a  

^a Michigan State University   (United States)

^b Cornell University   (United States)

^c University of Central Florida   (United States)

Author keywords

Artificial neural networks; developmental encodings; generative encodings; HyperNEAT; indirect encodings; regularity

Indexed keywords

COMPREHENSIVE STUDIES; DESIGN PRINCIPLES; DIRECT ENCODING; DOMAIN KNOWLEDGE; ENCODINGS; HIGH-DIMENSIONAL; HYPERNEAT; REAL-WORLD PROBLEM; REFINING PROCESS; REGULAR SOLUTION; REGULARITY; STAND-ALONE ALGORITHM; THREE PROBLEMS;

EVOLUTIONARY ALGORITHMS; NEURAL NETWORKS;

ENCODING (SYMBOLS);

EID: 79959710425     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2010.2104157     Document Type: Article

References (54)

1. H. Lipson, "Principles of modularity, regularity, and hierarchy for scalable systems," J. Biol. Phys. Chem., vol. 7, no. 4, p. 125, 2007.
2. K. Stanley and R. Miikkulainen, "A taxonomy for artificial embryo-geny," Artif. Life, vol. 9, no. 2, pp. 93-130, 2003.
3. S. Carroll, Endless Forms Most Beautiful: The New Science of Evo Devo and the Making of the Animal Kingdom. New York: Norton, 2005.
4. S. Carroll, J. Grenier, and S. Weatherbee, From DNA to Diversity. Malden, MA: Blackwell Science, 2001.
5. R. Raff and J. Slack, The Shape of Life: Genes, Development, and the Evolution of Animal Form. Chicago, IL: University of Chicago Press, 1996.
6. C. Southan, "Has the yo-yo stopped? An assessment of human protein-coding gene number," Proteomics, vol. 4, no. 6, pp. 1712-1726, 2004. (Pubitemid 38738328)
7. D. D'Ambrosio and K. Stanley, "A novel generative encoding for exploiting neural network sensor and output geometry," in Proc. Genet. Evol. Comput. Conf., 2007, pp. 974-981. (Pubitemid 47291650)
8. J. Gauci and K. Stanley, "Generating large-scale neural networks through discovering geometric regularities," in Proc. Genet. Evol. Comput. Conf., 2007, pp. 997-1004. (Pubitemid 47291653)
9. F. Gruau and E. Lip, "Genetic synthesis of Boolean neural networks with a cell rewriting developmental process," in Proc. Int. Workshop Combin. Genet. Algorithms Neural Netw., 1992, pp. 55-74.
10. F. Gruau, D. Whitley, and L. Pyeatt, "A comparison between cellular encoding and direct encoding for genetic neural networks," in Proc. 1st Annu. Conf. Genet. Programming, 1996, pp. 81-89.
11. G. Hornby and J. Pollack, "Creating high-level components with a generative representation for body-brain evolution," Artif. Life, vol. 8, no. 3, pp. 223-246, 2002.
12. J. Miller, "Evolving a self-repairing, self-regulating, French flag organism," in Proc. Genet. Evol. Comput. Conf., 2004, pp. 129-139. (Pubitemid 39747204)
13. J. Reisinger and R. Miikkulainen, "Acquiring evolvability through adaptive representations," in Proc. Genet. Evol. Comput. Conf., 2007, p. 1052.
14. K. Stanley, D. D'Ambrosio, and J. Gauci, "A hypercube-based encoding for evolving large-scale neural networks," Artif. Life, vol. 15, no. 2, pp. 185-212, 2009.
15. G. Striedter, Principles of Brain Evolution. Sunderland, MA: Sinauer Associates, 2005.
16. K. Stanley, "Compositional pattern producing networks: A novel abstraction of development," Genet. Programming Evol. Mach., vol. 8, no. 2, pp. 131-162, 2007. (Pubitemid 46904474)
17. J. Clune, C. Ofria, and R. Pennock, "The sensitivity of HyperNEAT to different geometric representations of a problem," in Proc. Genet. Evol. Comput. Conf., 2009, pp. 675-682.
18. J. Gauci and K. Stanley, "A case study on the critical role of geometric regularity in machine learning," in Proc. AAAI Conf. Artif. Intell., 2008, pp. 628-633.
19. J. Gauci and K. Stanley, "Autonomous evolution of topographic regularities in artificial neural networks," Neural Comput., vol. 22, no. 7, pp. 1860-1898, 2010.
20. J. Clune, B. Beckmann, C. Ofria, and R. Pennock, "Evolving coordinated quadruped gaits with the HyperNEAT generative encoding," in Proc. IEEE Congr. Evol. Comput., May 2009, pp. 2764-2771.
21. D. D'Ambrosio and K. Stanley, "Generative encoding for multiagent learning," in Proc. Genet. Evol. Comput. Conf., 2008, pp. 819-826.
22. D. D'Ambrosio, J. Lehman, S. Risi, and K. Stanley, "Evolving policy geometry for scalable multiagent learning," in Proc. Conf. Autonomous Agents Multiagent Syst., 2010, pp. 731-738.
23. P. Verbancsics and K. O. Stanley, "Transfer learning through indirect encoding," in Proc. Genet. Evol. Comput. Conf., 2010, pp. 547-554.
24. J. Secretan, N. Beato, D. D Ambrosio, A. Rodriguez, A. Campbell, and K. Stanley, "Picbreeder: Evolving pictures collaboratively online," in Proc. Comput. Hum. Interaction Conf., 2008, pp. 1759-1768.
25. K. Stanley and R. Miikkulainen, "Evolving neural networks through augmenting topologies," Evol. Comput., vol. 10, no. 2, pp. 99-127, 2002.
26. K. Stanley and R. Miikkulainen, "Competitive coevolution through evolutionary complexification," J. Artif. Intell. Res., vol. 21, no. 1, pp. 63-100, 2004. (Pubitemid 41525898)
27. J. Clune, B. Beckmann, P. McKinley, and C. Ofria, "Investigating whether HyperNEAT produces modular neural networks," in Proc. Genet. Evol. Comput. Conf., 2010, pp. 635-642.
28. J. Clune, B. Beckmann, R. Pennock, and C. Ofria, "HybrID: A hybridization of indirect and direct encodings for evolutionary computation," in Proc. Eur. Conf. Artif. Life, 2009, pp. 1-8.
29. J. Clune, C. Ofria, and R. Pennock, "How a generative encoding fares as problem-regularity decreases," in Proc. Parallel Problem Solving From Nature, 2008, pp. 358-367.
30. C. Ridderstrom, "Legged locomotion control: A literature survey," Royal Instit. Technol., Stockholm, Sweden, Tech. Rep. TRITA-MMK, ISSN 1400-1179, 1999.
31. D. Wettergreen and C. Thorpe, "Gait generation for legged robots," in Proc. IEEE Int. Conf. Intell. Robots Syst., Jul. 1992, pp. 1413-1420.
32. G. Hornby, S. Takamura, T. Yamamoto, and M. Fujita, "Autonomous evolution of dynamic gaits with two quadruped robots," IEEE Trans. Robot., vol. 21, no. 3, pp. 402-410, Jun. 2005. (Pubitemid 40858156)
33. J. Gallagher, R. Beer, K. Espenschied, and R. Quinn, "Application of evolved locomotion controllers to a hexapod robot," Robot. Autonomous Syst., vol. 19, no. 1, pp. 95-103, 1996. (Pubitemid 126371856)
34. F. Gruau, "Automatic definition of modular neural networks," Adaptive Behavior, vol. 3, no. 2, pp. 151-183, 1994.
35. G. Hornby, H. Lipson, and J. Pollack, "Generative representations for the automated design of modular physical robots," IEEE Trans. Robot. Autom., vol. 19, no. 4, pp. 703-719, Aug. 2003.
36. H. Liu and H. Iba, "A hierarchical approach for adaptive humanoid robot control," in Proc. IEEE Congr. Evol. Comput., Jun. 2004, pp. 1546-1553.
37. K. Sims, "Evolving 3-D morphology and behavior by competition," Artif. Life, vol. 1, no. 4, pp. 353-372, 1994.
38. R. Téllez, C. Angulo, and D. Pardo, "Evolving the walking behavior of a 12 DOF quadruped using a distributed neural architecture," in Biologically Inspired Approaches to Advanced Information Technology. Berlin, Germany: Springer, 2006, pp. 5-19. (Pubitemid 43849493)
39. V. Valsalam and R. Miikkulainen, "Modular neuroevolution for mul-tilegged locomotion," in Proc. Genet. Evol. Comput. Conf., 2008, pp. 265-272.
40. R. Beer and J. Gallagher, "Evolving dynamical neural networks for adaptive behavior," Adaptive Behav., vol. 1, no. 1, p. 91, 1992.
41. D. Filliat, J. Kodjabachian, and J. Meyer, "Evolution of neural controllers for locomotion and obstacle avoidance in a six-legged robot," Connection Sci., vol. 11, no. 3, pp. 225-242, 1999.
42. J. Kodjabachian and J. Meyer, "Evolution and development of neural controllers for locomotion, gradient-following, and obstacle-avoidance in artificial insects," IEEE Trans. Neural Netw., vol. 9, no. 5, pp. 796-812, Sep. 1998. (Pubitemid 128743647)
43. M. Raibert, M. Chepponis, and H. Brown, Jr., "Running on four legs as though they were one," IEEE J. Robot. Autom., vol. 2, no. 2, pp. 70-82, Jun. 1986. (Pubitemid 16630264)
44. S. Nolfi and D. Floreano, Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines. Cambridge, MA: MIT Press, 2000.
45. K. Wolff and P. Nordin, "An evolutionary based approach for control programming of humanoids," in Proc. 3rd Int. Conf. Humanoid Robots, 2003, pp. 1-19.
46. M. Taylor, P. Stone, and Y. Liu, "Transfer learning via inter-task mappings for temporal difference learning," J. Mach. Learning Res., vol. 8, no. 1, pp. 2125-2167, 2007. (Pubitemid 47510988)
47. A. Eiben, Z. Michalewicz, M. Schoenauer, and J. Smith, "Parameter control in evolutionary algorithms," in Parameter Setting in Evolutionary Algorithms. Berlin, Germany: Springer, 2007, pp. 19-46.
48. J. Grimbleby, "Automatic analogue circuit synthesis using genetic algorithms," IEE Proc. Circuits Devices Syst., vol. 147, no. 6, pp. 319-324, Dec. 2000.
49. A. Soltoggio, J. Bullinaria, C. Mattiussi, P. Durr, and D. Floreano, "Evolutionary advantages of neuromodulated plasticity in dynamic, reward-based scenarios," in Proc. Int. Conf. Artif. Life, vol. 11. 2008, pp. 569-576.
50. A. Soltoggio, P. Durr, C. Mattiussi, and D. Floreano, "Evolving neu-romodulatory topologies for reinforcement learning-like problems," in Proc. IEEE Congr. Evol. Comput., Sep. 2007, pp. 2471-2478. (Pubitemid 351371708)
51. S. Risi and K. Stanley, "Indirectly encoding neural plasticity as a pattern of local rules," in Proc. 11th Int. Conf. Simul. Adaptive Behav., to be submitted.
52. Y. LeCun, B. Boser, J. Denker, D. Henderson, R. Howard, W. Hub-bard, and L. Jackel, "Backpropagation applied to handwritten zip code recognition," Neural Comput., vol. 1, no. 4, pp. 541-551, 1989.
53. D. Rumelhart, G. Hinton, and R. Williams, Learning Internal Representations by Error Propagation, Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1: Foundations. Cambridge, MA: MIT Press, 1986.
54. S. Lawrence, C. Giles, A. Tsoi, and A. Back, "Face recognition: A convolutional neural-network approach," IEEE Trans. Neural Netw., vol. 8, no. 1, pp. 98-113, Jan. 1997. (Pubitemid 127767784)