How novelty search escapes the deceptive trap of learning to learn

Proceedings of the 11th Annual Genetic and Evolutionary Computation Conference, GECCO-2009

Volumn , Issue , 2009, Pages 153-160

  Risi, Sebastian ^a   Vanderbleek, Sandy D ^a   Hughes, Charles E ^a   Stanley, Kenneth O ^a  

^a University of Central Florida   (United States)

Author keywords

Adaptation; Learning; Neat; Neural networks; Neuroevolution; Neuromodulation; Novelty search

Indexed keywords

ADAPTIVE BEHAVIOR; ARTIFICIAL NEURAL NETWORKS; LEARNING TO LEARN; NEAT; NEUROEVOLUTION; NEUROMODULATION; SEARCH ALGORITHMS;

ADAPTIVE SYSTEMS; BEHAVIORAL RESEARCH; EDUCATION; HEALTH; NEURAL NETWORKS;

LEARNING ALGORITHMS;

EID: 72749096047     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1569901.1569923     Document Type: Conference Paper

References (22)

1. T. Aaltonen et al. Measurement of the top quark mass with dilepton events selected using neuroevolution at CDF. Physical Review Letters, 2009. To appear.
2. J. Blynel and D. Floreano. Exploring the T-Maze: Evolving Learning-Like Robot Behaviors using CTRNNs. In 2nd European Workshop on Evolutionary Robotics (EvoRob'2003), Lecture Notes in Computer Science, 2003.
3. T. Carew, E. Walters, and E. Kandel. Classical conditioning in a simple withdrawal reflex in Aplysia californica. The Journal of Neuroscience, 1(12):1426-1437, 1981.
4. P. Darwen and Y. Yao. Every niching method has its niche: Fitness sharing and implicit sharing compared. Parallel Problem Solving from Nature (PPSN IV), pages 398-407, 1996.
5. D. Floreano and J. Urzelai. Evolutionary robots with online self-organization and behavioral fitness. Neural Networks, 13:431-443, 2000.
6. D. E. Goldberg and J. Richardson. Genetic algorithms with sharing for multimodal function optimization. In Proceedings of the Second International Conference on Genetic Algorithms on Genetic algorithms and their application, pages 41-49, Hillsdale, NJ, USA, 1987. L. Erlbaum Associates Inc.
7. G. E. Hinton and S. J. Nowlan. How learning can guide evolution. Complex Systems, 1, 1987.
8. G. S. Hornby. Alps: the age-layered population structure for reducing the problem of premature convergence. In GECCO '06: Proceedings of the 8th annual conference on Genetic and evolutionary computation, pages 815-822, New York, NY, USA, 2006. ACM.
9. J. Hu, E. Goodman, K. Seo, Z. Fan, and R. Rosenberg. The hierarchical fair competition (hfc) framework for sustainable evolutionary algorithms. Evolutionary Computation, 13(2):241-277, 2005. PMID: 15969902.
10. M. Hutter and S. Legg. Fitness uniform optimization. IEEE Transactions on Evolutionary Computation, 10:568-589, 2006.
11. E. D. Jong. The incremental pareto-coevolution archive. In Proceedings of the Genetic and Evolutionary Computation Conference, (GECCO-2004), Berlin, 2004. Springer.
12. J. Lehman and K. O. Stanley. Exploiting open endedness to solve problems through the search for novelty. In Proceedings of the Eleventh International Conference on Artificial Life, Cambridge, MA, 2008. MIT Press.
13. S. W. Mahfoud. Niching methods for genetic algorithms. PhD thesis, Champaign, IL, USA, 1995.
14. G. Mayley. Guiding or hiding: Explorations into the effects of learning on the rate of evolution. In Fourth European Conference on Artificial Life, pages 135-144. MIT Press, 1997.
15. Y. Niv, D. Joel, I. Meilijson, and E. Ruppin. Evolution of reinforcement learning in uncertain environments: A simple explanation for complex foraging behaviors. Adaptive Behavior, 10(1):5-24, 2002.
16. S. Nolfi and D. Floreano. Learning and evolution. Autonomous Robots, 7(1):89-113, July 1999.
17. S. Nolfi, D. Parisi, and J. L. Elman. Learning and evolution in neural networks. Adaptive Behavior, 3:5-28, 1994.
18. A. Soltoggio, J. A. Bullinaria, C. Mattiussi, P. Dürr, and D. Floreano. Evolutionary Advantages of Neuromodulated Plasticity in Dynamic, Reward-based Scenarios. In Artificial Life XI, pages 569-576, Cambridge, MA, 2008. MIT Press.
19. A. Soltoggio, P. Dürr, C. Mattiussi, and D. Floreano. Evolving neuromodulatory topologies for reinforcement learning-like problems. In Proceedings of the IEEE Congress on Evolutionary Computation, 2007.
20. K. O. Stanley. rtNEAT C++ software homepage: www.cs.utexas.edu/users/ nn/keyword?rtneat. 2006-2008.
21. K. O. Stanley, B. D. Bryant, and R. Miikkulainen. Evolving adaptive neural networks with and without adaptive synapses. In Proceedings of the 2003 IEEE Congress on Evolutionary Computation (CEC-2003). Canberra, Australia: IEEE Press, 2003.
22. K. O. Stanley and R. Miikkulainen. Evolving neural networks through augmenting topologies. Evolutionary Computation, 10:99-127, 2002.