Evolving large-scale neural networks for vision-based reinforcement learning

GECCO 2013 - Proceedings of the 2013 Genetic and Evolutionary Computation Conference

Volumn , Issue , 2013, Pages 1061-1068

  Koutník, Jan ^a   Cuccu, Giuseppe ^a   Schmidhuber, Jürgen ^a   Gomez, Faustino ^a  

^a DALLE MOLLE INSTITUTE FOR ARTIFICIAL INTELLIGENCE IDSIA   (Switzerland)

Author keywords

Games; Indirect encodings; Neuroevolution; Reinforcement learning; Vision based TORCS

Indexed keywords

CONTROL NETWORK; CONTROL TASK; GAMES; HIGH DIMENSIONALITY; INDIRECT ENCODINGS; NETWORK WEIGHTS; NEURO EVOLUTIONS; VISION BASED;

CALCULATIONS; ENCODING (SYMBOLS); NEURAL NETWORKS;

REINFORCEMENT LEARNING;

EID: 84883060087     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2463372.2463509     Document Type: Conference Paper

References (16)

1. G. Cuccu, M. Luciw, J. Schmidhuber, and F. Gomez. Intrinsically motivated evolutionary search for vision-based reinforcement learning. In Proceedings of the IEEE Conference on Development and Learning, and Epigenetic Robotics, 2011.
2. D. B. D'Ambrosio and K. O. Stanley. A novel generative encoding for exploiting neural network sensor and output geometry. In Proceedings of the 9th annual conference on Genetic and evolutionary computation, (GECCO), pages 974-981, New York, NY, USA, 2007. ACM.
3. J. Gauci and K. Stanley. Generating large-scale neural networks through discovering geometric regularities. In Proceedings of the Conference on Genetic and Evolutionary Computation, pages 997-1004, New York, NY, USA, 2007. ACM.
4. F. Gomez, J. Koutník, and J. Schmidhuber. Compressed network complexity search. In Proceedings of the 12th International Conference on Parallel Problem Solving from Nature (PPSN XII, Taormina, IT), 2012.
5. F. Gomez, J. Schmidhuber, and R. Miikkulainen. Accelerated neural evolution through cooperatively coevolved synapses. Journal of Machine Learning Research, 9(May):937-965, 2008.
6. F. Gruau. Cellular encoding of genetic neural networks. Technical Report RR-92-21, Ecole Normale Superieure de Lyon, Institut IMAG, Lyon, France, 1992.
7. H. Kitano. Designing neural networks using genetic algorithms with graph generation system. Complex Systems, 4:461-476, 1990.
8. J. Koutník, F. Gomez, and J. Schmidhuber. Evolving neural networks in compressed weight space. In Proceedings of the Conference on Genetic and Evolutionary Computation (GECCO), 2010.
9. J. Koutník, F. Gomez, and J. Schmidhuber. Searching for minimal neural networks in fourier space. In Proceedings of the 4th Annual Conference on Artificial General Intelligence, 2010.
10. J. Koutník, J. Schmidhuber, and F. Gomez. A frequency-domain encoding for neuroevolution. Technical report, arXiv:1212.6521, 2012.
11. D. Loiacono, P. L. Lanzi, J. Togelius, E. Onieva, D. A. Pelta, M. V. Butz, T. D. Lönneker, L. Cardamone, D. Perez, Y. Sáez, M. Preuss, and J. Quadflieg. The 2009 simulated car racing championship, 2009.
12. L. G. Roberts. Machine Perception of Three-Dimensional Solids. Outstanding Dissertations in the Computer Sciences. Garland Publishing, New York, 1963.
13. J. Schmidhuber. Discovering neural nets with low Kolmogorov complexity and high generalization capability. Neural Networks, 10(5):857-873, 1997.
14. R. K. Srivastava, J. Schmidhuber, and F. Gomez. Generalized compressed network search. In Proceedings of the 12th International Conference on Parallel Problem Solving from Nature (PPSN XII, Taormina, IT), 2012.
15. V. V. Tolat and B. Widrow. An adaptive "broom balancer" with visual inputs. In Proceedings of the IEEE International Conference on Neural Networks (San Diego, CA), pages 641-647. Piscataway, NJ: IEEE, 1988.
16. Y. Yekutieli, R. Sagiv-Zohar, R. Aharonov, Y. Engel, B. Hochner, and T. Flash. A dynamic model of the octopus arm. I. biomechanics of the octopus reaching movement. Journal of Neurophysiology, 94(2):1443-1458, 2005.