Evolving deep unsupervised convolutional networks for vision-based reinforcement learning

GECCO 2014 - Proceedings of the 2014 Genetic and Evolutionary Computation Conference

Volumn , Issue , 2014, Pages 541-548

  Koutník, Jan ^a   Schmidhuber, Jürgen ^a   Gomez, Faustino ^a  

^a DALLE MOLLE INSTITUTE FOR ARTIFICIAL INTELLIGENCE IDSIA   (Switzerland)

Author keywords

Deep learning; Games; Neuroevolution; Reinforcement learning; Vision based TORCS

Indexed keywords

CONTROLLERS; CONVOLUTION; CONVOLUTIONAL NEURAL NETWORKS; DEEP LEARNING; REINFORCEMENT LEARNING; VISION;

COMPACT FEATURES; CONVOLUTIONAL NETWORKS; GAMES; NEURAL NETWORK CONTROLLERS; NEURO EVOLUTIONS; PROBLEM DIMENSIONALITY; RECURRENT NEURAL NETWORK (RNN); VISION BASED;

RECURRENT NEURAL NETWORKS;

EID: 84905695541     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2576768.2598358     Document Type: Conference Paper

References (24)

1. D. C. Ciresan, U. Meier, L. M. Gambardella, and J. Schmidhuber. Deep big simple neural nets for handwritten digit recognition. Neural Computation, 22(12):3207-3220, 2010.
2. D. C. Ciresan, U. Meier, J. Masci, L. M. Gambardella, and J. Schmidhuber. Flexible, high performance convolutional neural networks for image classiffication. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), pages 1237-1242, 2011.
3. G. Cuccu, M. Luciw, J. Schmidhuber, and F. Gomez. Intrinsically motivated evolutionary search for vision-based reinforcement learning. In Proceedings of the IEEE Conference on Development and Learning, and Epigenetic Robotics, 2011.
4. D. B. D'Ambrosio and K. O. Stanley. A novel generative encoding for exploiting neural network sensor and output geometry. In Proceedings of the 9th Conference on Genetic and Evolutionary Computation, (GECCO), pages 974-981, New York, NY, USA, 2007. ACM.
5. F. Fernández and D. Borrajo. Two steps reinforcement learning. International Journal of Intelligent Systems, 23(2):213-245, 2008.
6. K. Fukushima. Neocognitron: A self-organizing neural network for a mechanism of pattern recognition unaflected by shift in position. Biological Cybernetics, 36(4):193-202, 1980.
7. J. Gauci and K. Stanley. Generating large-scale neural networks through discovering geometric regularities. In Proceedings of the Conference on Genetic and Evolutionary Computation, (GECCO), pages 997-1004, New York, NY, USA, 2007. ACM.
8. L. Gisslén, M. Luciw, V. Graziano, and J. Schmidhuber. Sequential Constant Size Compressors and Reinforcement Learning. In Proceedings of the Fourth Conference on Artificial General Intelligence, 2011.
9. F. Gomez, J. Schmidhuber, and R. Miikkulainen. Accelerated neural evolution through cooperatively coevolved synapses. Journal of Machine Learning Research, 9(May):937-965, 2008.
10. F. Gruau. Cellular encoding of genetic neural networks. Technical Report RR-92-21, Ecole Normale Superieure de Lyon, Institut IMAG, Lyon, France, 1992.
11. S. R. Jodogne and J. H. Piater. Closed-loop learning of visual control policies. Journal of Artificial Intelligence Research, 28:349-391, 2007.
12. H. Kitano. Designing neural networks using genetic algorithms with graph generation system. Complex Systems, 4:461-476, 1990.
13. J. Koutník, G. Cuccu, J. Schmidhuber, and F. Gomez. Evolving large-scale neural networks for vision-based reinforcement learning. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO), Amsterdam, 2013.
14. J. Koutník, F. Gomez, and J. Schmidhuber. Evolving neural networks in compressed weight space. In Proceedings of the Conference on Genetic and Evolutionary Computation (GECCO-10), 2010.
15. S. Lange and M. Riedmiller. Deep auto-encoder neural networks in reinforcement learning. In International Joint Conference on Neural Networks (IJCNN 2010), Barcelona, Spain, 2010.
16. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, November 1998.
17. R. Legenstein, N. Wilbert, and L. Wiskott. Reinforcement Learning on Slow Features of High-Dimensional Input Streams. PLoS Computational Biology, 6(8), 2010.
18. D. Pierce and B. Kuipers. Map learning with uninterpreted sensors and effectors. Artificial Intelligence, 92:169-229, 1997.
19. M. Riedmiller, S. Lange, and A. Voigtlaender. Autonomous reinforcement learning on raw visual input data in a real world application. In Proceedings of the International Joint Conference on Neural Networks (IJCNN), pages 1-8, Brisbane, Australia, 2012.
20. D. Scherer, A. Müller, and S. Behnke. Evaluation of pooling operations in convolutional architectures for object recognition. In Proceedings of the International Conference on Artificial Neural Networks, ICANN, 2010.
21. J. Schmidhuber. Discovering neural nets with low Kolmogorov complexity and high generalization capability. Neural Networks, 10(5):857-873, 1997.
22. R. S. Sutton, D. A. McAllester, S. P. Singh, and Y. Mansour. Policy gradient methods for reinforcement learning with function approximation. In Advances in Neural Information Processing Systems 12 (NIPS), pages 1057-1063, 1999.
23. G. Tesauro. Practical issues in temporal difference learning. In D. S. Lippman, J. E. Moody, and D. S. Touretzky, editors, Advances in Neural Information Processing Systems 4 (NIPS), pages 259-266. Morgan Kaufmann, 1992.
24. X. Yao. Evolving artificial neural networks. Proceedings of the IEEE, 87(9):1423-1447, 1999.