Analysis of an evolutionary reinforcement learning method in a multiagent domain

Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS

Volumn 1, Issue , 2008, Pages 286-293

  Metzen, Jan Hendrik ^a   Edgington, Mark ^b   Kassahun, Yohannes ^b   Kirchner, Frank ^a  

^a GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

^b UNIVERSITY OF BREMEN   (Germany)

Author keywords

Neuroevolution; Reinforcement learning

Indexed keywords

AUTONOMOUS AGENTS; BENCHMARKING; NEURAL NETWORKS; REINFORCEMENT LEARNING;

BENCH-MARK PROBLEMS; EVOLUTIONARY ACQUISITION; MULTI-AGENT LEARNING; MULTI-AGENT PROBLEMS; NEURO EVOLUTIONS; REINFORCEMENT LEARNING METHOD; RELATIVE PERFORMANCE; TEMPORAL DIFFERENCE METHODS;

MULTI AGENT SYSTEMS;

EID: 84899942666     PISSN: 15488403     EISSN: 15582914     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. P. J. Angeline, G. M. Saunders, and J. B. Pollack. An evolutionary algorithm that constructs recurrent neural networks. IEEE Transactions on Neural Networks, 5:54-65, 1994.
2. I. E. Baker. Adaptive selection methods for genetic algorithms. In Proceedings of the 1st International Conference on Genetic Algorithms, pages 101-111, Mahwah, NJ, USA, 1985. Lawrence Erlbaum Associates, Inc.
3. P. Bentley and S. Kumar. Three ways to grow designs: A comparison of embryogénies for an evolutionary design problem. In Proceedings of the Genetic and Evolutionary Computation Conference, volume 1, pages 35-13, Orlando, Florida, USA, 13-17 July 1999. Morgan Kaufmann.
4. J. C. Bongard and R. Pfeifer. Repeated structure and dissociation of genotypic and phenotypic complexity in artificial ontogeny. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 829-836, 2001.
5. F. Gomez, J. Schmidhuber, and R. Miikkulainen. Efficient non-linear control through neuroevolution. In Proceedings oj the European Conference on Machine Learning, 2006.
6. F. Gruau. Neural Network Synthesis Using Cellular Encoding and the Genetic Algorithm. PhD thesis, Ecole Normale Supérieure de Lyon, Laboratoire de l'Informatique du Parallélisme, France, January 1994.
7. Y. Kassahun. Towards a Unified Approach to Learning and Adaptation. PhD thesis, Technical Report 0602, Institute of Computer Science and Applied Mathematics, Christian-Albrechts University. Kiel, Germany, Feb 2006.
8. Y. Kassahun, M. Edgington, J. H. Metzen, G. Sommer, and F. Kirchner. A common genetic encoding for both direct and indirect encodings of networks. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 1029-1036, 2007.
9. Y. Kassahun, J. H. Metzen, J. de Gea, M. Edgington, and F. Kirchner. A general framework for encoding and evolving neural networks. In Proceedings of the 30th Annual German Conference on Artificial Intelligence, pages 205-219, 9 2007.
10. H. Kitano. Designing neural networks using genetic algorithms with graph generation system. Complex Systems, 4:461-6, 1990.
11. A. Lindenmayer. Mathematical models for cellular interactions in development, parts I and II. Journal of Theoretical Biology, 18:280-315, 1968.
12. S. Nolfi and D. Floreano. Evolutionary Robotics. The Biology, Intelligence, and Technology of Self-Organizing Machines. MIT Press, Massachusetts, London, 2000.
13. S. Nolfi and D. Parisi. Growing neural networks. Technical Report PCIA-91-15, Institute of Psychology, Rome, 1991.
14. J. Reisinger and R. Miikkulainen. Acquiring evolvability through adaptive representations. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 1045-1052, New York, NY, USA, 2007. ACM Press.
15. H.-P. P. Schwefel. Evolution and Optimum Seeking: The Sixth Generation. John Wiley & Sons, Inc., New York, NY, USA, 1993
16. B. Sendhoff and M. Kreutz. Variable encoding of modular neural networks for time series prediction. In Congress on Evolutionäry Computation, pages 259-266, 1999.
17. N. Siebel, J. Krause, and G. Sommer. Efficient learning of neural networks with evolutionary algorithms. In Proceedings of the 29th German Symposium for Pattern Recognition, pages A66-A15, 2007.
18. K. O. Stanley. Efficient Evolution of Neural Networks through Complexification. PhD thesis, Artificial Intelligence Laboratory. The University of Texas at Austin., Austin, USA, Aug 2004.
19. P. Stone, G. Kuhlmann, M. E. Taylor, and Y. Liu. Keepaway soccer: From machine learning testbed to benchmark. In RoboCup-2005: Robot Soccer World Cup IX, volume 4020, pages 93-105. Springer Verlag, Berlin, 2006.
20. P. Stone, R. S. Sutton, and G. Kuhlmann. Reinforcement learning for RoboCup-soccer Keepaway. Adaptive Behavior. 13(3):165-188, 2005.
21. R. Sutton and A. Barto. Reinforcement Learning: An Introduction. MIT Press, Massachusetts, London, 1998.
22. M. E. Taylor, S. Whiteson, and P. Stone. Comparing evolutionary and temporal difference methods in a reinforcement learning domain. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 1321-1328,2006.
23. J. Vaario, A. Onitsuka, and K. Shimohara. Formation of neural structures. In Proceedings of the Fourth European Conference on Articial Life, pages 214-223, 1997.
24. S. Whiteson and P. Stone. Evolutionary function approximation for reinforcement learning. Journal of Machine Learning Research, 7:877-917, May 2006.
25. S. Whiteson, M. E. Taylor, and P. Stone. Empirical studies in action selection for reinforcement learning. Adaptive Behavior, 15(l):33-50, March 2007.
26. D. Whitley, S. Dominic, R. Das, and C. W. Anderson. Genetic reinforcement learning for neurocontrol problems. Machine Learning, 13:259-284, 1993.
27. X. Yao. Evolving artificial neural networks. Proceedings of the IEEE,87(9): 1423-1447, 1999.