Temporal difference and policy search methods for reinforcement learning: An empirical comparison

Proceedings of the National Conference on Artificial Intelligence

Volumn 2, Issue , 2007, Pages 1675-1678

  Taylor, Matthew E ^a   Whiteson, Shimon ^a   Stone, Peter ^a  

^a University of Texas at Austin   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARK DOMAINS; LEARNING METHODS; POLICY SEARCH METHODS; REINFORCEMENT LEARNINGS;

GENETIC ALGORITHMS; LEARNING SYSTEMS; PROBLEM SOLVING; ROBOTS; TEMPORAL LOGIC;

SEARCH ENGINES;

EID: 36348987166     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Gomez, F., and Miikkulainen, R. 2002. Robust nonlinear control through neuroevolution. Technical Report AI02-292.
2. Gomez, F., and Schmidhuber, J. 2005. Co-evolving recurrent neurons learn deep memory POMDPs. In GECCO-05: Proceedings of the Genetic and Evolutionary Computation Conference, 491-498.
3. Hsu, W. H., and Gustafson, S. M. 2002. Genetic programming and multi-agent layered learning by reinforcements. In Genetic and Evolutionary Computation Conference, 764-771. New York.NY: Morgan Kaufmann.
4. Kostiadis, K., and Hu, H. 2001. KaBaGe-RL: Kanerva-based generalization and reinforcement learning for possession football. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2001).
5. Moriarty, D. E., and Miikkulainen, R. 1996. Efficient reinforcement learning through symbiotic evolution. Machine Learning 22:11-32.
6. Pollack, J. B.; Blair, A. D.; and Land, M. 1997. Coevolution of a backgammon player. In Langton, C. G., and Shimohara, K., eds., Artificial Life V: Proc. of the Fifth Int. Workshop on the Synthesis and Simulation of Living Systems, 92-98. Cambridge, MA: The MIT Press.
7. Rummery, G. A., and Niranjan, M. 1994. On-line Q-learning using connectionist systems. Technical Report CUED/F-INFENG-RT 116, Engineering Department, Cambridge University.
8. Singh, S. P., and Sutton, R. S. 1996. Reinforcement learning with replacing eligibility traces. Machine Learning 22:123-158.
9. Stanley, K. O., and Miikkulainen, R. 2002. Evolving neural networks through augmenting topologies. Evolutionary Computation 10(2):99-127.
10. Stanley, K. O., and Miikkulainen, R. 2004a. Competitive coevolution through evolutionary complexification. Journal of Artificial Intelligence Research 21:63-100.
11. Stone, P.; Kuhlmann, G.; Taylor, M. E.; and Liu, Y. 2006. Keepaway soccer: From machine learning testbed to benchmark. In Noda, I.; Jacoff, A.; Bredenfeld, A.; and Takahashi, Y., eds, RoboCup-2005: Robot Soccer World Cup IX, volume 4020. Berlin: Springer Verlag. 93-105.
12. Stone, P.; Sutton, R. S.; and Kuhlmann, G. 2005. Reinforcement learning for RoboCup-soccer keepaway. Adaptive Behavior 13(3):165-188.
13. Sutton, R. S., and Barto, A. G. 1998. Introduction to Reinforcement Learning. MIT Press.
14. Sutton, R. S. 1996. Generalization in reinforcement learning: Successful examples using sparse coarse coding. In Advances in Neural Information Processing Systems 8, 1038-1044.
15. Taylor, M. E.; Whiteson, S.; and Stone, P. 2006. Comparing evolutionary and temporal difference methods in a reinforcement learning domain. In Proc. of the Genetic and Evolutionary Computation Conference, 1321-28.
16. Whiteson, S., and Stone, P. 2006. Evolutionary function approximation for reinforcement learning. Journal of Machine Learning Research.
17. Whiteson, S.; Kohl, N.; Miikkulainen, R.; and Stone, P. 2005, Evolving keepaway soccer players through task decomposition. Machine Learning 59(1):5-30.