Batch reinforcement learning in a complex domain

Proceedings of the International Conference on Autonomous Agents

Volumn , Issue , 2007, Pages 662-669

  Kalyanakrishnan, Shivaram ^a   Stone, Peter ^a  

^a University of Texas at Austin   (United States)

Author keywords

Evolution and adaptation; Learning; Perception and action

Indexed keywords

AGENT-BASED; ALGORITHMIC VARIANTS; ASYMPTOTIC PERFORMANCE; BATCH METHODS; BATCH REINFORCEMENT LEARNING; COMPLEX DOMAINS; DIMENSIONAL CONTROLS; EMPIRICAL PERFORMANCE; EVOLUTION AND ADAPTATION; EXPERIENCE DATUM; KEEPAWAY; LEARNING; MULTI AGENTS; ON-LINE ALGORITHMS; PERCEPTION AND ACTION; POLE BALANCING; ROBOCUP SOCCERS; SAMPLE COMPLEXITY; TEMPORAL DIFFERENCE REINFORCEMENT LEARNING;

AGENTS; AUTONOMOUS AGENTS; EDUCATION; FUZZY CLUSTERING; REINFORCEMENT; REINFORCEMENT LEARNING;

LEARNING ALGORITHMS;

EID: 60349130974     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1329125.1329241     Document Type: Conference Paper

References (16)

1. J. S. Albus. Brains, Behavior, and Robotics. BYTE Books, Peterborough, 1981.
2. D. Ernst, P. Geurts, and L. Wehenkel. Tree-based batch mode reinforcement learning. J. Mach. Learn. Res., 6:503-556, 2005.
3. S. Kalyanakrishnan, Y. Liu, and P. Stone. Half field offense in RoboCup soccer: A multiagent reinforcement learning case study. Proceedings of the RoboCup International Symposium 2006, June 2006.
4. M. G. Lagoudakis and R. Parr. Least-squares policy iteration. Journal of Machine Learning Research, 4:1107-1149, 2003.
5. L.-J. Lin. Self-improving reactive agents based on reinforcement learning, planning and teaching. Machine Learning, 8:293-321, 1992.
6. M.Chen, E.Foroughi, F.Heintz, Z.Huang, S.Kapetanakis, K.Kostiadis, J.Kummeneje, I.Noda, O.Obst, P.Riley, T.Steffens, Y.Waug, and X.Yin. Users manual: RoboCup soccer server -for soccer server version 7.07 and later. The RoboCup Federation, August 2002.
7. A. Y. Ng, H. J. Kim, M. I. Jordan, and S. Sastry. Autonomous helicopter flight via reinforcement learning. In S. Thrun, L. Saul, and B. Schölkopf, editors, Advances in Neural Information Processing Systems 16. MIT Press, Cambridge, MA, 2004.
8. M. Riedmiller. Neural fitted q iteration - first experiences with a data efficient neural reinforcement learning method. In J. Gama, R. Camacho, P. Brazdil, A. Jorge, and L. Torgo, editors, ECML, volume 3720 of Lecture Notes in Computer Science, pages 317-328. Springer, 2005.
9. G. A. Rummery and M. Niranjan. On-line Q-learning using connectionist systems. Technical Report CUED/F-INFENG/TR 166, Cambridge University Engineering Department, 1994.
10. P. Stone, G. Kuhlmann, M. E. Taylor, and Y. Liu. Keepaway soccer: From machine learning testbed to benchmark. R.oboCup-2005: Robot Soccer World Cup IX, 4020:93-105, 2006.
11. P. Stone, R. S. Sutton, and G. Kuhlmann. Reinforcement learning for RoboCup-soccer keepaway. Adaptive. Behavior, 13(3):165-188, 2005.
12. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
13. R. S. Sutton, D. Precup, and S. P. Singh. Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence, 112(1-2):181-211, 1999.
14. M. Taylor, S. Whiteson, and P. Stone. Comparing evolutionary and temporal difference methods for reinforcement learning. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 1321-28, July 2006.
15. M. E. Taylor and P. Stone. Behavior transfer for value-function-based reinforcement learning. In F. Dignum, V. Dignum, S. Koenig, S. Kraus, M. P. Singh, and M. Wooldridge, editors, The Fourth International Joint Conference on Autonomous Agents and Multiagent Systems, pages 53-59, New York, NY, July 2005. ACM Press.
16. C. J. C. H. Watkins and P. Dayan. Q-learning. Machine Learning, 8(3-4):279-292, 1992.