Potential-based shaping in model-based reinforcement learning

Proceedings of the National Conference on Artificial Intelligence

Volumn 2, Issue , 2008, Pages 604-609

  Asmuth, John ^a   Littman, Michael L ^a   Zinkov, Robert ^a  

^a RUTGERS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BIONICS; LEARNING SYSTEMS; REINFORCEMENT;

BACKGROUND KNOWLEDGES; LEARNING APPROACHES; MODEL-BASED; TRANSITION MODELS;

LEARNING ALGORITHMS;

EID: 57749177069     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. Barto, A. G.; Bradtke, S. J.; and Singh, S. P. 1995. Learning to act using real-time dynamic programming. Artificial Intelligence 72(1):81-138.
2. Brafman, R. I., and Tennenholtz, M. 2002. R-MAX-a general polynomial time algorithm for near-optimal reinforcement learning. Journal of Machine Learning Research 3:213-231.
3. Guestrin, C.; Patrascu, R.; and Schuurmans, D. 2002. Algorithm-directed exploration for model-based reinforcement learning in factored MDPs. In Proceedings of the International Conference on Machine Learning, 235-242.
4. Hansen, E. A., and Zilberstein, S. 1999. Solving Markov decision problems using heuristic search. In Proceedings of the AAAI Spring Symposium on Search Techniques for Problem Solving Under Uncertainty and Incomplete Information, 42-47.
5. Kakade, S. M. 2003. On the Sample Complexity of Reinforcement Learning. Ph.D. Dissertation, Gatsby Computational Neuroscience Unit, University College London.
6. Leffler, B. R.; Littman, M. L.; and Edmunds, T. 2007. Efficient reinforcement learning with relocatable action models. In Proceedings of the Twenty-Second Conference on Artificial Intelligence (AAAI-07).
7. Ng, A. Y.; Harada, D.; and Russell, S. 1999. Policy invariance under reward transformations: Theory and application to reward shaping. In Proceedings of the Sixteenth International Conference on Machine Learning, 278-287.
8. Puterman, M. L. 1994. Markov Decision Processes-Discrete Stochastic Dynamic Programming. New York, NY: John Wiley & Sons, Inc.
9. Russell, S. J., and Norvig, P. 1994. Artificial Intelligence: A Modern Approach. Englewood Cliffs, NJ: Prentice-Hall.
10. Strehl, A. L.; Li, L.; and Littman, M. L. 2006. PAC reinforcement learning bounds for RTDP and rand-RTDP. In AAAI 2006 Workshop on Learning For Search.
11. Watkins, C. J. C. H., and Dayan, P. 1992. Q-learning. Machine Learning 8(3):279-292.
12. Wiewiora, E. 2003. Potential-based shaping and Q-value initialization are equivalent. Journal of Artificial Intelligence Research 19:205-208.