Dual representations for dynamic programming and reinforcement learning

Proceedings of the 2007 IEEE Symposium on Approximate Dynamic Programming and Reinforcement Learning, ADPRL 2007

Volumn , Issue , 2007, Pages 44-51

  Wang, Tao ^a   Bowlingm, Michael ^a   Schuurmans, Dale ^a  

^a UNIVERSITY OF ALBERTA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ITERATIVE METHODS; LEARNING ALGORITHMS; PROBLEM SOLVING; REINFORCEMENT LEARNING;

Q-LEARNING; VALUE FUNCTION ESTIMATION; VALUE FUNCTIONS; VALUE ITERATION;

DYNAMIC PROGRAMMING;

EID: 34548784027     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ADPRL.2007.368168     Document Type: Conference Paper

References (10)

1. R. Sutton and A. Barto, Reinforcement Learning: An Introduction. MIT Press, 1998.
2. M. Puterman, Markov Decision Processes: Discrete Dynamic Programming. Wiley, 1994.
3. D. Bertsekas, Dynamic Programming and Optimal Control. Athena Scientific, 1995, vol. 2.
4. D. Bertsekas and J. Tsitsiklis, Neuro-Dynamic Programming. Athena Scientific, 1996.
5. P. Dayan, "Improving generalisation for temporal difference learning: The successor representation," Neural Computation, vol. 5, pp. 613-624, 1993.
6. A. Ng, R. Parr, and D. Koller, "Policy search via density estimation," in Proceedings NIPS, 1999.
7. D. de Farias and B. Van Roy, "The linear programming approach to approximate dynamic programming," 2001.
8. S. Ross, Introduction to Probability Models, 6th ed. Academic Press, 1997.
9. J. Tsitsiklis and B. Van Roy, "An analysis of temporal-difference learning with function approximation," IEEE Transactions on Automatic Control, vol. 42, no. 5, pp. 674-690, 1997.
10. L. Baird, "Residual algorithms: Reinforcement learning with function approximation," in Proceedings ICML, 1995.