Preconditioned temporal difference learning

Proceedings of the 25th International Conference on Machine Learning

Volumn , Issue , 2008, Pages 1208-1215

  Yao, Hengshuai ^a   Liu, Zhi Qiaug ^a  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; ITERATIVE METHODS; MACHINE LEARNING; STOCHASTIC MODELS; STOCHASTIC SYSTEMS; EDUCATION; LEARNING SYSTEMS; ROBOT LEARNING;

LEAST SQUARE; LEAST-SQUARES TEMPORAL DIFFERENCES; POLICY EVALUATION; PRECONDITIONING TECHNIQUES; RELATED ALGORITHMS; STEP SIZE; TEMPORAL DIFFERENCE LEARNING;

LEARNING ALGORITHMS;

LEAST-SQUARES; MODEL EQUATIONS; POLICY EVALUATIONS; PRECONDITIONING TECHNIQUES; TEMPORAL DIFFERENCE LEARNING; TEMPORAL DIFFERENCES;

EID: 56449123618     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1390156.1390308     Document Type: Conference Paper

References (13)

1. Boyan, J. A. (1999). Least-squares temporal difference learning. Proceedings of the Sixteenth International Conference on Machine Learning (pp. 49 56). Morgan Kaufmann.
2. Bradtke, S., & Barto, A. G. (1996). Linear least-squares algorithms for temporal difference learning. Machine Learning, 22, 33--57.
3. Geramifard, A., Bowling, M., & Sutton, R. S. (2006a). Incremental least-squares temporal difference learning. Twenty-First National Conference on Artificial Intelligence (AAAI-06) (pp. 356 361). AAAI Press.
4. Geramifard, A., Bowling, M., Zinkevich, M., & Sutton, R. S. (2006b). iLSTD: Eligibility traces and convergence analysis. Advances in Neural Information Processing Systems 19 (pp. 441-448).
5. Lin, L.-J., & Mitchell, T. M. (1992). Memory approaches to reinforcement learning in non-markovian domains (Technical Report CMU-CS-92-138). Carnegie Mellon University, Pittsburgh, PA 15213.
6. Nedić, A., & Bertsekas, D. P. (2003). Least-squares policy evaluation algorithms with linear function approximation. Journal of Discrete Event Systems, 13, 79-110.
7. Saad, Y. (2003). Iterative methods for sparse linear systems. SIAM.
8. Sutton, R. S. (1988). Learning to predict by the methods of temporal differences. Machine Learning, 3, 9-44.
9. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. MIT Press.
10. Tadić, V. (2001). On the convergence of temporal-difference learning with linear function approximation. Machine Learning, 42, 241-267.
11. Tsitsiklis, J. N., & Van Roy, B. (1997). An analysis of temporal-difference learning with function approximation. IEEE Transactions on Automatic Control, 42, 674-690.
12. Xu, X., He, H., & Hu, D. (2002). Efficient reinforcement learning using recursive least-squares methods. Journal of Artificial Intelligence Research, 16, 259-292.
13. Yao, H., & Liu, Z. (2008). Preconditioned temporal difference learning (Technical Report CityU-SCM-MCG-0408). City University of Hong Kong.