Incremental least-squares temporal difference learning

Proceedings of the National Conference on Artificial Intelligence

Volumn 1, Issue , 2006, Pages 356-361

  Geramifard, Alborz ^a   Bowling, Michael ^a   Sutton, Richard S ^a  

^a UNIVERSITY OF ALBERTA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTATIONAL COMPLEXITY; LEAST SQUARES APPROXIMATIONS; PUBLIC POLICY;

EMPIRICAL COMPARISONS; POLICY EVALUATION; SOLUTION STRATEGY; TEMPORAL DIFFERENCE (TD);

LEARNING SYSTEMS;

EID: 33750737011     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Albus, J. S. 1971. A theory of cerebellar function. Mathematical Biosciences 10:25-61.
2. Boyan, J. A. 1999. Least-squares temporal difference learning. In Proceedings of the Sixteenth International Conference on Machine Learning, 49-56. Morgan Kaufmann, San Francisco, CA.
3. Boyan, J. A. 2002. Technical update: Least-squares temporal difference learning. Machine Learning 49:233-246.
4. Bradtke, S., and Barto, A. 1996. Linear least-squares algorithms for temporal difference learning. Machine Learning 22:33-57.
5. Hinton, G. E.; McClelland, J. L.; and Rumelhart, D. E. 1986. Distributed representations. In Rumelhart, D. E.; and McClelland, J. L., eds., Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations.
6. Lin, L. J. 1993. Reinforcement Learning for Robots Using Neural Networks. Ph.D. Dissertation, Carnegie Mellon University.
7. Moore, A. W., and Atkeson, C. G. 1993. Prioritized sweeping: Reinforcement learning with less data and less time. Machine Learning 13:103-130.
8. Poggio, T., and Girosi, F. 1990. Networks for approximation and learning. Proceedings of the IEEE (special issue: Neural Networks I: Theory and Modeling) 78(9): 1481-1497.
9. Stone, P.; Sutton, R. S.; and Kuhlmann, G. 2005. Reinforcement learning for robocup soccer keepaway. International Society for Adaptive Behavior 13(3): 165-188.
10. Sutton, R. S., and Barto, A. G. 1998. Reinforcement Learning: An Introduction. MIT Press.
11. Sutton, R. S. 1988. Learning to predict by the methods of temporal differences. Machine Learning 3:9-44.
12. Sutton, R. S. 1996. Generalization in reinforcement learning: Successful examples using sparse coarse coding. In Touretzky, D. S.; Mozer, M. C.; and Hasselmo, M. E., eds., Advances in Neural Information Processing Systems 8, 1038-1044. The MIT Press.
13. Tedrake, R.; Zhang, T. W.; and Seung, H. S. 2004. Stochastic policy gradient reinforcement learning on a simple 3D biped. In Proceedings of the IEEE International Conference on Intelligent Robots and Systems, 2849-2854.
14. Tsitsiklis, J. N., and Van Roy, B. 1997. An analysis of temporal-difference learning with function approximation. IEEE Transactions on Automatic Control 42(5):674-690.
15. Xu, X.; He, H.; and Hu, D. 2002. Efficient reinforcement learning using recursive least-squares methods. Journal of Artificial Intelligence Research 16:259-292.