Temporal-difference networks

Advances in Neural Information Processing Systems

Volumn , Issue , 2005, Pages

  Sutton, Richard S ^a   Tanner, Brian ^a  

^a UNIVERSITY OF ALBERTA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

MONTE CARLO METHODS;

EXACT SOLUTION; FIXED INTERVALS; PREDICTIVE STATE REPRESENTATION; TD METHOD; TD-LEARNING; TEMPORAL DIFFERENCES; TEMPORAL RELATIONSHIPS; WORLD KNOWLEDGE;

FORECASTING;

EID: 84899003536     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. Boyan, J. A. (2000). Technical update: Least-squares temporal difference learning. Machine Learning 49:233-246.
2. Bradtke, S. J. and Barto, A. G. (1996). Linear least-squares algorithms for temporal difference learning. Machine Learning 22(1-3):33-57.
3. Dayan, P. (1993). Improving generalization for temporal difference learning: The successor representation. Neural Computation 5(4):613-624.
4. James, M. and Singh, S. (2004). Learning and discovery of predictive state representations in dynamical systems with reset. In Proceedings of the Twenty-First International Conference on Machine Learning, pages 417-424.
5. Kaelbling, L. P. (1993). Hierarchical learning in stochastic domains: Preliminary results. In Proceedings of the Tenth International Conference on Machine Learning, pp. 167-173.
6. Lagoudakis, M. G. and Parr, R. (2003). Least-squares policy iteration. Journal of Machine Learning Research 4(Dec):1107-1149.
7. Littman, M. L., Sutton, R. S. and Singh, S. (2002). Predictive representations of state. In Advances In Neural Information Processing Systems 14:1555-1561.
8. Rudary, M. R. and Singh, S. (2004). A nonlinear predictive state representation. In Advances in Neural Information Processing Systems 16:855-862.
9. Singh, S., Littman, M. L., Jong, N. K., Pardoe, D. and Stone, P. (2003) Learning predictive state representations. In Proceedings of the Twentieth Int. Conference on Machine Learning, pp. 712-719.
10. Sutton, R. S. (1988). Learning to predict by the methods of temporal differences. Machine Learning 3:9-44.
11. Sutton, R. S. (1995). TD models: Modeling the world at a mixture of time scales. In A. Prieditis and S. Russell (eds.), Proceedings of the Twelfth International Conference on Machine Learning, pp. 531.539. Morgan Kaufmann, San Francisco.
12. Sutton, R. S., Precup, D. and Singh, S. (1999). Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence 112:181-121.