Average cost temporal-difference learning

Automatica

Volumn 35, Issue 11, 1999, Pages 1799-1808

  Tsitsiklis, John N ^a   Van Roy, Benjamin ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; BOUNDARY CONDITIONS; COMPUTER SIMULATION; CONVERGENCE OF NUMERICAL METHODS; MARKOV PROCESSES; TABLE LOOKUP;

APPROXIMATION ERROR; AVERAGE COST; NEURODYNAMIC PROGRAMMING; REINFORCEMENT LEARNING; TEMPORAL DIFFERENCE;

DYNAMIC PROGRAMMING;

EID: 0033221519     PISSN: 00051098     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0005-1098(99)00099-0     Document Type: Article

References (11)

1. Abounadi, J. (1998). Stochastic Approximation for Non-expansive Maps: Application to Q-learning Algorithms. Ph.D. Thesis, Department of Electrical Engineering, Massachusetts Institute of Technology, Cambridge, MA.
2. Bertsekas, D. P., & Tsitsiklis, J. N. (1996). Neuro-dynamicprogramming. Belmont, MA: Athena Scientific.
3. Benveniste, A., Metivier, M., & Priouret, P. (1990). Adaptive Algorithms and Stochastic Approximations. Berlin: Springer.
4. Dayan, P. D. (1992). The convergence of TD(λ) for general λ. Machine Learning, 8, 341-362.
5. Gallager, R. G. (1996). Discrete Stochastic Processes'. Boston, MA.
6. Gurvits, L., Lin, L. J., & Hanson, S. J. (1994). Incremental Learning of Evaluation Functions for Absorbing Markov Chains: New Methods and Theorems, preprint.
7. Mahadevan, S. (1996). Average reward reinforcement learning: Foundations, algorithms, and empirical results. Machine Learning, 22, 1-38.
8. Marbach, P., Mihatsch, O., & Tsitsiklis, J. N. (1998). Call admission control and routing in integrated service networks using reinforcement learning. In Proceedings of the 1998 IEEE CDC, Tampa, FL.
9. Pmeda, F. (1996). Mean-field Analysis for Batched Td(λ). Unpublished.
10. Sutton, R. S. (1988). Learning to predict by the method of temporal differences. Machine Learning, 3, 9-44.
11. Tsitsiklis, J. N., & Van Roy, B. (1997). An Analysis of Temporal-Difference Learning with Function Approximation. IEEE Transactions on Automatic Control, 42(5), 674-690.