Temporal difference learning for heuristic search and game playing

Information sciences

Volumn 122, Issue 1, 2000, Pages 3-21

  Beal, D F ^a   Smith, M C ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; GAME THEORY; HEURISTIC METHODS; RANDOM PROCESSES;

TEMPORAL DIFFERENCE LEARNING;

LEARNING SYSTEMS;

EID: 0033632826     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0020-0255(99)00093-6     Document Type: Article

References (15)

1. R.S. Sutton, Learning to predict by the methods of temporal differences, Machine Learning 3 (1988) 9-44.
2. D.F. Beal, M.C. Smith, Temporal coherence and prediction decay in temporal difference learning, Technical Report no. 756, Department of Computer Science, Queen Mary and Westfield College, University of London, 1998.
3. J. Fürnkranz, Machine learning in computer chess: the next generation, International Computer Chess Association Journal 19 (3) (1996) 147-161.
4. T.S. Anantharaman, Evaluation tuning for computer chess: linear discriminant methods, International Computer Chess Association Journal 20 (4) (1997) 224-242.
5. G. Tesauro, Practical issues in temporal difference learning, Machine Learning 8 (1992) 257-277.
6. G. Tesauro, TD-Gammon, a self-teaching backgammon program, achieves master level play, Neural Computation 6 (2) (1994) 215-220.
7. R.S. Sutton, S.P. Singh, On step-size and bias in temporal-difference learning, in: Proceedings of the Eighth Yale Workshop on Adaptive and Learning Systems, 1994, pp. 91-96.
8. P. Dayan, The convergence of TD (λ) for general λ, Machine Learning 8 (1992) 341-362.
9. D.F. Beal, M.C. Smith, Learning piece values using temporal differences, International Computer Chess Association Journal 20 (3) (1997) 147-151.
10. R.A. Jacobs, Increased rates of convergence through learning rate adaptation, Neural Networks 1 (1988) 295-307.
11. T. Leggett, Shogi: Japan's Game of Strategy, Charles E. Turtle Company, 1993 (first published in 1966).
12. H. Matsubara, H. Iida, R. Grimbergen, Natural developments in game research: from chess to shogi to go, International Computer Chess Association Journal 19 (2) (1996) 103-112.
13. M. Mutz, Gnu Shogi v1.2p03, 1994 (available from many sources, including ftp://ftp.uni-passau.de/pub/local/shogi).
14. H. Yamashita, YSS: About the Data Structures and the Algorithm, Published on the WWW at http://plaza15.mbn.or.jp/∼yss, 1997.
15. D.F. Beal, M.C. Smith, Random evaluations in chess, International Computer Chess Association Journal 17 (1) (1994) 3-9.