Reinforcement learning in the game of Othello: Learning against a fixed opponent and learning from self-play

IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning, ADPRL

Volumn , Issue , 2013, Pages 108-115

  Van Der Ree, Michiel ^a   Wiering, Marco ^a  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL AGENTS; LEARNING AGENTS; MULTI-LAYER PERCEPTRONS; OTHELLO; Q-LEARNING; SELF-PLAY; TD-LEARNING;

ARTIFICIAL INTELLIGENCE; DYNAMIC PROGRAMMING; REINFORCEMENT LEARNING;

LEARNING ALGORITHMS;

EID: 84891544852     PISSN: 23251824     EISSN: 23251867     Source Type: Conference Proceeding    
DOI: 10.1109/ADPRL.2013.6614996     Document Type: Conference Paper

References (18)

1. R. Sutton and A. Barto, Reinforcement learning: An introduction. The MIT press, Cambridge MA, A Bradford Book, 1998.
2. M. Wiering and M. van Ottelo, Eds., Reinforcement Learning: State-ofthe-art. Springer, 2012.
3. G. Tesauro, "Temporal difference learning and TD-Gammon," Communications of the ACM, vol. 38, pp. 58-68, 1995.
4. S. Thrun, "Learning to play the game of chess," Advances in Neural Information Processing Systems, vol. 7, 1995.
5. J. Schaeffer, M. Hlynka, and V. Jussila, "Temporal difference learning applied to a high-performance game-playing program," in Proceedings of the 17th international joint conference on Artificial intelligence-Volume 1. Morgan Kaufmann Publishers Inc., 2001, pp. 529-534.
6. N. Schraudolph, P. Dayan, and T. Sejnowski, "Temporal difference learning of position evaluation in the game of go," Advances in Neural Information Processing Systems, pp. 817-817, 1994.
7. D. Moriarty and R. Miikkulainen, "Discovering complex othello strategies through evolutionary neural networks," Connection Science, vol. 7, no. 3, pp. 195-210, 1995.
8. S. Lucas, "Learning to play othello with n-tuple systems," Australian Journal of Intelligent Information Processing, vol. 4, pp. 1-20, 2008.
9. S. van den Dries and M. Wiering, "Neural-fitted td-learning for playing othello with structured neural networks," IEEE Transactions on Neural Networks and Learning Systems, vol. 23, no. 11, pp. 1701-1713, 2012.
10. R. S. Sutton, "Learning to predict by the methods of temporal differences," Machine Learning, vol. 3, pp. 9-44, 1988.
11. C. Watkins and P. Dayan, "Q-learning," Machine learning, vol. 8, no. 3, pp. 279-292, 1992.
12. N. van Eck and M. van Wezel, "Application of reinforcement learning to the game of othello," Computers &Operations Research, vol. 35, no. 6, pp. 1999-2017, 2008.
13. G. Rummery and M. Niranjan, On-line Q-learning using connectionist systems. Technical Report, University of Cambridge, Department of Engineering, 1994.
14. M. Wiering, "Self-play and using an expert to learn to play backgammon with temporal difference learning," Journal of Intelligent Learning Systems and Applications, vol. 2, no. 2, pp. 57-68, 2010.
15. M. Buro, "The evolution of strong othello programs," in Entertainment Computing-Technology and Applications, R. Nakatsu and J. Hoshino, Eds. Kluwer, 2003, pp. 81-88.
16. -, "Statistical feature combination for the evaluation of game positions," Journal of Artificial Intelligence Research, vol. 3, pp. 373-382, 1995.
17. S. Lucas and T. Runarsson, "Temporal difference learning versus coevolution for acquiring othello position evaluation," in Computational Intelligence and Games, 2006 IEEE Symposium on, 2006, pp. 52-59.
18. T. Yoshioka and S. Ishii, "Strategy acquisition for the game othello based on reinforcement learning," IEICE Transactions on Information and Systems, vol. 82, no. 12, pp. 1618-1626, 1999.