Better computer go player with neural network and long-term prediction

4th International Conference on Learning Representations, ICLR 2016 - Conference Track Proceedings

Volumn , Issue , 2016, Pages

  Tian, Yuandong ^a   Zhu, Yan ^a  

^a FACEBOOK AI RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BUDGET CONTROL; NEURAL NETWORKS; PATTERN MATCHING;

BRANCHING FACTORS; CONVOLUTIONAL NEURAL NETWORK; EVALUATION FUNCTION; LONG-TERM GOALS; LONG-TERM PREDICTION; MONTE CARLO TREE SEARCH (MCTS); SEARCH TECHNIQUE; STATE OF THE ART;

DEEP NEURAL NETWORKS;

EID: 85083953106     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Baudis, Petr and Gailly, Jean-loup. Pachi: State of the art open source go program. pp. 2438, 2012.
2. Browne, Cameron B, Powley, Edward, Whitehouse, Daniel, Lucas, Simon M, Cowling, Peter, Rohlf-shagen, Philipp, Tavener, Stephen, Perez, Diego, Samothrakis, Spyridon, Colton, Simon, et al. A survey of monte carlo tree search methods. Computational Intelligence and AI in Games, IEEE Transactions on, 4(1):1–43, 2012.
3. Clark, Christopher and Storkey, Amos. Training deep convolutional neural networks to play go. In Proceedings of the 32nd International Conference on Machine Learning (ICML-15), pp. 1766–1774, 2015.
4. Enzenberger, Markus. The integration of a priori knowledge into a go playing neural network. URL: http://www. markus-enzenberger. de/neurogo. html, 1996.
5. Enzenberger, Markus, Müller, Martin, Arneson, Broderick, and Segal, Richard. Fuegoan open-source framework for board games and go engine based on monte carlo tree search. Computational Intelligence and AI in Games, IEEE Transactions on, 2(4):259–270, 2010.
6. Graf, Tobias and Platzner, Marco. Adaptive playouts in monte-carlo tree search with policy-gradient reinforcement learning. In Advances in Computer Games, pp. 1–11. Springer, 2015.
7. He, Kaiming, Zhang, Xiangyu, Ren, Shaoqing, and Sun, Jian. Deep residual learning for image recognition. arXiv preprint arXiv:1512.03385, 2015.
8. Kocsis, Levente and Szepesvári, Csaba. Bandit based monte-carlo planning. In Machine Learning: ECML 2006, pp. 282–293. Springer, 2006.
9. Konda, Vijay R and Tsitsiklis, John N. Actor-critic algorithms. In NIPS, volume 13, pp. 1008–1014, 1999.
10. Maddison, Chris J, Huang, Aja, Sutskever, Ilya, and Silver, David. Move evaluation in go using deep convolutional neural networks. 2015.
11. Richards, Norman, Moriarty, David E, and Miikkulainen, Risto. Evolving neural networks to play go. Applied Intelligence, 8(1):85–96, 1998.
12. Schraudolph, Nicol N, Dayan, Peter, and Sejnowski, Terrence J. Temporal difference learning of position evaluation in the game of go. Advances in Neural Information Processing Systems, pp. 817–817, 1994.
13. Silver, David. Reinforcement learning and simulation-based search. Doctor of philosophy, University of Alberta, 2009.
14. Silver, David, Huang, Aja, Maddison, Chris J., Guez, Arthur, Sifre, Laurent, van den Driessche, George, Schrittwieser, Julian, Antonoglou, Ioannis, Panneershelvam, Veda, Lanctot, Marc, Diele-man, Sander, Grewe, Dominik, Nham, John, Kalchbrenner, Nal, Sutskever, Ilya, Lillicrap, Timothy, Leach, Madeleine, Kavukcuoglu, Koray, Graepel, Thore, and Hassabis, Demis. Mastering the game of go with deep neural networks and tree search. Nature, 2016.
15. Sutskever, Ilya and Nair, Vinod. Mimicking go experts with convolutional neural networks. In Artificial Neural Networks-ICANN 2008, pp. 101–110. Springer, 2008.
16. Sutton, Richard S, McAllester, David A, Singh, Satinder P, Mansour, Yishay, et al. Policy gradient methods for reinforcement learning with function approximation. In NIPS, volume 99, pp. 1057–1063. Citeseer, 1999.