Integrating opponent models with Monte-Carlo tree search in poker

AAAI Workshop - Technical Report

Volumn WS-10-03, Issue , 2010, Pages 37-42

  Ponsen, Marc ^a   Gerritsen, Geert ^a   Chaslot, Guillaume ^a  

^a MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

DOMAIN KNOWLEDGE; MONTE CARLO; ON-THE-FLY; OPPONENT MODELS; SEARCH ALGORITHMS; TREE SEARCH; TREE SEARCH ALGORITHM;

DECISION THEORY; GAME THEORY; LEARNING ALGORITHMS; PLANT EXTRACTS; USER INTERFACES;

TREES (MATHEMATICS);

EID: 79959750283     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Billings, D.; Burch, N.; Davidson, A.; Holte, R. C.; Schaeffer, J.; Schauenberg, T.; and Szafron, D. 2003. Approximating game-theoretic optimal strategies for full-scale poker. In Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence (IJCAI-03), 661-668. Morgan Kaufmann.
2. Billings, D.; Davidson, A.; Schauenberg, T.; Burch, N.; Bowling, M.; Holte, R. C.; Schaeffer, J.; and Szafron, D. 2006. Game-tree search with adaptation in stochastic imperfect-information games. In The 4th Computers and Games International Conference. Ramat-Gan, Israel: Springer.
3. Billings, D. 2006. Algorithms and Assessment in Computer Poker. Ph.D. dissertation. University of Alberta.
4. Bishop, C. M. 2007. Pattern Recognition and Machine Learning (Information Science and Statistics). Springer, 1 edition.
5. Blockeel, H., and De Raedt, L. 1998. Top-down induction of first order logical decision trees. Artificial Intelligence 101(1-2):285-297.
6. Bouzy, B., and Chaslot, G. 2006. Monte-Carlo Go Reinforcement Learning Experiments. In IEEE 2006 Symposium on Computational Intelligence in Games, Reno, USA, 187-194.
7. Chaslot, G. M. J.-B.; Saito, J.-T.; Bouzy, B.; Uiterwijk, J.; and van den Herik, H. 2006. Monte-Carlo Strategies for Computer Go. In Proceedings of the 18th BeNeLux Conference on Artificial Intelligence.
8. Chaslot, G.-B.; Winands, M.; Uiterwijk, J.; van den Herik, H.; and Bouzy, B. 2008. Progressive strategies for Monte-Carlo Tree Search. New Mathematics and Natural Computation 4(3):343-357.
9. Coulom, R. 2006. Efficient selectivity and backup operators in monte-carlo tree search. In Proceedings of the 5th International Conference on Computer and Games. Springer-Verlag, Heidelberg, Germany.
10. Coulom, R. 2007. Computing "elo ratings" of move patterns in the game of Go. ICGA Journal 30(4): 199-208.
11. Davidson, A.; Billings, D.; Schaeffer, J.; and Szafron, D. 2000. Improved opponent modeling in poker. In Proceedings of The 2000 International Conference on Artificial Intelligence (ICAI'2000), 1467-1473.
12. Finnsson, H., and Björnsson, Y. 2008. Simulation-based approach to general game playing. In Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence, AAAI 2008. AAAI Press.
13. Gelly, S., and Silver, D. 2007. Combining online and offline knowledge in uct. In ICML '07: Proceedings of the 24th international conference on Machine learning, 273-280. New York, NY, USA: ACM Press.
14. Gelly, S.; Wang, Y.; Munos, R.; and Teytaud, O. 2006. Modifications of uct with patterns in monte-carlo go. Technical Report 6062, INRIA.
15. Harrington, D. 2004. Harrington on Hold'em Expert Strategy for No Limit Tournaments. Two Plus Two Publisher.
16. Kocsis, L., and Szepesvári, C. 2006. Bandit Based Monte-Carlo Planning. In Machine Learning: ECML 2006, volume 4212 of Lecture Notes in Artificial Intelligence, 282-293.
17. Ponsen, M.; Ramon, J.; Croonenborghs, T.; Driessens, K.; and Tuyls, K. 2008. Bayes-relational learning of opponent models from incomplete information in no-limit poker. In Proceedings of the Twenty-third National Conference on Artificial Intelligence (AAAI-08), 1485-1487. Menlo Park, CA, United States: AAAI Press.
18. Ponsen, M.; Tuyls, K.; ; Kaisers, M.; and Ramon, J. 2009. An evolutionary game-theoretic analysis of poker strategies. In Entertainment Computing. Elsevier.
19. Slansky, D. 1987. The Theory of Poker. Two Plus Two Publisher.
20. Southey, F.; Bowling, M.; Larson, B.; Piccione, C.; Burch, N.; Billings, D.; and Rayner, D. C. 2005. Bayes' bluff: Opponent modelling in poker. In Proceedings of the 21st Conference in Uncertainty in Artificial Intelligence (UAI '05), 550-558.
21. Sturtevant, N. 2008. An Analysis of UCT in Multi-player Games. ICGA Journal 31(4): 195-208.
22. Zinkevich, M.; Johanson, M.; Bowling, M.; and Piccione, C. 2008. Regret minimization in games with incomplete information. In Advances in Neural Information Processing Systems 20 (NIPS).