Case-based strategies in computer poker

AI Communications

Volumn 25, Issue 1, 2012, Pages 19-48

  Rubin, Jonathan ^a   Watson, Ian ^a  

^a UNIVERSITY OF AUCKLAND   (New Zealand)

Author keywords

case based reasoning; game AI; Imperfect information games

Indexed keywords

BOTTOM UP; COHERENT FRAMEWORKS; COMPLICATED DOMAIN; FINDING ALGORITHM; GENERALISATION; IMPERFECT INFORMATION; TEXAS HOLD'EM; TOP DOWN APPROACHES;

GAME THEORY;

MULTI AGENT SYSTEMS;

EID: 84858225621     PISSN: 09217126     EISSN: None     Source Type: Journal    
DOI: 10.3233/AIC-2012-0513     Document Type: Article

References (39)

1. ACPC, The Annual Computer Poker Competition, 2012, available at: Http://www.computerpokercompetition.org/.
2. D.W. Aha, Editorial, Artificial Intelligence Review 11(1-5) (1997), 7-10.
3. D.W. Aha, M. Molineaux and M.J.V. Ponsen, Learning to win: Case-based plan selection in a real-time strategy game, in: Proc. 6th International Conference on Case-Based Reasoning, Springer, Heidelberg, 2005, pp. 5-20.
4. M. Andersen, Web posting at pokerai.org forums, general forums, August 2009, available at: Http://pokerai.org/pf3/viewtopic.php?t=2259&start=18.
5. R. Andersson, Pseudo-optimal strategies in no-limit poker, Master's thesis, Umea University, 2006.
6. B. Auslander, S. Lee-Urban, C. Hogg and H. Muñoz-Avila, Recognizing the enemy: Combining reinforcement learning with strategy selection using case-based reasoning, in: Advances in Case-Based Reasoning, 9th European Conference, Trier, Springer, 2008, pp. 59-73.
7. D. Billings, N. Burch, A. Davidson, R.C. Holte, J. Schaeffer, T. Schauenberg and D. Szafron, Approximating gametheoretic optimal strategies for full-scale poker, in: Proc. 18th International Joint Conference on Artificial Intelligence, G. Gottlob and T. Walsh, eds, Morgan Kauffmann, 2003, pp. 661-668.
8. D. Billings, A. Davidson, T. Schauenberg, N. Burch, M.H. Bowling, R.C. Holte, J. Schaeffer and D. Szafron, Gametree search with adaptation in stochastic imperfect-information games, in: Proc. 4th International Conference on Computers and Games, H.J. van den Herik, Y. Björnsson and S. Nathan, eds, Springer, 2004, pp. 21-34.
9. I. Fellows, Artificial intelligence poker, 2012, available at: Http://www.deducer.org/pmwiki/index.php/.
10. M.W. Floyd, B. Esfandiari and K. Lam, A case-based reasoning approach to imitating robocup players, in: Proc. 21st International Florida Artificial Intelligence Research Society Conference, AAAI Press, Coconut Grove, FL, 2008, pp. 251-256.
11. A. Gilpin, S. Hoda, J. Peña and T. Sandholm, Gradientbased algorithms for finding Nash equilibria in extensive form games, in: Proc. 3rd International Workshop on Internet and Network Economics, X. Deng and F.C. Graham, eds, Springer, 2007, pp. 57-69.
12. A. Gilpin and T. Sandholm, Better automated abstraction techniques for imperfect information games, with application to Texas Hold'em poker, in: Proc. 6th International Joint Conference on Autonomous Agents and Multiagent Systems, E.H. Durfee, M. Yokoo, M.N. Huhns and O. Shehory, eds, IFAAMAS, 2007, pp. 192-200.
13. A. Gilpin, T. Sandholm and T.B. Sørensen, A heads-up nolimit Texas Hold'em poker player: Discretized betting models and automatically generated equilibrium-finding programs, in: Proc. 7th International Joint Conference on Autonomous Agents and Multiagent Systems, L. Padgham, D.C. Parkes, J.P. Muller and S. Parsons, eds, IFAAMAS, 2008, pp. 911-918.
14. K.J. Hammond, Case-based planning: A framework for planning from experience, Cognitive Science 14(3) (1990), 385-443.
15. M. Johanson, M. Zinkevich and M.H. Bowling, Computing robust counter-strategies, in: Proc. 21st Annual Conference on Neural Information Processing Systems, Vancouver, BC, Canada, J.C. Platt, D. Koller, Y. Singer and S.T. Roweis, eds, Curran Associates, 2007.
16. M.B. Johanson, Robust strategies and counter-strategies: Building a champion level computer poker player, Master's thesis, University of Alberta, 2007.
17. J. Kolodner, Case-Based Reasoning, Morgan Kaufmann, San Mateo, CA, 1993.
18. K. Mishra, S. Ontañón and A. Ram, Situation assessment for plan retrieval in real-time strategy games, in: Proc. 9th European Conference on Advances in Case-Based Reasoning, K.-D. Althoff, R. Bergmann, M. Minor and A. Hanft, eds, Lecture Notes in Computer Science, Vol. 5239, Springer, 2008, pp. 355-369.
19. Y. Nesterov, Excessive gap technique in nonsmooth convex minimization, SIAM J. Optim. 16(1) (2005), 235-249.
20. S. Ontañón, K. Mishra, N. Sugandh and A. Ram, Casebased planning and execution for real-time strategy games, in: Proc. 7th International Conference on Case-Based Reasoning, R. Weber and M.M. Richter, eds, Lecture Notes in Computer Science, Vol. 4626, Springer, 2007, pp. 164-178.
21. S. Ontañón, K. Mishra, N. Sugandh and A. Ram, On-line casebased planning, Computational Intelligence 26(1) (2010), 84-119.
22. PokerAI.org Forums, Fell Omen 2, 2011, available at: Http://pokerai.org/ pf3/viewtopic.php?f=3&t=3593.
23. PokerAI.org Research, Pokerftp hand history database, March 2011, available at: Http://pokerftp.com/.
24. J.H. Powell, B.M. Hauff and J.D. Hastings, Utilizing casebased reasoning and automatic case elicitation to develop a self-taught knowledgeable agent, in: Proc. Workshop on Challenges in Game AI, 19th National Conference on Artificial Intelligence, San Jose, CA, AAAI Press, 2004.
25. C.K. Riesbeck and R.C. Schank, Inside Case-Based Reasoning, L. Erlbaum Associates, Hillsdale, NJ, 1989.
26. N.A. Risk and D. Szafron, Using counterfactual regret minimization to create competitive multiplayer poker agents, in: Proc. 9th International Conference on Autonomous Agents and Multiagent Systems, W. van der Hoek, G.A. Kaminka, Y. Lespérance, M. Luck and S. Sen, eds, IFAAMAS, 2010, pp. 159-166.
27. J. Rubin and I. Watson, Similarity-based retrieval and solution re-use policies in the game of Texas Hold'em, in: Proc. 18th International Conference on Case-Based Reasoning, Springer-Verlag, Berlin, 2010, pp. 465-479.
28. J. Rubin and I. Watson, On combining decisions from multiple expert imitators for performance, in: IJCAI-11, Proc. 22nd International Joint Conference on Artificial Intelligence, T. Walsh, ed., IJCAI/AAAI, 2011, pp. 344-349.
29. D. Schnizlein, M.H. Bowling and D. Szafron, Probabilistic state translation in extensive games with large action sets, in: Proc. 21st International Joint Conference on Artificial Intelligence, Morgan Kaufmann, San Francisco, CA, 2009, pp. 278-284.
30. M. Sharma, M.P. Holmes, J.C. Santamaría, A. Irani, C. Lee Isbell Jr. and A. Ram, Transfer learning in real-time strategy games using hybrid CBR/RL, in: Proc. 20th International Joint Conference on Artificial Intelligence, M.M. Veloso, ed., IJCAI/AAAI, 2007, pp. 1041-1046.
31. D. Sklansky, The Theory of Poker, Two Plus Two Publishing, Las Vegas, NV, 2005.
32. D. Sklansky and M. Malmuth, Hold'em Poker For Advanced Players, Two Plus Two Publishing, Las Vegas, NV, 1994.
33. N. Sugandh, S. Ontañón and A. Ram, On-line case-based plan adaptation for real-time strategy games, in: Proc. 23rd AAAI Conference on Artificial Intelligence, D. Fox and C.P. Gomes, eds, AAAI Press, 2008, pp. 702-707.
34. K. Sycara, D. Navin Chandra, R. Guttal, J. Koning and S. Narasimhan, Cadet: A case-based synthesis tool for engineering design, International Journal of Expert Systems 4(2) (1991), 157-188.
35. Technische Universität Darmstadt, Computer poker bots, 2012, available at: Http://www.ke.tu-darmstadt.de/resources/poker.
36. G. Van den Broeck, K. Driessens and J. Ramon, Monte-Carlo tree search in poker using expected reward distributions, in: Advances in Machine Learning, First Asian Conference on Machine Learning, Z.-H. Zhou and T. Washio, eds, Lecture Notes in Computer Science, Vol. 5828, Springer, 2009, pp. 367-381.
37. I. Watson, Applying Case-Based Reasoning: Techniques for Enterprise Systems, Morgan Kaufmann, San Francisco, CA, 1997.
38. K. Waugh, D. Schnizlein, M.H. Bowling and D. Szafron, Abstraction pathologies in extensive games, in: Proc. 8th International Joint Conference on Autonomous Agents and Multiagent Systems, C. Sierra, C. Castelfranchi, K.S. Decker and J.S. Sichman, eds, IFAAMAS, 2009, pp. 781-788.
39. M. Zinkevich, M. Johanson, M.H. Bowling and C. Piccione, Regret minimization in games with incomplete information, in: Advances in Neural Information Processing Systems 20, Proc. 21st Annual Conference on Neural Information Processing Systems, Vancouver, BC, Canada, 2007.