DeepStack: Expert-level artificial intelligence in heads-up no-limit poker

Science

Volumn 356, Issue 6337, 2017, Pages 508-513

  Moravčík, Matej ^a,b   Schmid, Martin ^a,b   Burch, Neil ^a   Lisý, Viliam ^a,c   Morrill, Dustin ^a   Bard, Nolan ^a   Davis, Trevor ^a   Waugh, Kevin ^a   Johanson, Michael ^a   Bowling, Michael ^a  

^a UNIVERSITY OF ALBERTA   (Canada)

^b CHARLES UNIVERSITY   (Czech Republic)

^c CZECH TECHNICAL UNIVERSITY IN PRAGUE   (Czech Republic)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTIFICIAL INTELLIGENCE; ASYMMETRY; COMPUTER SIMULATION; DECISION ANALYSIS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; PRIORITY JOURNAL; SOFTWARE; SOUND; SPEECH DISCRIMINATION; STATISTICAL SIGNIFICANCE; VIDEO GAME; DECOMPOSITION; DEEP LEARNING; HUMAN; INTUITION; REASONING; TEXAS; THEORETICAL STUDY;

TEXAS; UNITED STATES;

EID: 85014477370     PISSN: 00368075     EISSN: 10959203     Source Type: Journal    
DOI: 10.1126/science.aam6960     Document Type: Article

References (41)

1. G. Tesauro, Commun. ACM 38, 58-68 (1995).
2. J. Schaeffer, R. Lake, P. Lu, M. Bryant, AI Mag. 17, 21-29 (1996).
3. M. Campbell, A. J. Hoane Jr., F. Hsu, Artif. Intell. 134, 57-83 (2002).
4. D. Ferrucci, IBM J. Res. Develop. 56, 1:1-1:15 (2012).
5. V. Mnih et al., Nature 518, 529-533 (2015).
6. D. Silver et al., Nature 529, 484-489 (2016).
7. A. L. Samuel, IBM J. Res. Develop. 3, 210-229 (1959).
8. L. Kocsis, C. Szepesvári, Proceedings of the Seventeenth European Conference on Machine Learning (2006), pp. 282-293.
9. J. Bronowski, The Ascent of Man [documentary] (1973), episode 13.
10. V. L. Allis, thesis, University of Limburg (1994).
11. M. Johanson, "Measuring the size of large no-limit poker games," Tech. Rep. TR13-01, Department of Computing Science, University of Alberta (2013).
12. M. Zinkevich, M. Johanson, M. Bowling, C. Piccione, Adv. Neural Inf. Process. Syst. 20, 905-912 (2008).
13. A. Gilpin, S. Hoda, J. Peña, T. Sandholm, Proceedings of the Third International Workshop On Internet And Network Economics (2007), pp. 57-69.
14. N. Burch, M. Johanson, M. Bowling, Proceedings of the Twenty-Eighth Conference on Artificial Intelligence (2014), pp. 602-608; www.aaai.org/ocs/index.php/AAAI/AAAI14/paper/view/8407.
15. M. Bowling, N. Burch, M. Johanson, O. Tammelin, Science 347, 145-149 (2015).
16. J. Wood, "Doug Polk and Team Beat Claudico to Win $100,000 from Microsoft & the Rivers Casino," Pokerfuse (11 May 2015); http://pokerfuse.com/news/media-and-software/26854-doug-polk-and-team-beat-claudico-win-100000-microsoft/.
17. V. Lisý, M. Bowling, Proceedings of the AAAI-17 Workshop on Computer Poker and Imperfect Information Games (2017); https://arxiv.org/abs/1612.07547.
18. J. F. Nash, Proc. Natl. Acad. Sci. U.S.A. 36, 48-49 (1950).
19. A. Gilpin, T. Sandholm, T. B. Sørensen, Proceedings of the Seventh International Conference on Autonomous Agents and Multi-Agent Systems (2008), pp. 911-918; http://dl.acm.org/citation.cfm?id=1402298.1402350.
20. D. Schnizlein, M. Bowling, D. Szafron, Proceedings of the Twenty-First International Joint Conference on Artificial Intelligence (2009), pp. 278-284; www.aaai.org/ocs/index.php/IJCAI/IJCAI-09/paper/view/586.
21. A. Gilpin, T. Sandholm, T. B. Sørensen, Proceedings of the Twenty-Second Conference on Artificial Intelligence (2007), pp. 50-57.
22. M. Johanson, N. Burch, R. Valenzano, M. Bowling, Proceedings of the Twelfth International Conference on Autonomous Agents and Multi-Agent Systems (2013), pp. 271-278; http://dl.acm.org/citation.cfm?id=2484965.
23. A. Krizhevsky, I. Sutskever, G. E. Hinton, Adv. Neural Inf. Process. Syst. 25, 1106-1114 (2012).
24. G. Hinton et al., IEEE Signal Process. Mag. 29, 82-97 (2012).
25. A. van den Oord, S. Dieleman, H. Zen, K. Simonyan, O. Vinyals, A. Graves, N. Kalchbrenner, A. Senior, K. Kavukcuoglu, CoRR abs/1609.03499 (2016).
26. K. He, X. Zhang, S. Ren, J. Sun, Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV) (2015), pp. 1026-1034.
27. J. Shi, M. L. Littman, Proceedings of the Second International Conference on Computers and Games (2000), pp. 333-345.
28. D. P. Kingma, J. Ba, Proceedings of the Third International Conference on Learning Representations (2014); https://arxiv.org/abs/1412.6980.
29. P. J. Huber, Ann. Math. Stat. 35, 73-101 (1964).
30. International Federation of Poker; http://pokerfed.org/about/. on May 5, 2017
31. N. Burch, M. Schmid, M. Moravcik, M. Bowling, Proceedings of the AAAI-17 Workshop on Computer Poker and Imperfect Information Games (2017); https://arxiv.org/abs/1612.06915.
32. D. Billings et al., Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence (2003), pp. 661-668.
33. T. Sandholm, AI Mag. 31, 13-32 (2010).
34. V. Lisy, T. Davis, M. Bowling, Proceedings of the Thirtieth Conference on Artificial Intelligence (2016), pp. 544-550; https://aaai.org/ocs/index.php/AAAI/AAAI16/paper/view/12469.
35. K. Chen, M. Bowling, Adv. Neural Inf. Process. Syst. 25, 2078-2086 (2012).
36. J. Rehmeyer, N. Fox, R. Rico, Wired 16, 186-191 (2008).
37. S. Ganzfried, T. Sandholm, Proceedings of the Fourteenth International Conference on Autonomous Agents and Multi-Agent Systems (2015), pp. 37-45; www.ifaamas.org/Proceedings/aamas2015/aamas/p37.pdf.
38. M. Moravcik, M. Schmid, K. Ha, M. Hladk, S. J. Gaukrodger, Proceedings of the Thirtieth Conference on Artificial Intelligence (2016), pp. 572-578; www.aaai.org/ocs/index.php/AAAI/AAAI16/paper/view/12102.
39. N. Yakovenko, L. Cao, C. Raffel, J. Fan, Proceedings of the Thirtieth Conference on Artificial Intelligence (2016), pp. 360-367.
40. J. Heinrich, D. Silver, Deep reinforcement learning from self-play in imperfect-information games. arXiv:1603.01121 [cs.LG] (28 June 2016).
41. N. Brown, T. Sandholm, Proceedings of the AAAI-17 Workshop on Computer Poker and Imperfect Information Games (2017); www.cs.cmu.edu/~sandholm/safeAndNested.aaa17WS.pdf.