Poker-CNN: A pattern learning strategy for making draws and bets in poker games using convolutional networks

30th AAAI Conference on Artificial Intelligence, AAAI 2016

Volumn , Issue , 2016, Pages 360-367

  Yakovenko, Nikolai ^a   Cao, Liangliang ^b   Raffel, Colin ^b   Fan, James ^b  

^a PokerPoker LLC   (United States)

^b Columbia University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; HEURISTIC PROGRAMMING; NEURAL NETWORKS; PATTERN MATCHING;

CONVOLUTIONAL NETWORKS; CONVOLUTIONAL NEURAL NETWORK; DOMAIN KNOWLEDGE; LEARNING MODELS; PATTERN LEARNING; PATTERN MATCHING PROBLEMS; TEXAS HOLD'EM; ZERO KNOWLEDGE;

CONVOLUTION;

EID: 85007197275     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Bowling, M.; Burch, N.; Johanson, M.; and Tammelin, O. 2015. Heads-up limit holdem poker is solved. Science 347(6218):145-149.
2. Clark, C., and Storkey, A. 2014. Teaching deep convolutional neural networks to play go. arXiv preprint arXiv:1412.3409.
3. Dahl, F. A. 2001. A reinforcement learning algorithm applied to simplified two-player texas holdem poker. In Machine Learning: ECML 2001. Springer. 85-96.
4. Dieleman, S.; Schluter, J.; Raffel, C.; Olson, E.; Snderby, S. K.; Nouri, D.; Maturana, D.; Thoma, M.; Battenberg, E.; Kelly, J.; Fauw, J. D.; Heilman, M.; diogo149; McFee, B.; Weideman, H.; takacsg84; peterderivaz; Jon; instagibbs; Rasul, D. K.; CongLiu; Britefury; and Degrave, J. 2015. Lasagne: First release.
5. Fukushima, K. 1980. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biological cybernetics 36(4):193-202.
6. Gibson, R. 2014. Regret Minimization in Games and the Development of Champion Multiplayer Computer Poker- Playing Agents. Ph.D. Dissertation, University of Alberta.
7. Heinrich, J.; Lanctot, M.; and Silver, D. 2015. Fictitious self-play in extensive-form games. In Proceedings of the 32nd International Conference on Machine Learning, ICML 2015, Lille, France, 6-11 July 2015, 805-813.
8. Johanson, M.; Waugh, K.; Bowling, M.; and Zinkevich, M. 2011. Accelerating best response calculation in large extensive games. In IJCAI, volume 11, 258-265.
9. Johanson, M.; Burch, N.; Valenzano, R.; and Bowling, M. 2013a. Evaluating state-space abstractions in extensive-form games. In Proceedings of the 2013 international conference on Autonomous agents and multi-Agent systems, 271-278. International Foundation for Autonomous Agents and Multiagent Systems.
10. Johanson, M.; Burch, N.; Valenzano, R.; and Bowling, M. 2013b. Evaluating state-space abstractions in extensiveform games. In Proceedings of the 2013 international conference on Autonomous agents and multi-Agent systems, 271-278. International Foundation for Autonomous Agents and Multiagent Systems.
11. Krizhevsky, A.; Sutskever, I.; and Hinton, G. E. 2012. Imagenet classification with deep convolutional neural networks. In NIPS, 1106-1114.
12. LeCun, Y.; Bottou, L.; Bengio, Y.; and Haffner, P. 1998. Gradient based learning applied to document recognition. PIEEE 86(11):2278-2324.
13. Maddison, C. J.; Huang, A.; Sutskever, I.; and Silver, D. 2014. Move evaluation in go using deep convolutional neural networks. arXiv preprint arXiv:1412.6564.
14. Mnih, V.; Kavukcuoglu, K.; Silver, D.; Rusu, A. A.; Veness, J.; Bellemare, M. G.; Graves, A.; Riedmiller, M.; Fidjeland, A. K.; Ostrovski, G.; et al. 2015. Humanlevel control through deep reinforcement learning. Nature 518(7540):529-533.
15. Rubin, J., and Watson, I. 2011. Computer poker: A review. Artificial Intelligence 175(5):958-987.
16. Rutkin, A. 2015. Ai wears its best poker face to take on the pros. New Scientist 226(3020):21.
17. Sandholm, T. 2015a. Abstraction for solving large incomplete-information games. In AAAI Conference on Artificial Intelligence (AAAI). Senior Member Track.
18. Sandholm, T. 2015b. Solving imperfect-information games. Science 347(6218):122-123.
19. Simonyan, K., and Zisserman, A. 2014. Very deep convolutional networks for large-scale image recognition. CoRR abs/1409.1556.
20. Sutskever, I.; Martens, J.; Dahl, G.; and Hinton, G. 2013. On the importance of initialization and momentum in deep learning. In ICML, 1139-1147.
21. Taigman, Y.; Yang, M.; Ranzato, M.; and Wolf, L. 2014. Deepface: Closing the gap to human-level performance in face verification. In CVPR.
22. Tesauro, G. 1994. Td-gammon, a self-Teaching backgammon program, achieves master-level play. Neural computation 6(2):215-219.
23. Waugh, K. 2013. A fast and optimal hand isomorphism algorithm. In AAAI Workshop on Computer Poker and Incomplete Information.
24. Zinkevich, M.; Johanson, M.; Bowling, M.; and Piccione, C. 2007. Regret minimization in games with incomplete information. In Advances in neural information processing systems, 1729-1736.