On similarities between inference in game theory and machine learning

Journal of Artificial Intelligence Research

Volumn 33, Issue , 2008, Pages 259-283

  Rezek, Iead ^a   Leslie, David S ^b   Reece, Steven ^c   Roberts, Stephen J ^c   Rogers, Alex ^d   Dash, Rajdeep K ^d   Jennings, Nicholas R ^d  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF BRISTOL   (United Kingdom)

^c UNIVERSITY OF OXFORD   (United Kingdom)

^d UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; CLUSTERING ALGORITHMS; GAME THEORY; INFERENCE ENGINES; MACHINE LEARNING;

BAYESIAN APPROACHES; BAYESIAN INFERENCE; CONVERGENCE PROPERTIES; EMPIRICAL AVERAGES; LEARNING IN GAMES; MACHINE LEARNING PROBLEM; MIXTURE DISTRIBUTIONS; STRONGLY CONNECTED;

LEARNING ALGORITHMS;

EID: 55349113260     PISSN: None     EISSN: 10769757     Source Type: Journal    
DOI: 10.1613/jair.2523     Document Type: Article

References (37)

1. Bernardo, J. M., &: Smith, A. F. M. (1994). Bayesian Theory. John Wiley and Sons.
2. Bishop, C. M. (2006). Pattern Recognition and Machine Learning. Oxford University Press, Oxford.
3. Demiriz, A., Bennett, K. P., & Shawe-Taylor, J. (2002). Linear programming boosting via column generation. Machine Learning, 46(1-3), 225-254.
4. Freund, Y., & Schapire, R. E. (1997). A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences, 55(1), 119-139.
5. Fudenberg, D., & Levine, D. K. (1999). The Theory of Learning in Games. MIT Press.
6. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2000). Bayesian Data Analysis. Chapman & Hall/CRC.
7. Greenwald, A., & Littman, M. L. (2007). Introduction to the special issue on learning and computational game theory. Machine Learning, 67(1-2), 3-6.
8. Grünwald, P. D., & Dawid, A. P. (2004). Game Theory, Maximum Entropy, Minimum Discrepancy and Robust Bayesian Decision Theory. Annals of Statistics, 32, 1367-1433.
9. Haft, M., Hofmann, R., & Tresp, V. (1999). Model-Independent Mean Field Theory as a Local Method for Approximate Propagation of Information. Computation in Neural Systems, 10, 93-105.
10. Hofbauer, J., & Hopkins, E. (2005). Learning in perturbed asymmetric games. Games and Economic Behavior, 52, 133-157.
11. Hofbauer, J., & Sorin, S. (2006). Best response dynamics for continuous zero-sum games. Discrete and Continuous Dynamical Systems, B6, 215-224.
12. Husmeier, D., Dybowski, R., & Roberts, S. J. (Eds.). (2004). Probabilistic Modeling in Bioinformatics and Medical Informatics. Advanced Information and Knowledge Processing. Springer Verlag.
13. Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1997). An Introduction to Variational Methods for Graphical Models. In Jordan, M. I. (Ed.), Learning in Graphical Models. Kluwer Academic Press.
14. Kalai, E., & Lehrer, E. (1993). Rational Learning Leads to Nash Equilibrium. Econometrica, 61(5), 1019-1045.
15. Kearns, M., Littman, M. L., & Singh, S. (2001). Graphical Models for Game Theory. In Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence, pp. 253-260.
16. Lambert, T., Epelman, M. A., & Smith, R. L. (2005). A Fictitious Play Approach to Large-Scale Optimization. Operations Research, 53(3), 477-489.
17. Lee, C. F., & Wolpert, D. H. (2004). Product Distribution Theory for Control of Multi-Agent Systems. In AAMAS '04'. Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 522-529, New York, USA.
18. Leslie, D. S., & Collins, E. J. (2005). Generalised weakened fictitious play. Games and Economic Behavior, 56(2), 285-298.
19. Liu, W., Besterfield, G., & Belytschko, T. (1988). Variational approach to probabilistic finite elements. Journal of Engineering Mechanics, 114(12), 2115-2133.
20. Lowne, D., Haw, C., & Roberts, S. (2006). An adaptive, sparse-feedback EEG classifier for self-paced BCI. In Proceedings of the Third International Workshop on Brain-Computer Interfaces, Graz, Austria.
21. MacKay, D. J. C. (1992). The Evidence Framework Applied to Classification Networks. Neural Computation, 4(5), 720-736.
22. MacKay, D. J. C. (2003). Information Theory, Inference, and Learning Algorithms. Cambridge University Press.
23. Pearl, J. (1988). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann Publishers.
24. Penny, W., & Roberts, S. (1999). Dynamic logistic regression. In Proceedings of the International Joint Conference on Neural Networks (IJCNN'99), Vol. 3, pp. 1562-1567.
25. Penny, W., & Roberts, S. (2002). Bayesian Multivariate Autoregressive Models with Structured Priors. IEE Proceedings on Vision, Signal and Image Processing, 149(1), 33-41.
26. Redner, R. A., & Walker, H. F. (1984). Mixture Densities, Maximum Likelihood and the EM Algorithm. SIAM Review, 26(2), 195-239.
27. Ripley, B. (2000). Pattern Recognition and Neural Networks. Cambridge University Press.
28. Robert, C. P., & Casella, G. (1999). Monte Carlo Statistical Methods. Springer-Verlag: New York.
29. Roberts, S., Holmes, C., & Denison, D. (2001). Minimum Entropy data partitioning using Reversible Jump Markov Chain Monte Carlo. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(8), 909-915.
30. Shamma, J. S., & Arslan, G. (2005). Dynamic Fictitious Play, Dynamic Gradient Play and Distributed Convergence to Nash Equilibria. IEEE Transactions on Automatic Control, 50(3), 312-327.
31. Shoham, Y., Powers, R., & Grenager, T. (2007). If multi-agent learning is the answer, what is the question. Artificial Intelligence, 171(7), 365-377.
32. Smyrnakis, M., & Leslie, D. (2008). Stochastic Fictitious Play using particle Filters to update the beliefs of opponents strategies. In Proceedings of the First International Workshop on Optimisation in Multi-Agent Systems (OPTMAS) at the Seventh International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2008).
33. Uedaa, N., & Ghahramani, Z. (2002). Bayesian model search for mixture models based on optimizing variational bounds. Neural Networks, 15, 1223-1241.
34. van der Genugten, B. (2000). A Weakened Form of factitious Play in Two-Person Zero-Sum Games. International Game Theory Review, 2(4), 307-328.
35. Wolpert, D. H. (2004). Information Theory - The Bridge Connecting Bounded Rational Game Theory and Statistical Physics. arXiv.org:cond-mat/0402508.
36. Wolpert, D., Strauss, C., & Rajnarayan, D. (2006). Advances in Distributed Optimization Using Probability Collectives. Advances in Complex Systems, 9(4), 383-436.
37. Young, H. P. (1998). Individual Strategy and Social Structure: An Evolutionary Theory of Institutions. Princeton University Press.