Internal regret with partial monitoring: Calibration-based optimal algorithms

Journal of Machine Learning Research

Volumn 12, Issue , 2011, Pages 1896-1921

  Perchet, Vianney ^a  

^a Paris Descartes University   (France)

Author keywords

Calibration; On line learning; Partial monitoring; Regret; Repeated games; Vorono and Laguerre diagrams

Indexed keywords

DECISION MAKING;

LAGUERRE; ONLINE LEARNING; OPTIMAL ALGORITHM; RANDOM ALGORITHMS; RANDOM FEEDBACKS; REGRET; REPEATED GAMES; SEQUENTIAL DECISIONS;

CALIBRATION;

EID: 79960129843     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (32)

1. P. Auer, N. Cesa-Bianchi, Y. Freund, and R. E. Schapire. The nonstochastic multiarmed bandit problem. SIAM J. Comput., 32:48-77 (electronic), 2002/03.
2. F. Aurenhammer. A criterion for the affine equivalence of cell complexes in Rd and convex polyhedra in Rd+1. Discrete Comput. Geom., 2:49-64, 1987.
3. K. Azuma. Weighted sums of certain dependent random variables. Tôhoku Math. J. (2), 19:357-367, 1967.
4. L. J. Billera and B. Sturmfels. Fiber polytopes. The Annals of Mathematics, 135(3):pp. 527-549, 1992.
5. D. Blackwell. An analog of the minimax theorem for vector payoffs. Pacific J. Math., 6:1-8, 1956a.
6. D. Blackwell. Controlled random walks. In Proceedings of the International Congress of Mathematicians, 1954, Amsterdam, vol. III, pages 336-338, 1956b.
7. A. Blum and Y. Mansour. From external to internal regret. J. Mach. Learn. Res., 8:1307-1324 (electronic), 2007. (Pubitemid 47143711)
8. R. C. Buck. Partition of space. Amer. Math. Monthly, 50:541-544, 1943.
9. N. Cesa-Bianchi and G. Lugosi. Prediction, Learning, and Games. Cambridge University Press, Cambridge, 2006.
10. N. Cesa-Bianchi, G. Lugosi, and G. Stoltz. Minimizing regret with label efficient prediction. IEEE Trans. Inform. Theory, 51:2152-2162, 2005. (Pubitemid 40843632)
11. X. Chen and H. White. Laws of large numbers for Hilbert space-valued mixingales with applications. Econometric Theory, 12:284-304, 1996.
12. A. P. Dawid. The well-calibrated Bayesian. J. Amer. Statist. Assoc., 77:605-613, 1982.
13. D. P. Foster and R. V. Vohra. Calibrated learning and correlated equilibrium. Games Econom. Behav., 21:40-55, 1997. (Pubitemid 127175523)
14. D. P. Foster and R. V. Vohra. Asymptotic calibration. Biometrika, 85:379-390, 1998.
15. D. A. Freedman. On tail probabilities for martingales. Ann. Probability, 3:100-118, 1975.
16. D. Fudenberg and D. K. Levine. Conditional universal consistency. Games Econom. Behav., 29: 104-130, 1999.
17. J. Hannan. Approximation to Bayes risk in repeated play. In Contributions to the Theory of Games, volume 3 of Annals ofMathematics Studies, pages 97-139. Princeton University Press, Princeton, N. J., 1957.
18. S. Hart and A. Mas-Colell. A simple adaptive procedure leading to correlated equilibrium. Econometrica, 68:1127-1150, 2000.
19. W. Hoeffding. Probability inequalities for sums of bounded random variables. J. Amer. Statist. Assoc., 58:13-30, 1963.
20. T. Jaksch, R. Ortner, and P. Auer. Near-optimal regret bounds for reinforcement learning. J. Mach. Learn. Res., 11:1563-1600, 2010.
21. E. Lehrer and E. Solan. Learning to play partially-specified equilibrium. manuscript, 2007.
22. C. E. Lemke and J. T. Howson, Jr. Equilibrium points of bimatrix games. J. Soc. Indust. Appl. Math., 12:413-423, 1964.
23. G. Lugosi, S. Mannor, and G. Stoltz. Strategies for prediction under imperfect monitoring. Math. Oper. Res., 33:513-528, 2008.
24. V. Perchet. Calibration and internal no-regret with random signals. Proceedings of the 20th International Conference on Algorithmic Learning Theory, pages 68-82, 2009.
25. J. Rambau and G. M. Ziegler. Projections of polytopes and the generalized Baues conjecture. Discrete Comput. Geom., 16:215-237, 1996. (Pubitemid 126317943)
26. R. T. Rockafellar. Convex Analysis. Princeton Mathematical Series, No. 28. Princeton University Press, Princeton, N.J., 1970.
27. A. Rustichini. Minimizing regret: the general case. Games Econom. Behav., 29:224-243, 1999.
28. E. Seneta. Nonnegative Matrices and Markov Chains. Springer Series in Statistics. Springer-Verlag, New York, second edition, 1981.
29. S. Sorin. Supergames. In Game theory and applications (Columbus, OH, 1987), Econom. Theory Econometrics Math. Econom., pages 46-63. Academic Press, San Diego, CA, 1990.
30. S. Sorin. Lectures on Dynamics in Games. Unpublished Lecture Notes, 2008.
31. V. Yurinskii. Exponential inequalities for sums of random vectors. Journal of Multivariate Analysis, 6:473-499, 1976.
32. G. Ziegler. Lectures on Polytopes, volume 152 of Graduate Texts in Mathematics. Springer-Verlag, New York, 1995.