Tuning bandit algorithms in stochastic environments

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4754 LNAI, Issue , 2007, Pages 150-165

  Audibert, Jean Yves ^a   Munos, Rémi ^b   Szepesvári, Csaba ^c  

^a UNIVERSITÉ PARIS EST   (France)

^b INRIA   (France)

^c UNIVERSITY OF ALBERTA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; PARAMETER ESTIMATION; POLYNOMIALS; PROBLEM SOLVING; RISK ANALYSIS;

LOGARITHMIC; STOCHASTIC ENVIRONMENTS; SUBOPTIMAL ARMS;

TUNING;

EID: 38149013086     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-75225-7_15     Document Type: Conference Paper

References (9)

1. Agrawal, R.: Sample mean based index policies with O(log n) regret for the multiarmed bandit problem. Advances in Applied Probability 27, 1054-1078 (1995)
2. Audibert, J.-Y., Munos, R., Szepesvári,Cs.: Variance estimates and exploration function in multi-armed bandit. Research report 07-31, Certis - Ecole des Ponts (2007), http://cermics.enpc.fr/~audibert/RR0731.pdf
3. Auer, P., Cesa-Bianchi, N., Fischer, P.: Finite time analysis of the multiarmed bandit problem. Machine Learning 47(2-3), 235-256 (2002)
4. Auer, P., Cesa-Bianchi, N., Shawe-Taylor, J.: Exploration versus exploitation challenge. In: 2nd PASCAL Challenges Workshop. Pascal Network (2006)
5. Gittins, J.C.: Multi-armed Bandit Allocation Indices. In: Wiley-Interscience series in systems and optimization. Wiley, Chichester (1989)
6. Lai, T.L., Robbins, H.: Asymptotically efficient adaptive allocation rules. Advances in Applied Mathematics 6, 4-22 (1985)
7. Lai, T.L., Yakowitz, S.: Machine learning and nonparametric bandit theory. IEEE Transactions on Automatic Control 40, 1199-1209 (1995)
8. Robbins, H.: Some aspects of the sequential design of experiments. Bulletin of the American Mathematics Society 58, 527-535 (1952)
9. Thompson, W.R.: On the likelihood that one unknown probability exceeds another in view of the evidence of two samples. Biometrika 25, 285-294 (1933)