Simulation studies of multi-armed bandits with covariates (Invited paper)

Proceedings - UKSim 10th International Conference on Computer Modelling and Simulation, EUROSIM/UKSim2008

Volumn , Issue , 2008, Pages 493-498

  Pavlidis, Nicos G ^a   Tasoulis, Dimitris K ^a   Hand, David J ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ASYMPTOTIC ANALYSIS; ESTIMATION;

ASYMPTOTIC BEHAVIOUR; COMPUTER MODELLING; COVARIATES; INTERNATIONAL CONFERENCES; INTERVAL ESTIMATION; MULTI-ARMED BANDIT PROBLEM; MULTI-ARMED BANDITS; OPTIMAL POLICIES; PERFORMANCE MEASURES; SELECTION METHODS; SIMULATION STUDIES;

COMPUTER SYSTEMS;

EID: 50149089442     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/UKSIM.2008.86     Document Type: Conference Paper

References (11)

1. B. Awerbuch and R. Kleinberg. Adaptive routing with end-to-end feedback: Distributed learning and geometric approaches. In Proceedings of the 36th ACM Symposium on Theory of Computing (STOC 2004), pages 45-53, 2004.
2. J. P. Hardwick and Q. F. Stout. Bandit strategies for ethical sequential allocation. Computing Science and Statistics, 23:421-424, 1991.
3. L. P. Kaelbling. Learning in Embedded Systems. MIT Press, Cambridge, MA, 1993.
4. W. G. Macready and D. H. Wolpert. Bandit problems and the exploration/exploitation tradeoff. IEEE Transactions on Evolutionary Computation, 2(1):2-22, 1998.
5. H. Robbins. Some aspects of the sequential design of experiments. Bulletin of the American Mathematical Society, 55:527-535, 1952.
6. S. V. Shibayev, N. M. Adams, and D. J. Hand. State-of-the-art in action choice to maximize rewards with complete data. Technical report, Imperial College London, September 2006.
7. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
8. J. Velmorel and M. Mohri. Multi-armed bandit algorithms and empirical evaluation. In J. Gama, R. Camacho, P. Brazdil, A. Jorge, and L. Torgo, editors, Lecture Notes in Artificial Intelligence, volume 3720, pages 437-448. Springer-Verlag, Berlin Heidelberg, 2005.
9. C. J. C. H. Watkins. Learning from Delayed Rewards. PhD thesis, Cambridge University, 1989.
10. S. Weisberg. Applied Linear Regression. John Wiley & Sons, 1980.
11. Y. Yang and D. Zhu. Randomized allocation with nonparametric estimation for a multi-armed bandit problem with covariates. The Annals of Statistics, 30(1):100-121, February 2002.