A note on bandits with a twist

SIAM Journal on Discrete Mathematics

Volumn 18, Issue 1, 2004, Pages 110-113

  Katta, Akshay Kumar ^a   Sethuraman, Jay ^a  

^a Fu Foundation School of Engineering and Applied Science   (United States)

Author keywords

Game; Generalized bandit problem; Gittins index; Multiarmed bandit problem; Priority rule; Stochastic scheduling

Indexed keywords

GAME; GENERALIZED BANDIT PROBLEM; GITTINS INDEX; MULTIARMED BANDIT PROBLEM; PRIORITY RULE; STOCHASTIC SCHEDULING;

ALGORITHMS; COMBINATORIAL MATHEMATICS; FINITE DIFFERENCE METHOD; GAME THEORY; MARKOV PROCESSES; PROBLEM SOLVING;

OPTIMIZATION;

EID: 14644442290     PISSN: 08954801     EISSN: None     Source Type: Journal    
DOI: 10.1137/S0895480103433549     Document Type: Article

References (15)

1. D. BERTSIMAS AND J. NINO-MORA, Conservation laws, extended polymatroids and multi-armed bandit problems: A polyhedral approach to indexable systems, Math. Oper. Res., 21 (1996), pp. 257-306.
2. J. H. CROSBIE AND K. GLAZEBROOK, Index policies and a novel performance space structure for a class of generalized branching bandit problems, Math. Oper. Res., 25 (2000), pp. 281-297.
3. M. DACRE, K. GLAZEBROOK, AND J. NINO-MORA, The achievable region approach to the optimal control of stochastic systems, J. Roy. Statist. Soc. Ser. B, 61 (1999), pp. 747-791.
4. I. DUMITRIU, P. TETALI, AND P. WINKLER, On playing golf with two balls, SIAM J. Discrete Math., 16 (2003), pp. 604-615.
5. J. C. GITTINS, Multi-Armed Bandit Allocation Indices, Wiley, New York, 1989.
6. J. C. GITTINS, Bandit processes and dynamic allocation indices, J. Roy. Statist. Soc. Ser. B, 41 (1979), pp. 148-177.
7. J. C. GITTINS AND D. M. JONES, A dynamic allocation index for the sequential design of experiments, in Progress in Statistics, Colloq. Math. Soc. Janos Bolyai 9, J. Gani, K. Sarkadi, and I. Vincze, eds., North-Holland, Amsterdam, 1974, pp. 241-266.
8. P. NASH, A generalised bandit problem, J. Roy. Statist. Soc. Ser. B, 42 (1980), pp. 165-169.
9. R. WEBER, On the Gittins index for multiarmed bandits, Ann. Appl. Probab., 2 (1992), pp. 1024-1033.
10. J. N. TSITSIKLIS, A lemma on the multi-armed bandit problem, IEEE Trans. Automat. Control, 31 (1986), pp. 576-577.
11. J. N. TSITSIKLIS, A short proof of the Gittins index theorem, Ann. Appl. Probab., 4 (1994), pp. 194-199.
12. P. VARAIYA, J. WALRAND, AND C. BUYUKKOC, Extensions of the multi-armed bandit problem: The discounted case, IEEE Trans. Automat. Control, 30 (1985), pp. 426-439.
13. G. WEISS, Branching bandit processes, Probab. Engrg. Inform. Sci., 2 (1988), pp. 269-278.
14. P. WHITTLE, Multi-armed bandits and the Gittins index, J. Roy. Statist. Soc. Ser. B, 42 (1980), pp. 143-149.
15. P. WHITTLE, Arm acquiring bandits, Ann. Probab., 9 (1981), pp. 284-292.