Finite-time lower bounds for the two-armed bandit problem

IEEE Transactions on Automatic Control

Volumn 45, Issue 4, 2000, Pages 711-714

  Kulkarni, Sanjeev R ^a   Lugosi, Gábor ^b  

^a Princeton University   (United States)

^b UNIVERSITAT POMPEU FABRA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

ASYMPTOTIC STABILITY; CHEBYSHEV APPROXIMATION; INTEGRAL EQUATIONS; NORMAL DISTRIBUTION; PROBABILITY DENSITY FUNCTION; RANDOM PROCESSES; THEOREM PROVING;

ASYMPTOTIC LOWER BOUND; FINITE TIME LOWER BOUND; LAI-ROBBINS LOWER BOUND; RANDOM GUESSING STRATEGY; TWO ARMED BANDIT PROBLEM;

CONTROL THEORY;

EID: 0034171759     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/9.847107     Document Type: Article

References (9)

1. R. Agrawal, M. Hedge, and D. Teneketzis, "Asymptotically efficient adaptive allocation rules for the multiarmed bandit problem with switching cost," IEEE Trans. Automat. Contr., vol. 33, pp. 899-906, Oct. 1988.
2. R. Agrawal, D. Teneketzis, and V. Anantharam, "Asymptotically efficient adaptive allocation schemes for controlled i.i.d. processes: Finite parameter space," IEEE Trans. Automat. Contr., vol. 34, pp. 258-266, Mar. 1989.
3. V. Anantharam, P. Varaiya, and J. Walrand, "Asymptotically efficient allocation rules for the multiarmed bandit problem with multiple plays - Part I: i.i.d. rewards," IEEE Trans. Automat. Contr., vol. 32, pp. 968-976, Nov. 1987.
4. _, "Asymptotically efficient allocation rules for the multiarmed bandit problem with multiple plays - Part II: Markovian rewards," IEEE Trans. Automat. Contr., vol. 32, no. 11, pp. 977-982, Nov. 1987.
5. D. A. Berry and B. Fristedt, Bandit Problems. New York: Chapman and Hall, 1985.
6. J. C. Gittina, Multi-Armed Bandit Allocation Indices. New York: Wiley, 1989.
7. T. L. Lai and H. Robbins, "Asymptotically efficient adaptive allocation rules," Advances Appl. Math., vol. 6, pp. 4-22, 1985.
8. H. Robbins, "Some aspects of the sequential design of experiments," Bull. Amer. Math. Soc., vol. 58, pp. 527-535, 1952.
9. W. R. Thompson, "On the likelihood that one unknown probability exceeds another in view of the evidence of two samples," Biometrika, vol. 25, pp. 275-294, 1933.