Nearly optimal exploration-exploitation decision thresholds

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4131 LNCS - I, Issue , 2006, Pages 850-859

  Dimitrakakis, Christos ^a  

^a IDIAP RESEARCH INSTITUTE   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; DECISION MAKING; PROBLEM SOLVING;

OPTIMAL DECISION THRESHOLDS; REINFORCEMENT LEARNING;

LEARNING SYSTEMS;

EID: 33749818313     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11840817_88     Document Type: Conference Paper

References (14)

1. Wald, A.: Sequential Analysis. John Wiley & Sons (1947) Republished by Dover in 2004.
2. DeGroot, M.H.: Optimal Statistical Decisions. John Wiley & Sons (1970) Republished in 2004.
3. Bellman, R.E.: A problem in the sequential design of experiments. Sankhya 16 (1957) 221-229
4. Marmor, S., Tsitsiklis, J.N.: The sample complexity of exploration in the multiarmed bandit problem. Journal of Machine Learning Research 5 (2004) 623-648
5. Dearden, R., Friedrnan, N., Russell, S.J.: Bayesian Q-learning. In: AAAI/IAAI. (1998) 761-768
6. Even-Dar, E., Mannor, S., Mansour, Y.: Action elimination and stopping conditions for the multi-armed and reinforcement learning problems. Journal of Machine Learning Research (2006) to appear.
7. Sutton, R.S., Barto, A.G.; Reinforcement Learning: An Introduction. MIT Press (1998)
8. Corless, R.M., Gonnet, G.H., Hare, D.E.G., Jeffrey, D.J., Knuth, D.E.: On the lambert W function. Advances in Computational Mathematics 5 (1996) 329-359
9. Sutton, R.S., Precup, D., Singh, S.P.: Between MDPs and serni-MDPs: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence 112(1-2) (1999) 181-211
10. Madani, O., Lizotte, D.J., Greiner, R.: The budgeted multi-armed bandit problem. In: Learning Theory: 17th Annual Conference on earning Theory, COLT 2004. Volume 3120 of Lecture Notes in Computer Science., Springer-Verlag (2004) 643-645
11. Madani, O., Lizotte, D.J., Greiner, R.: Active model selection. In: Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence, Banff, Canada, AUAI Press, Arlington, Virginia (2004) 357-365
12. Auer, P.: Models for trading exploration and exploitation using upper confidence bounds, In: PASCAL workshop on principled methods of trading exploration and exploitation, PASCAL Network (2005)
13. Bernardo, J.M.: Expected information as expected utility, In: The Annals of Statistics. Volume 7., Institute of Mathematical Statistics (1979) 686-690
14. Dimitrakakis, C., Bengio, S.: Gradient estimates of return. IDIAP-RR 05-29, IDIAP (2005)