Online Markov decision processes under bandit feedback

Advances in Neural Information Processing Systems 23: 24th Annual Conference on Neural Information Processing Systems 2010, NIPS 2010

Volumn , Issue , 2010, Pages

  Neu, Gergely ^a,b   György, András ^b   Szepesvári, Csaba ^c   Antos, András ^b  

^a BUDAPEST UNIVERSITY OF TECHNOLOGY AND ECONOMICS   (Hungary)

^b Machine Learning Research Group   (Hungary)

^c UNIVERSITY OF ALBERTA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

E-LEARNING; MARKOV PROCESSES; STOCHASTIC SYSTEMS;

BANDIT FEEDBACKS; LEARNING AGENTS; MARKOV DECISION PROCESSES; MARKOVIAN ENVIRONMENT; OBLIVIOUS ADVERSARIES; ONLINE LEARNING; REWARD FUNCTION; STATIONARY POLICY; STOCHASTICS; TIME STEP;

LEARNING ALGORITHMS;

EID: 85162052729     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (8)

1. Auer, P., Cesa-Bianchi, N., Freund, Y., and Schapire, R. E. (2002). The nonstochastic multiarmed bandit problem. SIAM J. Comput., 32(1):48-77.
2. Even-Dar, E., Kakade, S. M., and Mansour, Y. (2005). Experts in a Markov decision process. In Saul, L. K., Weiss, Y., and Bottou, L., editors, Advances in Neural Information Processing Systems 17, pages 401-408.
3. Even-Dar, E., Kakade, S. M., and Mansour, Y. (2009). Online Markov decision processes. Mathematics of Operations Research, 34(3):726-736.
4. Neu, G., György, A., and Szepesvári, C. (2010). The online loop-free stochastic shortest-path problem. In COLT-10.
5. Puterman, M. L. (1994). Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley-Interscience.
6. Yu, J. Y. and Mannor, S. (2009a). Arbitrarily modulated Markov decision processes. In Joint 48th IEEE Conference on Decision and Control and 28th Chinese Control Conference. IEEE Press.
7. Yu, J. Y. and Mannor, S. (2009b). Online learning in Markov decision processes with arbitrarily changing rewards and transitions. In GameNets'09: Proceedings of the First ICST international conference on Game Theory for Networks, pages 314-322, Piscataway, NJ, USA. IEEE Press.
8. Yu, J. Y., Mannor, S., and Shimkin, N. (2009). Markov decision processes with arbitrary reward processes. Mathematics of Operations Research, 34(3):737-757.