Reinforcement learning with limited reinforcement: Using Bayes risk for active learning in POMDPs

10th International Symposium on Artificial Intelligence and Mathematics, ISAIM 2008

Volumn , Issue , 2008, Pages

  Doshi, Finale ^a   Roy, Nicholas ^a   Pineau, Joelle ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

ACTIVE LEARNING; APPROXIMATE ALGORITHMS; BAYES RISK; DOMAIN KNOWLEDGE; HIDDEN STATE; MODEL PARAMETERS; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; PLANNING DOMAINS;

ARTIFICIAL INTELLIGENCE;

REINFORCEMENT LEARNING;

EID: 84864606634     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Cohn, D. A.; Ghahramani, Z.; and Jordan, M. I. 1996. Active learningwith statistical models. Journal of Artificial Intelligence Research 4:129-145.
2. Dearden, R.; Friedman, N.; and Andre, D. 1999. Model based bayesian exploration. 150-159.
3. Even-Dar, E.; Kakade, S. M.; and Mansour, Y. 2005. Reinforcement learning in pomdps without resets. In IJCAI, 690-695.
4. Jaulmes, R.; Pineau, J.; and Precup, D. 2005. Learning in non-stationary partially observable markov decision processes. In ECML Workshop.
5. Littman, M. L.; Cassandra, A. R.; and Kaelbling, L. P. 1995. Learning policies for partially observable environments: scaling up. ICML.
6. Ng, A., and Russell, S. 2000. Algorithms for inverse reinforcement learning. In Proceedings of ICML.
7. Pineau, J.; Gordon, G.; and Thrun, S. 2003. Point-based value iteration: An anytime algorithm for pomdps. IJCAI.
8. Poupart, P.; Vlassis, N.; Hoey, J.; and Regan, K. 2006. An analytic solution to discrete bayesian reinforcement learning. In ICML, 697-704. New York, NY, USA: ACMPress.
9. Rabiner, L. R. 1989. A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of the IEEE 77(2):257-286.
10. Sato,M. 1999. Fast learning of on-line em algorithm. Technical Report, TR-H-281, ATR Human Information Processing Research Laboratorie.
11. Strehl, A. L.; Li, L.; and Littman, M. L. 2006. Incremental model-based learners with formal learning-time guarantees. In Proceedings of the 22nd Conference on Uncertainty in Artificial Intelligence.
12. Strens, M. 2000. A bayesian framework for reinforcement learning. In Proc. of the 17th International Conf. on Machine Learning.
13. Sutton, R. 1988. Learning to predict by the methods of temporal differences. Machine Learning 3.
14. Watkins, C. 1989. Learning from Delayed Rewards. Ph.D. Dissertation, Cambridge University.
15. Williams, J., and Young, S. 2005. Scaling up pomdps for dialogue management: The "summary pomdp" method. In Proceedings of the IEEE ASRU Workshop.