Monte Carlo Bayesian reinforcement learning

Proceedings of the 29th International Conference on Machine Learning, ICML 2012

Volumn 2, Issue , 2012, Pages 1135-1142

  Wang, Yi ^a   Won, Kok Sung ^a   Hsu, David ^a   Lee, Wee Sun ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

CROSS PRODUCT; FINITE SET; GENERAL APPROACH; GUARANTEED PERFORMANCE; MODEL PARAMETERS; MONTE CARLO; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; POINT-BASED APPROXIMATION; PRIOR KNOWLEDGE; STATE SPACE;

APPROXIMATION ALGORITHMS; MONTE CARLO METHODS; PROBABILITY DISTRIBUTIONS;

REINFORCEMENT LEARNING;

EID: 84867122397     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. Asmuth, J., Li, L., Littman, M. L., Nouri, A., and Wingate, D. A Bayesian sampling approach to exploration in reinforcement learning. In UAI, 2009.
2. Axelrod, R. The Evolution of Cooperation. Basic Books, New York, NY, 1984.
3. Castro, P. S. and Precup, D. Using linear programming for Bayesian exploration in Markov Decision Processes. In IJCAI, 2007.
4. Dearden, R., Friedman, N., and Russell, S. Bayesian Q-learning. In AAAI, pp. 761-768, 1998.
5. Dearden, R., Friedman, N., and Andre, D. Model-based Bayesian exploration. In UAI, 1999.
6. Duff, M. O. Optimal Learning: Computational Procedures for Bayes-Adaptive Markov Decision Processes. PhD thesis, University of Massachusetts Amherst, 2002.
7. Kaelbling, L. P., Littman, M. L., and Cassandra, A. R. Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101:99-134, 1998.
8. Kraines, D. and Kraines, V. Evolution of learning among pavlov strategies in a competitive environment with noise. Journal of Conflict Resolution, 39:439-466, 1995.
9. Kurniawati, H., Hsu, D., and Lee, W. S. SARSOP: Efficient point-based POMDP planning by approximating optimally reachable belief spaces. In RSS, 2008.
10. Leonard, J., How, J., and Teller, S. A perception driven autonomous urban vehicle. Journal of Field Robotics, 25(10): 727-774, 2008.
11. Li, J. How to design a strategy to win an IPD tournament. In The Iterated Prisoners' Dilemma: 20 Years On, 2007.
12. Littman, M. L. and Stone, P. Leading best-response strategies in repeated games. In IJCAI Workshop on Economic Agents, Models, and Mechanisms, 2001.
13. Liu, Y. and Ozguner, U. Human driver model and driver decision making for intersection driving. IEEE Intelligent Vehicles Symposium, pp. 642-647, 2007.
14. Ng, A. and Jordan, M. PEGASUS: A policy search method for large MDPs and POMDPs. In UAI, pp. 406-415, 2000.
15. Nowak, M. and Sigmund, K. A strategy of win-stay, lose-shift that outperforms tit-for-tat in the prisoner's dilemma game. Nature, 364, 1993.
16. Ong, S. C. W., Png, S. W., Hsu, D., and Lee, W. S. Planning under uncertainty for robotic tasks with mixed observability. IJRR, 29(8):1053-1068, 2010.
17. Pineau, J., Gordon, G., and Thrun, S. Point-based value iteration: An anytime algorithm for POMDPs. In IJCAI, pp. 1025-1032, 2003.
18. Poundstone, W. Prisoner's Dilemma. Doubleday, New York, NY, 1992.
19. Poupart, P. and Vlassis, N. Model-based Bayesian reinforcement learning in partially observable domains. In ISAIM, 2008.
20. Poupart, P., Vlassis, N., Hoey, J., and Regan, K. An analytic solution to discrete Bayesian reinforcement learning. In ICML, pp. 697-704, 2006.
21. Ross, S. and Pineau, J. Model-based Bayesian reinforcement learning in large structured domains. In UAI, 2008.
22. Ross, S., Chaib-draa, B., and Pineau, J. Bayes-adaptive POMDPs. In NIPS, 2007.
23. Slany, W. and Kienreich, W. On some winning strategies for the Iterated Prisoner's Dilemma or Mr. Nice Guy and the Cosa Nostra. In The Iterated Prisoners' Dilemma: 20 Years On, 2007.
24. Smith, T. and Simmons, R. G. Point-based POMDP algorithms: Improved analysis and implementation. In UAI, pp. 542-547, 2005.
25. Wang, T., Lizotte, D., Bowling, M., and Schuurmans, D. Bayesian sparse sampling for on-line reward optimization. In ICML, 2005.