Reverse iterative deepening for finite-horizon MDPs with large branching factors

ICAPS 2012 - Proceedings of the 22nd International Conference on Automated Planning and Scheduling

Volumn , Issue , 2012, Pages 146-154

  Kolobov, Andrey ^a   Dai, Peng ^a,b   Mausam, ^a   Weld, Daniel S ^a  

^a University of Washington   (United States)

^b GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BRANCHING FACTORS; DETERMINIZATION; GOAL-ORIENTED; ITERATIVE DEEPENING; MAXIMIZATION PROBLEM; NATURAL DYNAMICS; OPTIMAL ALGORITHM; PROBABILISTIC PLANNING; TERMINAL STATE; TRANSITION FUNCTIONS;

OPTIMIZATION;

ALGORITHMS;

EID: 84866455769     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Barto, A.; Bradtke, S.; and Singh, S. 1995. Learning to act using real-time dynamic programming. Artificial Intelligence 72:81-138.
2. Bellman, R. 1957. Dynamic Programming. Princeton University Press.
3. Bertsekas, D. 1995. Dynamic Programming and Optimal Control. Athena Scientific.
4. Bonet, B., and Geffner, H. 2003. Labeled RTDP: Improving the convergence of real-time dynamic programming. In ICAPS'03, 12-21.
5. Bryce, D., and Buffet, O. 2008. International planning competition, uncertainty part: Benchmarks and results. In http://ippc-2008.loria.fr/wiki/ images/0703/Results.pdf.
6. Feng, Z.; Hansen, E. A.; and Zilberstein, S. 2003. Symbolic generalization for on-line planning. In UAI, 109-116.
7. Hoffmann, J., and Nebel, B. 2001. The FF planning system: Fast plan generation through heuristic search. Journal of Artificial Intelligence Research 14:253-302.
8. Keller, T., and Eyerich, P. 2012. PROST: Probabilistic Planning Based on UCT. In ICAPS'12.
9. Mausam, and Weld, D. S. 2004. Solving concurrent markov decision processes. In AAAI'04.
10. Nilsson, N. 1980. Principles of Artificial Intelligence. Tioga Publishing.
11. Proper, S., and Tadepalli, P. 2006. Scaling model-based average-reward reinforcement learning for product delivery. In ECML, 735-742.
12. Puterman, M. 1994. Markov Decision Processes. John Wiley & Sons.
13. Sanner, S. 2010. Relational dynamic influence diagram language (RDDL): Language description. http://users.cecs.anu.edu.au/ssanner/IPPC-2011/RDDL.pdf.
14. Sanner, S. 2011. ICAPS 2011 international probabilistic planning competition. http://users.cecs.anu.edu.au/ssanner/IPPC-2011/.
15. Teichteil-Koenigsbuch, F.; Infantes, G.; and Kuter, U. 2008. RFF: A robust, FF-based MDP planning algorithm for generating policies with low probability of failure. In Sixth International Planning Competition at ICAPS'08.
16. Yoon, S.; Fern, A.; and Givan, R. 2007. FF-Replan: A baseline for probabilistic planning. In ICAPS'07, 352-359.