Bounded real-time dynamic programming: RTDP with monotone upper bounds and performance guarantees

ICML 2005 - Proceedings of the 22nd International Conference on Machine Learning

Volumn , Issue , 2005, Pages 569-576

  McMahan, H Brendan ^a   Likhachev, Maxim ^a   Gordon, Geoffrey J ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATION THEORY; DYNAMIC PROGRAMMING; PLANNING; PROBLEM SOLVING;

BOUNDED RTDP; OPTIMAL VALUE FUNCTION; REAL-TIME DYNAMIC PROGRAMMING;

LEARNING SYSTEMS;

EID: 31844446535     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1102351.1102423     Document Type: Conference Paper

References (12)

1. Barto, A. G., Bradtke, S. J., & Singh, S. P. (1995). Learning to act using real-time dynamic programming. Artif. Intell., 72, 81-138.
2. Bertsekas, D. P., & Tsitsiklis, J. N. (1996). Neurodynamic programming. Belmont, MA: Athena Scientific.
3. Bonet, B., & Geffner, H. (2003a). Faster heuristic search algorithms for planning with uncertainty and full feedback. Proc. 18th International Joint Conf. on Artificial Intelligence (pp. 1233-1238). Acapulco, Mexico: Morgan Kaufmann.
4. Bonet, B., & Geffner, H. (2003b). Labeled RTDP: Im
5. proving the convergence of real-time dynamic programming. Proc. of ICAPS-03 (pp. 12-21).
6. Dean, T., Kaelbling, L. P., Kirman, J., & Nicholson, A. (1995). Planning under time constraints in stochastic domains. Artif. Intell., 76, 35-74.
7. Ferguson, D., & Stentz, A. T. (2004). Focussed dynamic programming: Extensive comparative results (Technical Report CMU-RI-TR-04-13). Robotics Institute, Carnegie Mellon University, Pittsburgh, PA.
8. Hansen, E. A., & Zilberstein, S. (2001). LAO*: a heuristic search algorithm that finds solutions with loops. Artif. Intell., 129, 35-62.
9. McMahan, H. B., & Gordon, G. J. (2005). Fast exact planning in markov decision processes. To appear in ICAPS.
10. Ng, A. Y., Coates, A., Diel, M., Ganapathi, V., Schulte, J., Tse, B., Berger, E., & Liang, E. (2004). Inverted autonomous helicopter flight via reinforcement learning. ISER. Springer.
11. Roy, N., Gordon, G., & Thrun, S. (2004). Finding approximate POMDP solutions through belief compression. Journal of Artificial Intelligence Research. To appear.
12. Smith, T., & Simmons, R. (2004). Heuristic search value iteration for pomdps. Proc. of UAI 2004. Banff, Alberta.