Symbolic dynamic programming for first-order MDPs

IJCAI International Joint Conference on Artificial Intelligence

Volumn , Issue , 2001, Pages 690-697

  Boutilier, Craig ^a   Reiter, Ray ^a   Price, Bob ^b  

^a UNIVERSITY OF TORONTO   (Canada)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION SPACES; DECISION-THEORETIC; EXPLICIT STATE; MARKOV DECISIONS PROCESS; OPTIMAL VALUE FUNCTIONS; SITUATION CALCULUS; VALUE FUNCTIONS; VALUE ITERATION;

ARTIFICIAL INTELLIGENCE; ITERATIVE METHODS;

DYNAMIC PROGRAMMING;

EID: 84880891360     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. F. Bacchus, J. Y. Halpern, and H. J. Levesque. Reasoning about noisy sensors in the situation calculus. IJCAI-95, 1933-1940, Montreal, 1995.
2. R. E. Bellman. Dynamic Programming. Princeton University Press, Princeton, 1957.
3. D. P. Bertsekas and J. N. Tsitsiklis. Neuro-dynamic Programming. Athena, Belmont, MA, 1996.
4. C. Boutilier, T. Dean, and S. Hanks. Decision theoretic planning: Structural assumptions and computational leverage. J. Art. Intel. Res., 11:1-94, 1999. (Pubitemid 129628760)
5. C. Boutilier, R. Dearden, and M. Goldszmidt. Stochastic dynamic programming with factored representations. Art. Intel., 121:49-107, 2000.
6. C. Boutilier, R. Reiter, M. Soutchanski, and S. Thrun. Decision-theoretic, high-level agent programming in the situation calculus. AAAI-2000, 355-362, Austin, TX, 2000.
7. H. Geffner and B. Bonet. High-level planning and control with incomplete information using POMDPs. Fall AAAI Symp. on Cognitive Robotics, Orlando, FL, 1998.
8. J. Hoey, R. St-Aubin, A. Hu, and C. Boutilier. SPUDD: Stochastic planning using decision diagrams. UAI-99, 279-288, Stockholm, 1999.
9. J. McCarthy. Situations, actions and causal laws. Tech. report, Stanford Univ., 1963. Repr. Semantic Information Processing (M. Minsky ed.), MIT Press, Cambridge, 1968, 410-417.
10. F. Pirri and R. Reiter. Some contributions to the metatheory of the situation calculus. JACM, 46(3):261-325, 1999.
11. D. Poole. The independent choice logic for modelling multiple agents under uncertainty. Art. Intel., 94(1-2):7-56, 1997.
12. M. L. Puterman. Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, 1994.
13. R. Reiter. The frame problem in the situation calculus: A simple solution (sometimes) and a completeness result for goal regression. In V. Lifschitz, ed., Artificial Intelligence and Mathematical Theory of Computation (Papers in Honor of John McCarthy), 359-380. Academic Press, 1991.
14. R. Reiter. Knowledge in Action: Logical Foundations for Describing and Implementing Dynamical Systems. MIT Press, Cambridge, MA, 2001.