Region-based value iteration for partially observable Markov decision processes

ACM International Conference Proceeding Series

Volumn 148, Issue , 2006, Pages 561-568

  Li, Hui ^a   Liao, Xuejun ^a   Carin, Lawrence ^a  

^a USA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MARKOV DECISION PROCESSES; OPTIMAL POLICY; POLYHEDRAL PARTITION; REGION-BASED VALUE ITERATION (RBVI);

ALGORITHMS; APPROXIMATION THEORY; DECISION MAKING; ITERATIVE METHODS; MAXIMUM LIKELIHOOD; PARAMETER ESTIMATION; VECTORS;

MARKOV PROCESSES;

EID: 34250694951     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1143844.1143915     Document Type: Conference Paper

References (14)

1. Brafman, R. I. (1997). A heuristic variable grid solution method for pomdps. AAAI (pp. 727-733).
2. Cheng, H.-T. (1988). Algorithms for partially observable Markov decision processes. Doctoral dissertation, University of British Columbia, Vancouver, BC.
3. Corduneanu, A., & Bishop, C. (2001). Variational Bayesian model selection for mixture distributions. AI and Statistics (pp. 27-34).
4. Kaelbling, L., Littman, M., & Cassandra, A. (1998). Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101, 99-134.
5. Littman, M. L., Cassandra, A. R., & Kaelbling, L. P. (1995). Learning policies for partially obsevable environments:scaling up. ICML (pp. 362-370).
6. Lovejoy, W. S. (1991). Computationally feasible bounds for partially observed Markov decision processes. Operations Research, 39, 162-175.
7. Pineau, J., Gordon, G., & Thrun, S. (2003). Point-based value iteration: An anytime algorithm for POMDPs. IJCAI (pp. 1025-1032).
8. Poon, K.-M. (2001). A fast heuristic algorithm for decision-theoretic planning. Master's thesis, The Hong Kong University of Science and Technology.
9. Poupart, P., & Boutilier, C. (2003). Bounded finite state controllers. NIPS.
10. Smallwood, R. D., & Sondik, E. J. (1973). The optimal control of partially observable Markov processes over a finite horizon. Operational Research, 21, 1071-1088.
11. Smith, T., & Simmons, R. (2004). Heuristic search value iteration for POMDPs. Proc. of UAI.
12. Smith, T., & Simmons, R. (2005). Point-based POMDP algorithms: Improved analysis and implementation. Proc. of UAI.
13. Sondik, E. J. (1971). The optimal control of partially observable Markov processes. Doctoral dissertation, Stanford University.
14. Spaan, M., & Vlassis, N. (2004). A point-based POMDP algorithm for robot planning. Proc. IEEE Int. Conf. on Robotics and Automation (ICRA) (pp. 2399-2404).