Efficient approximate value iteration for continuous Gaussian POMDPs

Proceedings of the National Conference on Artificial Intelligence

Volumn 3, Issue , 2012, Pages 1832-1838

  Van Den Berg, Jur ^a   Patil, Sachin ^b   Alterovitz, Ron ^b  

^a University of Utah   (United States)

^b CB 3175 Sitterson Hall   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BELIEF SPACE; CONTINUOUS SPACES; FAST SOLUTIONS; GAUSSIANS; INCOMPLETE OBSERVATION; LINEAR CONTROLS; MARKOV DECISION PROCESSES; NOMINAL TRAJECTORY; ROBOT NAVIGATION; SEQUENTIAL DECISION MAKING; STATE SPACE; TIME POLYNOMIALS; VALUE FUNCTIONS; VALUE ITERATION;

EXTENDED KALMAN FILTERS; GAUSSIAN DISTRIBUTION; ITERATIVE METHODS; LINEAR CONTROL SYSTEMS; MARKOV PROCESSES;

ARTIFICIAL INTELLIGENCE;

EID: 84868275731     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. Bai, H.; Hsu, D.; Lee, W.; and Ngo, V. 2011. Monte Carlo Value Iteration for Continuous-State POMDPs. Algorithmic Foundations of Robotics IX 175-191.
2. Brooks, A.; Makarenko, A.; Williams, S.; and Durrant-Whyte, H. 2006. Parametric POMDPs for Planning in Continuous State Spaces. Robotics and Autonomous Systems 54(11):887-897.
3. Bry, A., and Roy, N. 2011. Rapidly-exploring Random Belief Trees for Motion Planning Under Uncertainty. In Proc. IEEE Int. Conf. Robotics and Automation (ICRA), 723-730.
4. C. Papadimitriou, J. T. 1987. The Complexity of Markov Decision Processes. Mathematics of Operations Research 12(3):441-450.
5. Erez, T., and Smart, W. D. 2010. A Scalable Method for Solving High-Dimensional Continuous POMDPs Using Local Approximation. In Conf. on Uncertainty in Artificial Intelligence, 160-167.
6. Hauser, K. 2011. Randomized Belief-Space Replanning in Partially-Observable Continuous Spaces. Algorithmic Foundations of Robotics IX 193-209.
7. Jacobson, D., and Mayne, D. 1970. Differential Dynamic Programming. American Elsevier Publishing Company, Inc.
8. Kaelbling, L. P.; Littman, M. L.; and Cassandra, A. R. 1998. Planning and Acting in Partially Observable Stochastic Domains. Artificial Intelligence 101(1-2):99-134.
9. Kurniawati, H.; Du, Y.; Hsu, D.; and Lee, W. 2011. Motion Planning under Uncertainty for Robotic Tasks with Long Time Horizons. Int. Journal of Robotics Research 30(3):308-323.
10. Kurniawati, H.; Hsu, D.; and Lee, W. S. 2008. SARSOP: Efficient Point-based POMDP Planning by Approximating Optimally Reachable Belief Spaces. In Robotics: Science and Systems (RSS).
11. LaValle, S., and Kuffner, J. 2001. Randomized Kinodynamic Planning. Int. Journal of Robotics Research 20(5):378-400.
12. Liao, L. Z., and Shoemaker, C. A. 1991. Convergence in Unconstrained Discrete-Time Differential Dynamic Programming. IEEE Trans. on Automatic Control 36(6):692-706.
13. Miller, S. A.; Harris, Z. A.; and Chong, E. K. P. 2009. Coordinated Guidance of Autonomous UAVs via Nominal Belief-State Optimization. In American Control Conference (ACC), 2811-2818.
14. Pineau, J.; Gordon, G.; and Thrun, S. 2003. Point-based Value Iteration: An Anytime Algorithm for POMDPs. In Int. Joint Conf. on Artificial Intelligence, 1025-1032.
15. Platt, R.; Tedrake, R.; Kaelbling, L.; and Lozano-Perez, T. 2010. Belief Space Planning assuming Maximum Likelihood Observations. In Robotics: Science and Systems (RSS).
16. Platt, R.; Kaelbling, L.; Lozano-Perez, T.; and Tedrake, R. 2011. Efficient Planning in Non-Gaussian Belief Spaces and its Application to Robot Grasping. In Int. Symp. on Robotics Research (ISRR).
17. Porta, J.; Vlassis, N.; Spaan, M.; and Poupart, P. 2006. Point-based Value Iteration for Continuous POMDPs. Journal of Machine Learning Research 7:2329-2367.
18. Prentice, S., and Roy, N. 2009. The Belief Roadmap: Efficient Planning in Belief Space by Factoring the Covariance. Int. Journal of Robotics Research 28(11-12):1448-1465.
19. Silver, D., and Veness, J. 2010. Monte-Carlo Planning in Large POMDPs. In Advances in Neural Information Processing Systems (NIPS). 2164-2172.
20. Smith, T., and Simmons, R. 2004. Heuristic Search Value Iteration for POMDPs. In Proc. Conf. on Uncertainty in Artificial Intelligence, 520-527.
21. Thrun, S.; Burgard, W.; and Fox, D. 2005. Probabilistic Robotics. MIT Press.
22. Thrun, S. 2000. Monte Carlo POMDPs. Advances in Neural Information Processing Systems 12:1064-1070.
23. Todorov, E., and Li, W. 2005. A Generalized Iterative LQG Method for Locally-Optimal Feedback Control of Constrained Nonlinear Stochastic Systems. In Proc. American Control Conference (ACC), 300-306.
24. van den Berg, J.; Abbeel, P.; and Goldberg, K. 2011. LQG-MP: Optimized Path Planning for Robots with Motion Uncertainty and Imperfect State Information. Int. Journal of Robotics Research 30(7):895-913.
25. van den Berg, J.; Patil, S.; and Alterovitz, R. 2011. Motion Planning under Uncertainty using Differential Dynamic Programming in Belief Space. In Int. Symp. on Robotics Research (ISRR).
26. Welch, G., and Bishop, G. 2006. An Introduction to the Kalman Filter. Technical Report TR 95-041, Univ. North Carolina at Chapel Hill.