A scalable method for solving high-dimensional continuous POMDPs using local approximation

Proceedings of the 26th Conference on Uncertainty in Artificial Intelligence, UAI 2010

Volumn , Issue , 2010, Pages 160-167

  Erez, Tom ^a   Smart, William D ^a  

^a WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; MARKOV PROCESSES; SCALABILITY;

APPROXIMATE SOLUTION; FIRST-ORDER FILTERS; HAND EYE COORDINATION; LOCAL APPROXIMATION; LOCAL OPTIMIZATION METHODS; LOCAL OPTIMIZATIONS; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; PLANNING ALGORITHMS;

EXTENDED KALMAN FILTERS;

EID: 79956353833     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. Abbeel, Pieter and Ng, Andrew Y. Exploration and apprenticeship learning in reinforcement learning. In International Conference on Machine Learning (ICML), pp. 1-8, 2005. (Pubitemid 43183309)
2. Boutilier, Craig. A POMDP formulation of preference elicitation problems. In Eighteenth national conference on Artificial intelligence, pp. 239-246, 2002.
3. Brooks, Alex. Parametric POMDPs. VDM Verlag, 2009.
4. Brunskill, Emma, Kaelbling, Leslie, Lozano-Perez, Tomas, and Roy, Nicholas. Continuous-state POMDPs with hybrid dynamics. In Tenth International Symposium on Artificial Intelligence and Mathematics (ISAIM), January 2008.
5. Cassin, Barbara and Rubin, Melvin L. Dictionary of Eye Terminology. Triad Publishing Company (FL), 2001.
6. Drumwright, E. A fast and stable penalty method for rigid body simulation. IEEE Transactions on Visualization and Computer Graphics, 14(1):231-240, 2008. (Pubitemid 350157893)
7. Erez, T. and Smart, W.D. Bipedal walking on rough terrain using manifold control. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1539-1544, 2007.
8. Erez, Tom and Smart,William D. What does shaping mean for computational reinforcement learning? 7th IEEE International Conference on Development and Learning (ICDL), pp. 215-219, 2008.
9. Erez, Tom and Smart,William D. Coupling perception and action using minimax optimal control. In IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), pp. 58-65, 2009.
10. Feng, Zhengzhu and Zilberstein, Shlomo. Region-based incremental pruning for POMDPs. In The 20th conference on Uncertainty in artificial intelligence (UAI), pp. 146-153, 2004.
11. Hoey, Jesse and Poupart, Pascal. Solving POMDPs with continuous or large discrete observation spaces. In International Joint Conference on Artificial Intelligence (IJCAI), pp. 1332-1338, 2005.
12. Hsiao, Kaijen, Kaelbling, Leslie Pack, and Lozano-Perez, Tomas. Grasping POMDPs. In IEEE International Conference on Robotics and Automation (ICRA), pp. 4685-4692, 2007. (Pubitemid 350140913)
13. Jacobson, D. H. and Mayne, D. Q. Differential Dynamic Programming. Elsevier, 1970.
14. Kaelbling, Leslie Pack, Littman, Michael L., and Cassandra, Anthony R. Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101 (1-2):99-134, 1998. (Pubitemid 128387390)
15. Miller, Scott A., Harris, Zachary A., and Chong, Edwin K. P. A POMDP framework for coordinated guidance of autonomous uavs for multitarget tracking. EURASIP Journal of Advanced Signal Process, 2009:1-17, 2009.
16. Platt, Robert, Tedrake, Russ, Kaelbling, Leslie Pack, and Lozano-Perez, Tomas. Belief space planning assuming maximum likelihood observations. In Robotics: Science and Systems (R:SS), 2010.
17. Porta, Josep M., Vlassis, Nikos, Spaan, Matthijs T.J., and Poupart, Pascal. Point-based value iteration for continuous POMDPs. Journal of Machine Learning Research, 7:2329-2367, December 2006. (Pubitemid 44708007)
18. Prentice, S. and Roy, N. The belief roadmap: Efficient planning in belief space by factoring the covariance. The International Journal of Robotics Research, 28(11-12): 1448-1465, 2009.
19. Roy, Nicholas and Thrun, Sebastian. Coastal navigation with mobile robots. In Advances in Neural Processing Systems (NIPS), volume 12, pp. 1043-1049, 1999.
20. Sondik, E.J. The Optimal Control of Partially Observable Markov Processes. PhD thesis, Stanford, 1971.
21. Spaan, Matthijs T. J. and Vlassis, Nikos A. Planning with continuous actions in partially observable environments. In IEEE International Conference on Robotics and Automation (ICRA), pp. 3458-3463, 2005. (Pubitemid 46084320)
22. Stengel, Robert F. Optimal Control and Estimation. Dover Publications, 1994.
23. Stewart, David E. Rigid-body dynamics with friction and impact. SIAM Reviews, 42(1):3-39, 2000.
24. Stolle, Martin and Atkeson, Chris. Policies based on trajectory libraries. In IEEE International Conference on Robotics and Automation (ICRA), 2006.
25. Tassa, Yuval, Erez, Tom, and Smart, William. Receding horizon differential dynamic programming. In Advances in Neural Information Processing Systems (NIPS), volume 20. MIT Press, Cambridge, MA, 2008.
26. Tedrake, Russ. LQR-trees: Feedback motion planning on sparse randomized trees. In Robotics: Science and Systems (R:SS), 2009.
27. Thrun, S. Monte carlo POMDPs. In Solla, S.A., Leen, T.K., and Müller, K.-R. (eds.), Advances in Neural Information Processing Systems (NIPS), volume 12, pp. 1064-1070. MIT Press, 2000.
28. Toussaint, Marc. Pros and cons of truncated gaussian ep in the context of approximate inference control. NIPS workshop on Probabilistic Approaches for Robotics and Control, 2009.