Real-time hierarchical POMDPs for autonomous robot navigation

Robotics and Autonomous Systems

Volumn 55, Issue 7, 2007, Pages 561-571

  Foka, Amalia ^a,b   Trahanias, Panos ^a,b  

^a INSTITUTE OF COMPUTER SCIENCE   (Greece)

^b UNIVERSITY OF CRETE   (Greece)

Author keywords

Hierarchical POMDP; Partially observable Markov decision processes (POMDP); Robot navigation

Indexed keywords

AUTONOMOUS AGENTS; COLLISION AVOIDANCE; DECISION THEORY; MARKOV PROCESSES; MATHEMATICAL MODELS; ROBOTICS;

HIERARCHICAL POMDP; PARTIALLY OBSERVABLE MARKOV DECISION PROCESSES (POMDP); ROBOT NAVIGATION;

REAL TIME SYSTEMS;

EID: 34248656990     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2007.01.004     Document Type: Article

References (26)

1. A.R. Cassandra, L.P. Kaelbling, J.A. Kurien, Acting under uncertainty: Discrete bayesian models for mobile-robot navigation, in: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, 1996
2. A. Foka, P. Trahanias, Predictive autonomous robot navigation, in: Proceedings IEEE/RSJ International Conference Intelligent Robots and Systems, IROS, 2002
3. A. Foka, P. Trahanias, Predictive control of robot velocity to avoid obstacles in dynamic environments, in: Proceedings IEEE/RSJ International Conference Intelligent Robots and Systems, IROS, 2003
4. G. Gordon, J. Pineau, S. Thrun, Point-based value iteration: An anytime algorithm for pomdps, in: Proceedings of the International Joint Conference on Artificial Intelligence, IJCAI, 2003
5. Hauskrecht M. Value function approximations for partially observable Markov decision processes. Journal of Artificial Intelligence Research 13 (2000) 33-95
6. Kaebling L.P., Littman M.L., and Cassandra A.R. Planning and acting in partially observable stochastic domains. Artificial Intelligence 101 1-2 (1998) 99-134
7. Kassim A.A., and Vijaya Kumar B.V.K. Path planners based on the wave expansion neural network. Robotics and Autonomous Systems 26 1 (1999) 1-22
8. Khatib O., Quinlan S., and Williams D. Robot planning and control. Robotics and Autonomous Systems 21 3 (1997) 249-261
9. S. Koenig, R.G. Simmons, Unsupervised learning of probabilistic models for robot navigation, in: Proceedings of the International Conference on Robotics and Automation, 1996, pp. 2301-2308
10. Latombe J.-C. Robot Motion Planning (1991), Kluwer Academic Publishers
11. M. Littman, A. Cassandra, L. Kaebling, Learning policies for partially observable environments: Scaling up, in: Proceeding of the 12th International Conference on Machine Learning, 1995, pp. 362-370
12. Littman M.L., Goldsmith J., and Mundhenk M. The computational complexity of probabilistic planning. Journal of Artificial Intelligence Research 9 (1998) 1-36
13. Lu F., and Milios E. Robot pose estimation in unknown environments by matching 2d range scans. Journal of Intelligent and Robotic Systems 18 (1998) 249-275
14. Monahan G.E. A survey of partially observable markov decision processes: Theory, models, and algorithms. Management Science 28 (1982) 1-16
15. Nehmzow U., and Owen C. Robot navigation in the real world: Experiments with Manchester's FortyTwo in unmodified, large environments. Robotics and Autonomous Systems 33 4 (2000) 223-242
16. J. Pineau, S. Thrun, An integrated approach to hierarchy and abstraction for POMDPs, Technical Report (CMU-RI-TR-02-21), Carnegie Mellon University, 2002
17. Pineau J., Gordon G., and Thrun S. Applying metric-trees to belief-point POMDPs. Neural Information Processing Systems (NIPS) (2003)
18. Pineau J., Montemerlo M., Pollack M., Roy N., and Thrun S. Towards robotic assistants in nursing homes: Challenges and results. Robotics and Autonomous Systems 42 3-4 (2003) 271-281
19. Poupart P., and Boutilier C. Value-directed compression of POMDPs. Neural Information Systems (NIPS) (2003)
20. K.-M. Poon, A fast heuristic algorithm for decision-theoretic planning, Master's Thesis, The Hong-Kong University of Science and Technology, 2001
21. N. Roy, J. Pineau, S. Thrun, A hierarchical approach to pomdp planning and execution, in: Workshop on Hierarchy and Memory in Reinforcement Learning, ICML, 2001
22. Roy N., and Gordon G. Exponential family PCA for belief compression in POMDPs. Neural Information Systems (NIPS) (2003)
23. R. Simmons, S. Koenig, Probabilistic robot navigation in partially observable environments, in: Proceedings of the International Joint Conference on Artificial Intelligence, 1995, pp. 1080-1087
24. M.T.J. Spaan, N. Vlassis, A point-based POMDP algorithm for robot planning, in: Proceedings of 2004 IEEE International Conference on Robotics and Automation, ICRA, 2004
25. G. Theocharous, Hierarchical learning and planning in partially observable Markov decision processes, Ph.D. Thesis, Michigan State University, 2002
26. Thrun S., Beetz M., Bennewitz M., Burgard W., Cremers A.B., Dellaert F., Fox D., Hahnel D., Rosenberg C., Roy N., Schulte J., and Schulz D. Probabilistic algorithms and the interactive musuem tour-guide robot minerva. International Journal of Robotics Research 19 11 (2000) 972-999