Monte Carlo Value Iteration with macro-actions

Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011

Volumn , Issue , 2011, Pages

  Lim, Zhan Wei ^a   Hsu, David ^a   Lee, Wee Sun ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE;

COMPUTATIONAL CHALLENGES; CONDITION; CONTINUOUS STATE SPACE; DISCRETE STATE SPACE; PERFORMANCE; PLANNING HORIZONS; SPACE STATE; STATE-SPACE; TEMPORAL ABSTRACTION; VALUE ITERATION;

MONTE CARLO METHODS;

EID: 85162333012     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. H. Bai, D. Hsu, M.J. Kochenderfer, and W. S. Lee. Unmanned aircraft collision avoidance using continuous-state POMDPs. In Proc. Robotics: Science & Systems, 2011.
2. H. Bai, D. Hsu, W. S. Lee, and V. Ngo. Monte Carlo Value Iteration for Continuous-State POMDPs. In Algorithmic Foundations of Robotics IX-Proc. Int.Workshop o n the Algorithmic Foundations of Robotics (WAFR), pages 175-191. Springer, 2011.
3. Andrew G. Barto and Sridhar Mahadevan. Recent advances in hierarchical reinforcement learning. Discrete Event Dynamic Systems, 13:2003, 2003.
4. T. G. Dietterich. Hierarchical reinforcement learning with the MAXQ value function decomposition. J. Artificial Intelligence Research, 13:227-303, 2000.
5. E. Hansen and R. Zhou. Synthesis of hierarchical finite-state controllers for POMDPs. In Proc. Int. Conf. on Automated Planning and Scheduling, 2003.
6. M. Hauskrecht, N. Meuleau, L.P. Kaelbling, T. Dean, and C. Boutilier. Hierarchical solution of Markov decision processes using macro-actions. In Proc. Conf. on Uncertainty in Artificial Intelligence, pages 220-229. Citeseer, 1998.
7. R. He, E. Brunskill, and N. Roy. PUMA: Planning under uncertainty with macro-actions. In Proc. AAAI Conf. on Artificial Intelligence, 2010.
8. H. Kurniawati, Y. Du, D. Hsu, and W. S. Lee. Motion planning under uncertainty for robotic tasks with long time horizons. Int. J. Robotics Research, 30(3):308-323, 2010.
9. H. Kurniawati, D. Hsu, and W.S. Lee. SARSOP: Efficient point-based POMDP planning by approximating optimally reachable belief spaces. In Proc. Robotics: Science & Systems, 2008.
10. J. Pineau, G. Gordon, and S. Thrun. Point-based value iteration: An anytime algorithm for POMDPs. In Int. Jnt. Conf. on Artificial Intelligence, volume 18, pages 1025-1032, 2003.
11. J. Pineau, N. Roy, and S. Thrun. A hierarchical approach to POMDP planning and execution. In Workshop on Hierarchy & Memory in Reinforcement Learning (ICML), volume 156, 2001.
12. S. Ross, J. Pineau, S. Paquet, and B. Chaib-Draa.Online planning algorithms for POMDPs. Journal of Artificial Intelligence Research, 32(1):663-704, 2008.
13. A. Sivakumar and C.K.Y. Tan. UAV swarm coordination using cooperative control for establishing a wireless communications backbone. In Proc. Int. Conf. on Autonomous Agents & Multiagent Systems, pages 1157-1164, 2010.
14. T. Smith and R. Simmons. Heuristic search value iteration for POMDPs. In Proc. Conf. on Uncertainty in Artificial Intelligence, pages 520-527. AUAI Press, 2004.
15. R.S. Sutton, D. Precup, and S. Singh. Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence, 112(1):181-211, 1999.
16. G. Theocharous and L. P. Kaelbling. Approximate planning in POMDPs with macro-actions. Advances in Neural Processing Information Systems, 17, 2003.
17. M. Toussaint, L. Charlin, and P. Poupart. Hierarchical POMDP controller optimization by likelihood maximization. Proc. Conf. on Uncertainty in Artificial Intelligence, 2008.
18. C.C. White. Procedures for the solution of a finite-horizon, partially observed, semi-Markov optimization problem.Operations Research, 24(2):348-358, 1976.