Planning with macro-actions in decentralized POMDPs

13th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2014

Volumn 2, Issue , 2014, Pages 1273-1280

  Amato, Christopher ^a   Konidaris, George D ^a   Kaelbling, Leslie P ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84911422338     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (34)

1. C. Amato, G. Chowdhary, A. Geramifard, N. K. Ure, and M. J. Kochenderfer. Decentralized control of partially observable Markov decision processes. In Proceedings of the Fifty-Second IEEE Conference on Decision and Control, 2013.
2. C. Amato, J. S. Dibangoye, and S. Zilberstein. Incremental policy generation for finite-horizon DEC-POMDPs. In Proceedings of the Nineteenth International Conference on Automated Planning and Scheduling, pages 2-9, 2009.
3. R. Aras, A. Dutech, and F. Charpillet. Mixed integer linear programming for exact finite-horizon planning in decentralized POMDPs. In Proceedings of the Seventeenth International Conference on Automated Planning and Scheduling, pages 18-25, 2007.
4. A. Barto and S. Mahadevan. Recent advances in hierarchical reinforcement learning. Discrete Event Dynamic Systems, 13:41-77, 2003.
5. R. Becker, V. Lesser, and S. Zilberstein. Decentralized Markov Decision Processes with Event-Driven Interactions. In Proceedings of the Third International Conference on Autonomous Agents and Multiagent Systems, pages 302-309, 2004.
6. R. Becker, S. Zilberstein, V. Lesser, and C. V. Goldman. Solving transition-independent decentralized Markov decision processes. Journal of Artificial Intelligence Research, 22:423-455, 2004.
7. D. S. Bernstein, R. Givan, N. Immerman, and S. Zilberstein. The complexity of decentralized control of Markov decision processes. Mathematics of Operations Research, 27(4):819-840, 2002.
8. D. S. Bernstein, S. Zilberstein, and N. Immerman. The complexity of decentralized control of Markov decision processes. In Proceedings of the Sixteenth Conference on Uncertainty in Artificial Intelligence, pages 32-37, 2000.
9. A. Boularias and B. Chaibdraa. Exact dynamic programming for decentralized POMDPs with lossless policy compression. In Proceedings of the Eighteenth International Conference on Automated Planning and Scheduling, 2008.
10. J. S. Dibangoye, C. Amato, O. Buffet, and F. Charpillet. Optimally solving Dec-POMDPs as continuous-state MDPs. In Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, 2013.
11. J. S. Dibangoye, C. Amato, A. Doniec, and F. Charpillet. Producing efficient error-bounded solutions for transition independent decentralized MDPs. In Proceedings of the Twelfth International Conference on Autonomous Agents and Multiagent Systems, 2013.
12. T. Dietterich. Hierarchical reinforcement learning with the MAXQ value function decomposition. Journal of Artificial Intelligence Research, 13:227-303, 2000.
13. M. Ghavamzadeh, S. Mahadevan, and R. Makar. Hierarchical multi-agent reinforcement learning. Journal of Autonomous Agents and Multi-Agent Systems, 13(2):197-229, 2006.
14. E. A. Hansen, D. S. Bernstein, and S. Zilberstein. Dynamic programming for partially observable stochastic games. In Proceedings of the Nineteenth National Conference on Artificial Intelligence, pages 709-715, 2004.
15. B. Horling and V. Lesser. A survey of multi-agent organizational paradigms. The Knowledge Engineering Review, 19(4):281-316, 2004.
16. G. Konidaris and A. G. Barto. Building portable options: Skill transfer in reinforcement learning. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence, pages 895-900, 2007.
17. G. Konidaris, L. P. Kaelbling, and T. Lozano-Perez. Symbol acquisition for task-level planning. In the AAAI 2013 Workshop on Learning Rich Representations from Low-Level Sensors, 2013.
18. A. Kumar and S. Zilberstein. Point-based backup for decentralized POMDPs: complexity and new algorithms. In Proceedings of the Ninth International Conference on Autonomous Agents and Multiagent Systems, pages 1315-1322, 2010.
19. A. McGovern and A. Barto. Automatic discovery of subgoals in reinforcement learning using diverse density. In Proceedings of the Eighteenth International Conference on Machine Learning, pages 361-368, 2001.
20. F. Melo and M. Veloso. Decentralized MDPs with sparse interactions. Artificial Intelligence, 2011.
21. J. V. Messias, M. T. Spaan, and P. U. Lima. GSMDPs for multi-robot sequential decision-making. In Proceedings of the Twenty-Seventh AAAI Conference on Artificial Intelligence, 2013.
22. R. Nair, P. Varakantham, M. Tambe, and M. Yokoo. Networked distributed POMDPs: a synthesis of distributed constraint optimization and POMDPs. In Proceedings of the Twentieth National Conference on Artificial Intelligence, 2005.
23. F. A. Oliehoek, M. T. J. Spaan, C. Amato, and S. Whiteson. Incremental clustering and expansion for faster optimal planning in Dec-POMDPs. Journal of Artificial Intelligence Research, 46:449-509, 2013.
24. F. A. Oliehoek, S. Whiteson, and M. T. J. Spaan. Approximate solutions for factored Dec-POMDPs with many agents. In Proceedings of the Twelfth International Conference on Autonomous Agents and Multiagent Systems, 2013.
25. S. Seuken and S. Zilberstein. Memory-bounded dynamic programming for DEC-POMDPs. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence, pages 2009-2015, 2007.
26. D. Silver and K. Ciosek. Compositional planning using optimal option models. In Proceedings of the Twenty-Ninth International Conference on Machine Learning, 2012.
27. M. T. J. Spaan and F. S. Melo. Interaction-driven Markov games for decentralized multiagent planning under uncertainty. In Proceedings of the Seventh International Conference on Autonomous Agents and Multiagent Systems, pages 525-532, 2008.
28. M. Stilman and J. Kuffner. Navigation among movable obstacles: Real-time reasoning in complex environments. International Journal on Humanoid Robotics, 2(4):479-504, 2005.
29. P. Stone, R. Sutton, and G. Kuhlmann. Reinforcement learning for robocup soccer keepaway. Adaptive Behavior, 13(3):165-188, 2005.
30. R. S. Sutton, D. Precup, and S. Singh. Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence, 112(1):181-211, 1999.
31. P. Velagapudi, P. R. Varakantham, K. Sycara, and P. Scerri. Distributed model shaping for scaling to decentralized POMDPs with hundreds of agents. In Proceedings of the Tenth International Conference on Autonomous Agents and Multiagent Systems, 2011.
32. F. Wu, S. Zilberstein, and X. Chen. Point-based policy generation for decentralized POMDPs. In Proceedings of the Ninth International Conference on Autonomous Agents and Multiagent Systems, pages 1307-1314, 2010.
33. F. Wu, S. Zilberstein, and X. Chen. Point-based policy generation for decentralized POMDPs. In Proceedings of the Ninth International Conference on Autonomous Agents and Multiagent Systems, pages 1307-1314, 2010.
34. F. Wu, S. Zilberstein, and X. Chen. Rollout sampling policy iteration for decentralized POMDPs. In Proceedings of the Twenty-Sixth Conference on Uncertainty in Artificial Intelligence, 2010.