Producing efficient error-bounded solutions for transition independent decentralized MDPs

12th International Conference on Autonomous Agents and Multiagent Systems 2013, AAMAS 2013

Volumn 1, Issue , 2013, Pages 539-546

  Dibangoye, Jilles S ^a   Amato, Christopher ^b   Doniec, Arnaud ^c   Charpillet, François ^a  

^a INRIA   (France)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c Univ Lille Nord de France   (France)

Author keywords

Cooperative multiagent systems; Decentralized POMDPs; Planning under uncertainty

Indexed keywords

AUTONOMOUS AGENTS; HEURISTIC ALGORITHMS; LEARNING ALGORITHMS; MARKOV PROCESSES;

COOPERATIVE MULTIAGENT SYSTEMS; DECENTRALIZED MARKOV DECISION PROCESSES; DECENTRALIZED POMDPS; MARKOV DECISION PROCESSES; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; PLANNING UNDER UNCERTAINTY; SEQUENTIAL DECISION MAKING; STATE-OF-THE-ART ALGORITHMS;

MULTI AGENT SYSTEMS;

EID: 84899461871     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. C. Amato, D. S. Bernstein, and S. Zilberstein. Optimizing fixed-size stochastic controllers for POMDPs and decentralized POMDPs. Autonomous Agents and Multi-Agent Systems, 21(3): 293-320, 2010.
2. C. Amato, B. Bonet, and S. Zilberstein. Finite-state controllers based on mealy machines for centralized and decentralized POMDPs. In AAAI, 2010.
3. C. Amato, J. S. Dibangoye, and S. Zilberstein. Incremental policy generation for finite-horizon DEC-POMDPs. In ICAPS, pages 2-9, Thessaloniki, Greece, 2009.
4. R. Aras and A. Dutech. An investigation into mathematical programming for finite horizon decentralized POMDPs. J AIR, 37: 329-396, 2010.
5. R. Becker, S. Zilberstein, V. R. Lesser, and C. V. Goldman. Solving transition independent decentralized Markov decision processes. JAIR, 22: 423-455, 2004.
6. D. S. Bernstein, C. Amato, E. A. Hansen, and S. Zilberstein. Policy iteration for decentralized control of Markov decision processes. JAIR, 34: 89-132, 2009.
7. D. S. Bernstein, R. Givan, N. Immerman, and S. Zilberstein. The complexity of decentralized control of Markov decision processes. Math. Oper. Res., 27(4): 819-840, 2002.
8. A. Boularias and B. Chaibdraa. Exact dynamic programming for decentralized POMDPs with lossless policy compression. In ICAPS, pages 20-27, Sydney, Australia, 2008.
9. G. Corona and F. Charpillet. Distribution over beliefs for memory bounded Dec-POMDP planning. In UAI, pages 135-142, 2010.
10. J. S. Dibangoye, C. Amato, and A. Doniec. Scaling up decentralized MDPs through heuristic search. In UAI, 2012.
11. J. S. Dibangoye, A.-I. Mouaddib, and B. Chaidraa. Point-based incremental pruning heuristic for solving finite-horizon DEC-POMDPs. In AAMAS, pages 569-576, Budapest, Hungary, 2009.
12. J. S. Dibangoye, A.-I. Mouaddib, and B. Chaibdraa. Toward error-bounded algorithms for infinite-horizon DEC-POMDPs. In AAMAS, pages 947-954, 2011.
13. C. V. Goldman and S. Zilberstein. Decentralized control of cooperative systems: Categorization and complexity analysis. JAIR, 22: 143-174, 2004.
14. E. A. Hansen. Solving POMDPs by searching in policy space. In UAI, pages 211-219, 1998.
15. M. Hauskrecht. Value-function approximations for partially observable Markov decision processes. J. Artif. Intell. Res. (JAIR), 13: 33-94, 2000.
16. L. P. Kaelbling, M. L. Littman, and A. R. Cassandra. Planning and acting in partially observable stochastic domains. Artif. Intell., 101 (1-2): 99-134, May 1998.
17. A. Kumar, S. Zilberstein, and M. Toussaint. Scalable multiagent planning using probabilistic inference. In IJCAI, pages 2140-2146, 2011.
18. R. Nair, P. Varakantham, M. Tambe, and M. Yokoo. Networked distributed POMDPs: A synthesis of distributed constraint optimization and POMDPs. In AAAI, pages 133-139, 2005.
19. J. Pajarinen and J. Peltonen. Efficient planning for factored infinite-horizon DEC-POMDPs. In IJCAl, pages 325-331, 2011.
20. J. Pajarinen and J. Peltonen. Periodic finite state controllers for efficient POMDP and DEC-POMDP planning. In NIPS, pages 2636-2644, 2011.
21. M. Petrik and S. Zilberstein. A bilinear programming approach for multiagent planning. JAIR, 35: 235-274, 2009.
22. S. Seuken and S. Zilberstein. Formal models and algorithms for decentralized decision making under uncertainty. Autonomous Agents and Multi-Agent Systems, 17(2): 190-250, 2008.
23. R. D. Smallwood and E. J. Sondik. The optimal control of partially observable Markov decision processes over a finite horizon. Operations Research, 21(5): 1071-1088, 1973.
24. T. Smith and R. G. Simmons. Point-based POMDP algorithms: Improved analysis and implementation. In UAI, pages 542-547, 2005.
25. M. T. J. Spaan, F. A. Oliehoek, and C. Amato. Scaling up optimal heuristic search in Dec-POMDPs via incremental expansion. In IJCAl, pages 2027-2032, 2011.
26. *: A heuristic search algorithm for solving decentralized pomdps. In UAI, pages 576-590, 2005.
27. P. Velagapudi, P. Varakantham, K. Sycara, and P. Scerri. Distributed model shaping for scaling to decentralized POMDPs with hundreds of agents. In AAMAS, pages 955-962, 2011.
28. S. J. Witwicki and E. H. Durfee. Towards a unifying characterization for quantifying weak coupling in Dec-POMDPs. In AAMAS, pages 29-36, 2011.
29. F. Wu, S. Zilberstein, and X. Chen. Point-based policy generation for decentralized POMDPs. In AAMAS, pages 1307-1314. 2010.
30. F. Wu, S. Zilberstein, and X. Chen. Trial-based dynamic programming for multi-agent planning. In AAAI, 2010.