Heuristic search of multiagent influence space

11th International Conference on Autonomous Agents and Multiagent Systems 2012, AAMAS 2012: Innovative Applications Track

Volumn 1, Issue , 2012, Pages 200-207

  Witwicki, Stefan J ^a   Oliehoek, Frans A ^b   Kaelbling, Leslie P ^b  

^a INSTITUTO SUPERIOR TÉCNICO   (Portugal)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Heuristic Search; Influence Based Abstraction; Multiagent Planning Under Uncertainty; TD POMDP

Indexed keywords

ABSTRACTING; AUTONOMOUS AGENTS; HEURISTIC ALGORITHMS; MATHEMATICAL TECHNIQUES; MODULAR ROBOTS;

COMPUTATIONAL SAVINGS; HEURISTIC SEARCH; INFLUENCE EVALUATION; INFLUENCE-BASED ABSTRACTION; MATHEMATICAL FOUNDATIONS; MULTI-AGENT PLANNING; SEARCH SPACES; TD-POMDP;

MULTI AGENT SYSTEMS;

EID: 84899434526     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. R. Becker, S. Zilberstein, and V. Lesser. Decentralized Markov decision processes with event-driven interactions. In AAMAS, pages 302-309, 2004.
2. R. Becker, S. Zilberstein, V. Lesser, and C. V. Goldman. Solving transition independent decentralized Markov decision processes. JAIR, 22:423-455, 2004.
3. D. S. Bernstein, R. Givan, N. Immerman, and S. Zilberstein. The complexity of decentralized control of Markov decision processes. Math. of OR, 27(4):819-840, 2002.
4. C. Boutilier, T. Dean, and S. Hanks. Decision-theoretic planning: Structural assumptions and computational leverage. JAIR, 11:1-94, 1999.
5. R. Emery-Montemerlo, G. Gordon, J. Schneider, and S. Thrun. Approximate solutions for partially observable stochastic games with common payoffs. In AAMAS, pages 136-143, 2004.
6. M. Hauskrecht. Value-function approximations for partially observable Markov decision processes. JAIR, 13:33-94, 2000.
7. L. P. Kaelbling, M. L. Littman, and A. R. Cassandra. Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101(1-2):99-134, 1998.
8. A. Kumar, S. Zilberstein, and M. Toussaint. Scalable multiagent planning using probabilistic inference. In IJCAI, pages 2140-2146, 2011.
9. H. Mostafa and V. Lesser. Compact mathematical programs for DEC-MDPs with structured agent interactions. In UAI, pages 523-530, 2011.
10. R. Nair, M. Tambe, M. Yokoo, D. V. Pynadath, and S. Marsella. Taming decentralized POMDPs: Towards efficient policy computation for multiagent settings. In IJCAI, 2003.
11. R. Nair, P. Varakantham, M. Tambe, and M. Yokoo. Networked distributed POMDPs: A synthesis of distributed constraint optimization and POMDPs. In AAAI, pages 133-139, 2005.
12. F. A. Oliehoek. Value-Based Planning for Teams of Agents in Stochastic Partially Observable Environments. PhD thesis, University of Amsterdam, 2010.
13. F. A. Oliehoek, J. F. Kooi, and N. Vlassis. The cross-entropy method for policy search in decentralized POMDPs. Informatica, 32:341-357, 2008.
14. F. A. Oliehoek, M. T. J. Spaan, and N. Vlassis. Optimal and approximate Q-value functions for decentralized POMDPs. JAIR, 32:289-353, 2008.
15. F. A. Oliehoek, M. T. J. Spaan, S. Whiteson, and N. Vlassis. Exploiting locality of interaction in factored Dec-POMDPs. In AAMAS, pages 517-524, 2008.
16. J. Pajarinen and J. Peltonen. Efficient planning for factored infinite-horizon DEC-POMDPs. In IJCAI, pages 325-331, 2011.
17. S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Pearson Education, 2nd edition, 2003.
18. S. Seuken and S. Zilberstein. Memory-bounded dynamic programming for DEC-POMDPs. In IJCAI, 2007.
19. M. T. J. Spaan, F. A. Oliehoek, and C. Amato. Scaling up optimal heuristic search in Dec-POMDPs via incremental expansion. In IJCAI, pages 2027-2032, 2011.
20. *: A heuristic search algorithm for solving decentralized POMDPs. In UAI, pages 576-583, 2005.
21. P. Varakantham, J. Marecki, Y. Yabu, M. Tambe, and M. Yokoo. Letting loose a SPIDER on a network of POMDPs: Generating quality guaranteed policies. In AAMAS, 2007.
22. P. Varakantham, J. young Kwak, M. Taylor, J. Marecki, P. Scerri, and M. Tambe. Exploiting coordination locales in distributed POMDPs via social model shaping. In ICAPS, 2009.
23. P. Velagapudi, P. Varakantham, P. Scerri, and K. Sycara. Distributed model shaping for scaling to decentralized POMDPs with hundreds of agents. In AAMAS, 2011.
24. S. J. Witwicki. Abstracting Influences for Efficient Multiagent Coordination Under Uncertainty. PhD thesis, University of Michigan, 2011.
25. S. J. Witwicki and E. H. Durfee. Influence-based policy abstraction for weakly-coupled Dec-POMDPs. In ICAPS, 2010.