Influence-based abstraction for multiagent systems

Proceedings of the National Conference on Artificial Intelligence

Volumn 2, Issue , 2012, Pages 1422-1428

  Oliehoek, Frans A ^a   Witwicki, Stefan J ^b   Kaelbling, Leslie P ^c  

^a MAASTRICHT UNIVERSITY   (Netherlands)

^b INSTITUTO SUPERIOR TÉCNICO   (Portugal)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AGENT INTERACTION; EMPIRICAL COMPARISON; LOCAL MODEL; ONLINE LEARNING; SPECIFIC PROBLEMS; THEORETICAL RESULT;

MULTI AGENT SYSTEMS;

ABSTRACTING;

EID: 84868296549     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. Becker, R.; Zilberstein, S.; Lesser, V.; and Goldman, C. V. 2003. Transition-independent decentralized Markov decision processes. In AAMAS, 41-48.
2. Becker, R.; Zilberstein, S.; and Lesser, V. 2004. Decentralized Markov decision processes with event-driven interactions. In AAMAS, 302-309.
3. Bernstein, D. S.; Givan, R.; Immerman, N.; and Zilberstein, S. 2002. The complexity of decentralized control of Markov decision processes. Mathematics of Operations Research 27(4):819-840.
4. Boutilier, C.; Dean, T.; and Hanks, S. 1999. Decision-theoretic planning: Structural assumptions and computational leverage. JAIR 11:1-94.
5. Doshi, P.; Zeng, Y.; and Chen, Q. 2008. Graphical models for interactive POMDPs: representations and solutions. Journal of Autonomous Agents and Multi-Agent Systems 18(3):376-416.
6. Gmytrasiewicz, P. J., and Doshi, P. 2005. A framework for sequential planning in multi-agent settings. JAIR 24:49-79.
7. Guestrin, C., and Gordon, G. 2002. Distributed planning in hierarchical factored MDPs. In UAI, 197-206.
8. Guestrin, C.; Koller, D.; and Parr, R. 2002. Multiagent planning with factored MDPs. In Advances in Neural Information Processing Systems 14, 1523-1530.
9. Hansen, E. A.; Bernstein, D. S.; and Zilberstein, S. 2004. Dynamic programming for partially observable stochastic games. In AAAI, 709-715.
10. Kaelbling, L. P.; Littman, M. L.; and Cassandra, A. R. 1998. Planning and acting in partially observable stochastic domains. Artificial Intelligence 101(1-2):99-134.
11. Koller, D., and Friedman, N. 2009. Probabilistic Graphical Models: Principles and Techniques. MIT Press.
12. Kumar, A.; Zilberstein, S.; and Toussaint, M. 2011. Scalable multi-agent planning using probabilistic inference. In IJCAI, 2140-2146.
13. Melo, F. S., and Veloso, M. 2011. Decentralized MDPs with sparse interactions. Artificial Intelligence 175(11):1757-1789.
14. Monderer, D., and Shapley, L. S. 1996. Potential games. Games and Economic Behavior 14(1):124-143.
15. Mostafa, H., and Lesser, V. 2009. Offline planning for communication by exploiting structured interactions in decentralized MDPs. In Proc. of Int. Conf. on Web Intelligence and Intelligent Agent Technology, 193-200.
16. Nair, R.; Tambe, M.; Yokoo, M.; Pynadath, D. V.; and Marsella, S. 2003. Taming decentralized POMDPs: Towards efficient policy computation for multiagent settings. In IJCAI, 705-711.
17. Nair, R.; Varakantham, P.; Tambe, M.; and Yokoo, M. 2005. Networked distributed POMDPs: A synthesis of distributed constraint optimization and POMDPs. In AAAI, 133-139.
18. Oliehoek, F. A.; Spaan, M. T. J.; Whiteson, S.; and Vlassis, N. 2008. Exploiting locality of interaction in factored Dec-POMDPs. In AAMAS, 517-524.
19. Oliehoek, F. A. 2010. Value-Based Planning for Teams of Agents in Stochastic Partially Observable Environments. Ph.D. Dissertation, University of Amsterdam.
20. Petrik, M., and Zilberstein, S. 2009. A bilinear programming approach for multiagent planning. JAIR 35(1):235-274.
21. Pynadath, D. V., and Marsella, S. 2007. Minimal mental models. In AAAI, 1038-1044.
22. Rathnasabapathy, B.; Doshi, P.; and Gmytrasiewicz, P. 2006. Exact solutions of interactive POMDPs using behavioral equivalence. In AAMAS, 1025-1032.
23. Rosenthal, R. W. 1973. A class of games possessing pure-strategy Nash equilibria. International Journal of Game Theory 2(1):65-67.
24. Spaan, M. T. J., and Melo, F. S. 2008. Interaction-driven Markov games for decentralized multiagent planning under uncertainty. In AAMAS, 525-532.
25. Toussaint, M. 2009. Probabilistic inference as a model of planned behavior. Kunstliche Intelligenz 3(9):23-29.
26. Varakantham, P.; Marecki, J.; Yabu, Y.; Tambe, M.; and Yokoo, M. 2007. Letting loose a SPIDER on a network of POMDPs: Generating quality guaranteed policies. In AAMAS.
27. Varakantham, P.; young Kwak, J.; Taylor, M.; Marecki, J.; Scerri, P.; and Tambe, M. 2009. Exploiting coordination locales in distributed POMDPs via social model shaping. In ICAPS, 313-320.
28. Wiering, M. 2000. Multi-agent reinforcement learning for traffic light control. In Proc. of the International Conference on Machine Learning, 1151-1158.
29. Witwicki, S., and Durfee, E. 2010. Influence-based policy abstraction for weakly-coupled Dec-POMDPs. In ICAPS, 185-192.
30. Witwicki, S., and Durfee, E. 2011. Towards a unifying characterization for quantifying weak coupling in Dec-POMDPs. In AAMAS, 29-36.
31. Witwicki, S.; Oliehoek, F. A.; and Kaelbling, L. P. 2012. Heuristic search of multiagent influence space. In AAMAS. (To appear).
32. Witwicki, S. J. 2011. Abstracting Influences for Efficient Multiagent Coordination Under Uncertainty. Ph.D. Dissertation, University of Michigan.
33. Zeng, Y.; Doshi, P.; Pan, Y.; Mao, H.; Chandrasekaran, M.; and Luo, J. 2011. Utilizing partial policies for identifying equivalence of behavioral models. In AAAI, 1083-1088.