Graphical models for interactive POMDPs: Representations and solutions

Autonomous Agents and Multi-Agent Systems

Volumn 18, Issue 3, 2009, Pages 376-416

  Doshi, Prashant ^a   Zeng, Yifeng ^b   Chen, Qiongyu ^c  

^a University of Georgia ^*  (United States)

^b AALBORG UNIVERSITY   (Denmark)

^c NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Interactive POMDPs; Probabilistic graphical models; Sequential multiagent decision making

Indexed keywords

EID: 59849115174     PISSN: 13872532     EISSN: 15737454     Source Type: Journal    
DOI: 10.1007/s10458-008-9064-7     Document Type: Article

References (36)

1. B. Adam E. Dekel 1993 Hierarchies of beliefs and common knowledge International Journal of Game Theory 59 1 189 198
2. R.J. Aumann 1999 Interactive epistemology i: Knowledge International Journal of Game Theory, 28 3 263 300
3. Boutilier, C. (1999). Sequential optimality and coordination in multiagent systems. In Sixteenth International Joint Conference on Artificial Intelligence (IJCAI) (pp. 478-485). Stockhom, Sweeden.
4. Boutilier, C., & Poole, D. (1996). Computing optimal policies for partially observable decision processes using compact representations. In Thirteenth Conference on Artificial Intelligence (AAAI) (pp. 1168-1175). Portland, Oregon.
5. Camerer C. (2003) Behavioral game theory: Experiments in strategic interaction. Princeton University Press, Princeton New Jersey
6. J.M. Charnes P. Shenoy 2004 Multistage monte carlo methods for solving influence diagrams using local computation Management Science 50 3 405 418
7. Dennett D. (1986) Intentional systems. MIT Press, Brainstorms
8. Doshi, P., & Gmytrasiewicz, P. J. (2005). Approximating state estimation in multiagent settings using particle filters. In Autonomous Agents and Multi-agent Systems Conference (AAMAS) (pp. 320-327). Utrecht, Netherlands.
9. Doshi, P., & Gmytrasiewicz, P. J. (2005). A particle filtering based approach to approximating interactive pomdps. In Twentieth Conference on Artificial Intelligence (AAAI) (pp. 969-974). Pittsburg, PA.
10. E. Fehr S. Gachter 2000 Cooperation and punishment in public good experiments American Economic Review 90 4 980 994
11. Fudenberg D., Levine D.K. (1998) The theory of learning in games. The MIT Press, Cambridge MA
12. Fudenberg, D., & Tirole, J. (1991). Game theory. MIT Press.
13. Gal, Y., & Pfeffer, A. (2003). A language for modeling agent's decision-making processes in games. In Autonomous Agents and Multi-Agents Systems Conference (AAMAS) (pp. 265-272). Melbourne, Australia.
14. P. Gmytrasiewicz P. Doshi 2005 A framework for sequential planning in multiagent settings Journal of Artificial Intelligence Research (JAIR) 24 49 79
15. P.J. Gmytrasiewicz E.H. Durfee 2000 Rational coordination in multi-agent environments Journal of Autonomous Agents and Multi-Agent Systems 3 4 319 350
16. Guestrin, C., Koller, D., & Parr, R. (2001). Solving factored pomdps with linear value functions. In Workshop on Planning under Uncertainty and Incomplete Information, IJCAI. Seattle, Washington.
17. J.C. Harsanyi 1967 Games with incomplete information played by bayesian players Management Science 14 3 159 182
18. Howard, R. A., & Matheson, J. E. (1984). Influence diagrams. In Readings on the Principles and Applications of Decision Analysis (pp. 721-762).
19. L. Kaelbling M. Littman A. Cassandra 1998 Planning and acting in partially observable stochastic domains Artificial Intelligence Journal 101 1-2 99 134
20. Koller, D., & Milch, B. (2001). Multi-agent influence diagrams for representing and solving games. In International Joint Conference on Artificial Intelligence (IJCAI) (pp. 1027-1034). Seattle, Washington.
21. Littman, M. (1994). Markov games as a framework for multiagent reinforcement learning. In International Conference on Machine Learning (ICML) (pp. 157-163). New Brunswick, New Jersey.
22. MacQueen J. (1967) Some methods for classification and analysis of multivariate observations. In: LeCam L.M., Neyman J.(eds) Proceedings of the Fifth Berkeley Symposium on Mathematics, Statistics, and Probablity. UC Press, Berkeley, CA, pp 281-297
23. J.F. Mertens S. Zamir 1985 Formulation of bayesian analysis for games with incomplete information International Journal of Game Theory 14 1 29
24. Nair, R., Tambe, M., Yokoo, M., Pynadath, D., & Marsella, S. (2003). Taming decentralized pomdps: Towards efficient policy computation for multiagent settings. In International Joint Conference on Artificial Intelligence (IJCAI) (pp. 705-711). Acapulco, Mexico.
25. Nilsson, D., & Lauritzen, S. (2000). Evaluating influence diagrams using limids. In Uncertainty in Artificial Intelligence (UAI) (pp. 436-445). Stanford, California.
26. Pearl J. (1988). Probabilistic reasoning in intelligent systems: Networks of plausible inference. Morgan-Kaufmann: Los Altos, California.
27. J. Pineau G. Gordon S. Thrun 2006 Anytime point-based approximations for large pomdps Journal of Artificial Intelligence Research (JAIR) 27 335 380
28. Polich, K., & Gmytrasiewicz, P. (2006). Interactive dynamic influence diagrams. In Game Theory and Decision Theory (GTDT) Workshop, AAMAS. Hakodate, Japan.
29. Pynadath, D., & Marsella, S. (2007). Minimal mental models. In Twenty-Second Conference on Artificial Intelligence (AAAI) (pp. 1038-1044). Canada, Vancouver.
30. Rathnas, B., Doshi, P., & Gmytrasiewicz, P. J. (2006). Exact solutions to interactive pomdps using behavioral equivalence. In Autonomous Agents and Multi-Agents Systems Conference (AAMAS) (pp. 1025-1032). Hakodate, Japan.
31. Russell, S., & Norvig, P. (2003). Artificial intelligence: A modern approach (2nd edn). Prentice Hall.
32. Seuken, S., & Zilberstein, S. (2008). Formal models and algorithms for decentralized decision making under uncertainty. Journal of Autonomous Agents and Multi-agent Systems. doi: 10.1007/s10458-007-9026-5 .
33. R.D. Shachter 1986 Evaluating influence diagrams Operations Research 34 6 871 882
34. R. Smallwood E. Sondik 1973 The optimal control of partially observable markov decision processes over a finite horizon Operations Research (OR) 21 1071 1088
35. Suryadi, D., & Gmytrasiewicz, P. (1999). Learning models of other agents using influence diagrams. In International Conference on User Modeling (pp. 223-232).
36. J.A. Tatman R.D. Shachter 1990 Dynamic programming and influence diagrams IEEE Transactions on Systems, Man, and Cybernetics 20 2 365 379