Not all agents are equal: Scaling up distributed POMDPs for agent networks

Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS

Volumn 1, Issue , 2008, Pages 478-485

  Marecki, Janusz ^a   Gupta, Tapana ^a   Varakantham, Pradeep ^b   Tambe, Milind ^a   Yokoo, Makoto ^c  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c KYUSHU UNIVERSITY   (Japan)

Author keywords

Distributed POMDP; Finite state machines; Multi agent systems; Partially Observable Markov Decision Process (POMDP)

Indexed keywords

AUTONOMOUS AGENTS; AUTONOMOUS UNDERWATER VEHICLES; FINITE AUTOMATA; HEURISTIC ALGORITHMS; MULTI AGENT SYSTEMS; SENSOR NETWORKS;

BEST-KNOWN ALGORITHMS; DISTRIBUTED POMDP; MOBILE SENSOR NETWORKS; NETWORK ALGORITHMS; ORDERS OF MAGNITUDE; PARTIALLY OBSERVABLE MARKOV DECISION PROBLEMS; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; UNMANNED AIR VEHICLE (UAVS);

MOBILE AGENTS;

EID: 84899969517     PISSN: 15488403     EISSN: 15582914     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. R. Becker, S. Zilberstein, V. Lesser, and C. Goldman. Solving transition independent decentralized Markov decision processes. JAIR, 22:423-455, 2004.
2. D. S. Bernstein, E. Hansen, and S. Zilberstein. Bounded policy iteration for decentralized POMDPs. In IJCAI, 2005.
3. D. S. Bernstein, S. Zilberstein, and N. Immerman. The complexity of decentralized control of MDPs. In UAI, 2000.
4. DARPA. Landroids. http://fs1.fbo.gov/EPSData/ODA/Synopses/4965/BAA07-46/ BAA07-46LANdroidsPIP.pdf
5. R. Emery-Montemerlo, G. Gordon, J. Schneider, and S. Thrun. Approximate solutions for partially observable stochastic games with common payoffs. In AAMAS, 2004.
6. P. Gmytrasiewicz and P. Doshi. A framework for sequential planning in multiagent settings. Journal of Artificial Intelligence Research, 24:49-79, 2005.
7. E. Hansen, D. Bernstein, and S. Zilberstein. Dynamic programming for partially observable stochastic games. In AAAI, 2004.
8. V. Lesser, C. Ortiz, and M. Tambe. Distributed sensor nets: A multiagent perspective. Kluwer, 2003.
9. R. Nair, D. Pynadath, M. Yokoo, M. Tambe, and S. Marsella. Taming decentralized POMDPs: Towards efficient policy computation for multiagent settings. In IJCAI, 2003.
10. R. Nair, P. Varakantham, M. Tambe, and M. Yokoo. Networked distributed POMDPs: A synthesis of distributed constraint optimization and POMDPs. In AAAI, 2005.
11. L. Peshkin, N. Meuleau, K.-E. Kim, and L. Kaelbling. Learning to cooperate via policy search. In UAI, 2000.
12. P. Poupart and C. Boutilier. Bounded finite state controllers. In NIPS, 2003.
13. D. Szer, F. Charpillet, and S. Zilberstein. MAA*: A heuristic search algorithm for solving decentralized POMDPs. In IJCAI, 2005.
14. P. Varakantham, J. Marecki, Y.Yabu, M. Tambe, and M. Yokoo. Letting loose a SPIDER on a network of POMDPs: Generating quality guaranteed policies. In AAMAS, 2007.