Sample bounded distributed reinforcement learning for decentralized POMDPs

Proceedings of the National Conference on Artificial Intelligence

Volumn 2, Issue , 2012, Pages 1256-1262

  Banerjee, Bikramjit ^a   Lyle, Jeremy ^b   Kraemer, Landon ^a   Yellamraju, Rajesh ^a  

^a UNIVERSITY OF SOUTHERN MISSISSIPPI   (United States)

^b University of Southern Mississippi   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEST RESPONSE; COMPUTATION PROBLEMS; DISTRIBUTED REINFORCEMENT LEARNING; ERROR TOLERANCE; LEARNING APPROACH; MODELING TECHNIQUE; MULTI-AGENT COORDINATIONS; OPTIMAL POLICIES; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; PRIOR KNOWLEDGE; PROBLEM PARAMETERS; SAMPLE COMPLEXITY; SOLUTION TECHNIQUES;

UNCERTAINTY ANALYSIS;

ARTIFICIAL INTELLIGENCE;

EID: 84868275593     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Amato, C.; Bernstein, D.; and Zilberstein, S. 2007. Optimizing memory-bounded controllers for decentralized POMDPs. In Proc. UAI.
2. Bernstein, D. S.; Givan, R.; Immerman, N.; and Zilberstein, S. 2002. The complexity of decentralized control of markov decision processes. Mathematics of Operations Research 27:819-840.
3. Brafman, R. I., and Tennenholtz, M. 2002. R-max - A general polynomial time algorithm for near-optimal reinforcement learning. Journal of Machine Learning Research 3:213-231.
4. Chrisman, L. 1992. Reinforcement learning with perceptual aliasing: The perceptual distinctions approach. In Proceedings of the Tenth National Conference on Articial Intelligence, 183-188. San Jose, CA: AAAI Press.
5. Claus, C., and Boutilier, C. 1998. The dynamics of reinforcement learning in cooperative multiagent systems. In Proceedings of the 15th National Conference on Artificial Intelligence, 746-752. Menlo Park, CA: AAAI Press/MIT Press.
6. Emery-Montemerlo, R.; Gordon, G.; Schneider, J.; and Thrun, S. 2004. Approximate solutions for partially observable stochastic games with common payoffs. Autonomous Agents and Multiagent Systems, International Joint Conference on 1:136-143.
7. Kraemer, L., and Banerjee, B. 2012. Informed initial policies for learning in dec-pomdps. In Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence Student Abstract and Poster Program. To appear.
8. McCallum, A. K. 1995. Reinforcement Learning with Selective Perception and Hidden State. Ph.D. Dissertation, Department of Computer Science, University of Rochester.
9. Meuleau, N.; Peshkin, L.; Kim, K.; and Kaelbling, L. 1999. Learning finite-state controllers for partially observable environments. In Proc. UAI, 427-436.
10. Nair, R.; Tambe, M.; Yokoo, M.; Pynadath, D.; and Marsella, S. 2003. Taming decentralized pomdps: Towards efficient policy computation for multiagent settings. In Proceedings of the 18th International Joint Conference on Artificial Intelligence (IJCAI-03), 705-711.
11. Oliehoek, F. A.; Spaan, M. T. J.; Dibangoye, J. S.; and Amato, C. 2010. Heuristic search for identical payoff bayesian games. In Proceedings of the Ninth International Conference on Autonomous Agents and Multiagent Systems (AAMAS-10), 1115-1122.
12. Peshkin, L.; Kim, K.; Meuleau, N.; and Kaelbling, L. 2000. Learning to cooperate via policy search. In Proceedings of the 16th Conference on Uncertainty in Artificial Intelligence (UAI '00).
13. Seuken, S. 2007. Memory-bounded dynamic programming for dec-pomdps. In Proceedings of the 20th International Joint Conference on Artificial Intelligence (IJCAI-07), 2009-2015.
14. Shani, G.; Brafman, R.; and Shimony, S. 2005. Model-based online learning of POMDPs. In Proceedings of the European Conference on Machine Learning (ECML), volume Lecture Notes in Computer Science 3720, 353-364. Springer.
15. Spaan, M. T. J.; Oliehoek, F. A.; and Amato, C. 2011. Scaling up optimal heuristic search in Dec-POMDPs via incremental expansion. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence (IJCAI-11), 2027-2032.
16. Sutton, R., and Barto, A. G. 1998. Reinforcement Learning: An Introduction. MIT Press.
17. Szer, D., and Charpillet, F. 2006. Point-based dynamic programming for dec-pomdps. In Proceedings of the 21st National Conference on Artificial Intelligence, 1233-1238.
18. Wu, F.; Zilberstein, S.; and Chen, X. 2010. Rollout sampling policy iteration for decentralized POMDPs. In Proceedings of the 26th Conference on Uncertainty in Artificial Intelligence (UAI-10), 666-673.
19. Zhang, C., and Lesser, V. 2011. Coordinated multi-agent reinforcement learning in networked distributed POMDPs. In Proc. AAAl-11.