Hybrid BDI-POMDP framework for multiagent teaming

Journal of Artificial Intelligence Research

Volumn 23, Issue , 2005, Pages 367-420

  Nair, Ranjit ^a   Tambe, Milind ^b  

^a HONEYWELL TECHNOLOGY CENTER   (United States)

^b University of Southern California   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; LARGE SCALE SYSTEMS; MARKOV PROCESSES; OPTIMAL CONTROL SYSTEMS; PLANNING; UNCERTAIN SYSTEMS;

MULTIAGENT ROLE ALLOCATION; POLICY SEARCH; ROBOCUPRESCUE DISASTER RESCUE SIMULATION; ROLE-BASED MARKOV TEAM DECISION PROBLEM;

MULTI AGENT SYSTEMS;

EID: 27344450974     PISSN: 10769757     EISSN: 10769757     Source Type: Journal    
DOI: 10.1613/jair.1549     Document Type: Article

References (59)

1. Barber, S., & Martin, C. (2001). Dynamic reorganization of decision-making groups. In Proceedings of the Fifth International Conference on Autonomous Agents (Agents-01), pp. 513-520.
2. Becker, R., Zilberstein, S., Lesser, V., & Goldman, C. V. (2003). Transition-independent decentralized Markov decision processes. In Proceedings of the Second International Joint Conference on Autonomous Agents and Multi Agent Systems (AAMAS-03), pp. 41-48.
3. Bernstein, D. S., Zilberstein, S., & Immerman, N. (2000). The complexity of decentralized control of MDPs. In Proceedings of the Sixteenth Conference on Uncertainty in Artificial Intelligence (UAI-00), pp. 32-37.
4. Boutilier, C. (1996). Planning, learning & coordination in multiagent decision processes. In Proceedings of the Sixth Conference on Theoretical Aspects of Rationality and Knowledge (TARK-96), pp. 195-210.
5. Boutilier, C., Reiter, R., Soutchanski, M., & Thrun, S. (2000). Decision-theoretic, highlevel agent programming in the situation calculus. In Proceedings of the Seventeenth National Conference on Artificial Intelligence (AAAI-00), pp. 355-362.
6. Cassandra, A., Littman, M., & Zhang, N. (1997). Incremental pruning: A simple, fast, exact method for partially observable Markov decision processes. In Proceedings of the Thirteenth Annual Conference on Uncertainty in Artificial Intelligence (UAI-97), pp. 54-61.
7. Chadès, I., Scherrer, B., & Charpillet, F. (2002). A heuristic approach for solving decentralized-pomdp: Assessment on the pursuit problem. In Proceedings of the 2002 ACM Symposium on Applied Computing (SAC-02), pp. 57-62.
8. Cohen, P. R., & Levesque, H. J. (1991). Teamwork. Nous, 25(4), 487-512.
9. da Silva, J. L. T., & Demazeau, Y. (2002). Vowels co-ordination model. In Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS-2002), pp. 1129-1136.
10. Dean, T., & Lin, S. H. (1995). Decomposition techniques for planning in stochastic domains. In Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence (IJCAI-95), pp. 1121-1129.
11. Decker, K., & Lesser, V. (1993). Quantitative modeling of complex computational task environments. In Proceedings of the Eleventh National Conference on Artificial Intelligence (AAAI-93), pp. 217-224.
12. Dix, J., Muoz-Avila, H., Nau, D. S., & Zhang, L. (2003). Impacting shop: Putting an ai planner into a multi-agent environment. Annals of Mathematics and Artificial Intelligence, 37(4), 381-407.
13. Dunin-Keplicz, B., & Verbrugge, R. (2001). A reconfiguration algorithm for distributed problem solving. Engineering Simulation, 18, 227-246.
14. Erol, K., Hendler, J., & Nau, D. S. (1994). HTN planning: Complexity and expressivity. In Proceedings of the Twelfth National Conference on Artificial Intelligence (AAAI-94), pp.1123-1128.
15. Fatima, S. S., & Wooldridge, M. (2001). Adaptive task and resource allocation in multiagent systems. In Proceedings of the Fifth International Conference on Autonomous Agents (Agents-01), pp. 537-544.
16. Georgeff, M. P., & Lansky, A. L. (1986). Procedural knowledge. Proceedings of the IEEE special issue on knowledge representation, 74, 1383-1398.
17. Goldman, C. V., & Zilberstein, S. (2003). Optimizing information exchange in cooperative multi-agent systems. In Proceedings of the Second International Joint Conference on Autonomous Agents and Multi Agent Systems (AAMAS-03), pp. 137-144.
18. Grosz, B., Hunsberger, L., & Kraus, S. (1999). Planning and acting together. AI Magazine, 20(4), 23-34.
19. Grosz, B., & Kraus, S. (1996). Collaborative plans for complex group action. Artificial Intelligence, 86(2), 269-357.
20. Guestrin, C., Venkataraman, S., & Koller, D. (2002). Context specific multiagent coordination and planning with factored MDPs. In Proceedings of the Eighteenth National Conference on Artificial Intelligence (AAAI-02), pp. 253-259.
21. Hansen, E., & Zhou, R. (2003). Synthesis of hierarchical finite-state controllers for pomdps. In Proceedings of the Thirteenth International Conference on Automated Planning and Scheduling (ICAPS-03), pp. 113-122.
22. Hansen, E. A., Bernstein, D. S., & Zilberstein, S. (2004). Dynamic programming for partially observable stochastic games. In Proceedings of the Nineteenth National Conference on Artificial Intelligence (AAAI-04), pp. 709-715.
23. Ho, Y.-C. (1980). Team decision theory and information structures. Proceedings of the IEEE, 68(6), 644-654.
24. Horling, B., Benyo, B., & Lesser, V. (2001). Using self-diagnosis to adapt organizational structures. In Proceedings of the Fifth International Conference on Autonomous Agents (Agents-01), pp. 529-536.
25. Hunsberger, L., & Grosz, B. (2000). A combinatorial auction for collaborative planning. In Proceedings of the Fourth International Conference on Multiagent Systems (ICMAS-2000), pp. 151-158.
26. Jennings, N. (1995). Controlling cooperative problem solving in industrial multi-agent systems using joint intentions. Artificial Intelligence, 75(2), 195-240.
27. Kaelbling, L., Littman, M., & Cassandra, A. (1998). Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101(2), 99-134.
28. Kitano, H., Tadokoro, S., Noda, I., Matsubara, H., Takahashi, T., Shinjoh, A., & Shimada, S. (1999). RoboCup-Rescue: Search and rescue for large scale disasters as a domain for multiagent research. In Proceedings of IEEE Conference on Systems, Men, and Cybernetics (SMC-99), pp. 739-743.
29. Levesque, H. J., Cohen, P. R., & Nunes, J. (1990). On acting together. In Proceedings of the National Conference on Artificial Intelligence, pp. 94-99. Menlo Park, Calif.: AAAI press.
30. Mailler, R. T., & Lesser, V. (2004). Solving distributed constraint optimization problems using cooperative mediation. In Proceedings of the Third International Joint Conference on Agents and Multiagent Systems (AAMAS-04), pp. 438-445.
31. Marschak, J., & Radner, R. (1972). The Economic Theory of Teams. Cowles Foundation and Yale University Press, New Haven, CT.
32. Modi, P. J., Shen, W.-M., Tambe, M., & Yokoo, M. (2003). An asynchronous complete method for distributed constraint optimization. In Proceedings of the Second International Joint Conference on Agents and Multiagent Systems (AAMAS-03), pp. 161-168.
33. Monahan, G. (1982). A survey of partially observable Markov decision processes: Theory, models and algorithms. Management Science, 101(1), 1-16.
34. Nair, R., Ito, T., Tambe, M., & Marsella, S. (2002). Task allocation in the rescue simulation domain. In Robo Cup 2001: Robot Soccer World Cup V, Vol. 2377 of Lecture Notes in Computer Science, pp. 751-754. Springer-Verlag, Heidelberg, Germany.
35. Nair, R., Pynadath, D., Yokoo, M., Tambe, M., & Marsella, S. (2003a). Taming decentralized POMDPs: Towards efficient policy computation for multiagent settings. In Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence (IJCAI-03), pp. 705-711.
36. Nair, R., Tambe, M., & Marsella, S. (2003b). Team formation for reformation in multiagent domains like RoboCupRescue. In Kaminka, G., Lima, P., & Roja, R. (Eds.), Proceedings of RoboCup-2002 International Symposium, pp. 150-161. Lecture Notes in Computer Science, Springer Verlag.
37. Nair, R., Tambe, M., Marsella, S., & Raines, T. (2004). Automated assistants to analyze team behavior. Journal of Autonomous Agents and Multi-Agent Systems, 8(1), 69-111.
38. Papadimitriou, C., & Tsitsiklis, J. (1987). Complexity of Markov decision processes. Mathematics of Operations Research, 12(3), 441-450.
39. Peshkin, L., Meuleau, N., Kim, K.-E., & Kaelbling, L. (2000). Learning to cooperate via policy search. In Proceedings of the Sixteenth Conference in Uncertainty in Artificial Intelligence (UAI-00), pp. 489-496.
40. Poupart, P., & Boutilier, C. (2003). Bounded finite state controllers. In Proceedings of Advances in Neural Information Processing Systems 16 (NIPS).
41. Pynadath, D. V., & Tambe, M. (2002). The communicative multiagent team decision problem: Analyzing teamwork theories and models. Journal of Artificial Intelligence Research, 16, 389-423.
42. Pynadath, D. V., & Tambe, M. (2003). Automated teamwork among heterogeneous software agents and humans. Journal of Autonomous Agents and Multi-Agent Systems (JAAMAS), 7, 71-100.
43. Rich, C., & Sidner, C. (1997). COLLAGEN: When agents collaborate with people. In Proceedings of the First International Conference on Autonomous Agents (Agents-97), pp. 284-291.
44. Scerri, P., Johnson, L., Pynadath, D., Rosenbloom, P., Si, M., Schurr, N., & Tambe, M. (2003). A prototype infrastructure for distributed robot, agent, person teams. In Proceedings of the Second International Joint Conference on Agents and Multiagent Systems (AAMAS-03), pp. 433-440.
45. Scerri, P., Pynadath, D. V., & Tambe, M. (2002). Towards adjustable autonomy for the real-world. Journal of Artificial Intelligence (JAIR), 17, 171-228.
46. Schut, M. C., Wooldridge, M., & Parsons, S. (2001). Reasoning about intentions in uncertain domains. In Proceedings of the Sixth European Conference on Symbolic and Quantitative Approaches to Reasoning with Uncertainty (ECSQARU-2001), pp. 84-95.
47. Shehory, O., & Kraus, S. (1998). Methods for task allocation via agent coalition formation. Artificial Intelligence, 101(1-2), 165-200.
48. Sondik, E. J. (1971). The optimal control of partially observable Markov processes. Ph.D. Thesis, Stanford.
49. Stone, P., & Veloso, M. (1999). Task decomposition, dynamic role assignment, and lowbandwidth communication for real-time strategic teamwork. Artificial Intelligence, 110(2), 241-273.
50. Tambe, M. (1997). Towards flexible teamwork. Journal of Artificial Intelligence Research, 7, 83-124.
51. Tambe, M., Pynadath, D., & Chauvat, N. (2000). Building dynamic agent organizations in Cyberspace. IEEE Internet Computing, 4(2), 65-73.
52. Tidhar, G. (1993a). Team-oriented programming: Preliminary report. Tech. rep. 41, Australian Artificial Intelligence Institute.
53. Tidhar, G. (1993b). Team-oriented programming: Social structures. Tech. rep. 47, Australian Artificial Intelligence Institute.
54. Tidhar, G., Rao, A., & Sonenberg, E. (1996). Guided team selection. In Proceedings of the Second International Conference on Multi-agent Systems (ICMAS-96), pp. 369-376.
55. Wooldridge, M. (2002). An Introduction to Multiagent Systems. John Wiley & Sons.
56. Xuan, P., & Lesser, V. (2002). Multi-agent policies: from centralized ones to decentralized ones. In Proceedings of the First International Joint Conference on Agents and Multiagent Systems (AAMAS-02), pp. 1098-1105.
57. Xuan, P., Lesser, V., & Zilberstein, S. (2001). Communication decisions in multiagent cooperation. In Proceedings of the Fifth International Conference on Autonomous Agents (Agents-01), pp. 616-623.
58. Yen, J., Yin, J., Ioerger, T. R., Miller, M. S., Xu, D., & Volz, R. A. (2001). Cast: Collaborative agents for simulating teamwork. In Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence (IJCAI-01), pp. 1135-1144.
59. Yoshikawa, T. (1978). Decomposition of dynamic team decision problems. IEEE Transactions on Automatic Control, AC-23(4), 627-632.