Individual learning of coordination knowledge

Journal of Experimental and Theoretical Artificial Intelligence

Volumn 10, Issue 3, 1998, Pages 333-356

  Sen, Sandip ^a   Sekaran, Mahendra ^a  

^a UNIVERSITY OF TULSA   (United States)

Author keywords

Multiple agents; Reinforcementlearning; Repeated problem solving experience

Indexed keywords

EID: 0032359707     PISSN: 0952813X     EISSN: 13623079     Source Type: Journal    
DOI: 10.1080/095281398146798     Document Type: Article

References (58)

1. Barto, A. B., Sutton, R. S. and Watkins, C., 1989, Sequential decision problems and neural networks. In Proceedings of 1989 Conference on Neural Information Processing.
2. Bond, A. H. and Gasser, L., 1988, Readings in Distributed Artificial Intelligence (San Mateo CA: Morgan Kaufmann Publishers).
3. Booker, L. B., 1988, Classifier systems that learn internal world models. Machine Learning, 3: 161-192.
4. Booker, L. B., Goldberg, D. E. and Holland, J. H., 1989, Classifier systems and genetic algorithms. Artificial Intelligence, 40: 235-282.
5. Brazdil, P., Gams, M., Sian, S., Torgo, L. and van de Velde, W., 1991, Learning in distributed systems and multi-agent environments. In European Working Session on Learning, Lecture Notes in AI, 482 (Berlin: Springer Verlag).
6. Bui, H. H., Kieronska, D. and Venkatesh, S., 1996, Negotiating agents that learn about others' preferences. In Proceedings of the Thirteenth National Conference on Artificial Intelligence, (Menlo Park, CA: AAAI Press) pp. 114-119.
7. Carmel, D. and Markovitch, S., 1996, Incorporating opponent models into adversary search. In Proceedings of the Thirteenth National Conference on Artificial Intelligence (Menlo Park, CA: AAAI Press), pp. 62-67.
8. Cohen, P. R. and Perrault, C. R., 1979, Elements of a plan-based theory of speech acts. Cognitive Science, 3(3): 177-212.
9. Conry, S. E., Meyer, R. A. and Lesser, V. R., 1988, Multistage negotiation in distributed planning. In A. H. Bond and L. Gasser (eds) Readings in Distributed Artificial Intelligence (Los Alamos CA: Morgan Kaufman), pp. 367-384.
10. Dorigo, M. and Bersini, H., 1994, A comparison of Q-learning and classifier systems. In Proceedings of From Animals to Animats, Third International Conference on Simulation of Adaptive Behavior.
11. Durfee, E. H. and Lesser, V. R., 1991, Partial global planning: a coordination framework for distributed hypothesis formation. IEEE Transactions on Systems, Man and Cybernetics, 21(5) (Special Issue on Distributed Sensor Networks) 1167-1 183.
12. Durfee, E. H., Lesser, V. R. and Corkill, D. D., 1987, Coherent cooperation among communicating problem solvers. IEEE Transactions on Computers, 36(11): 1275-1291.
13. Durfee, E. H., Lesser, V. R. and Corkill, D. D., 1989, Trends in cooperative distributed problem solving. IEEE Transactions on Knowledge and Data Engineering, 1(1): 63-83.
14. Durfee, E. H. and Montgomery, T. A., 1991, Coordination as distributed search in a hierarchical behavior space. IEEE Transactions on Systems, Man and Cybernetics, 21(6): 1363-1378.
15. Fox, M. S., 1981, An organizational view of distributed systems. IEEE Transactions on Systems, Man and Cybernetics, 11(1): 70-80.
16. Garland, A. and Alterman, R., 1996, Multiagent learning through collective memory. In S. Sen (ed.) Working Notes for the AAAI Symposium on Adaptation, Co-evolution and Learning in Multi agent Systems (Stanford CA: Stanford University), pp. 33-38.
17. Gasser, L. and Huhns, M. N. (eds), 1989, Distributed Artificial Intelligence, Research Notes in Artificial Intelligence, Vol. 2 (London: Pitman).
18. Genesereth, M. R., Ginsberg, M. L. and Rosenschein, J. S., 1986, Cooperation without communications. In Proceedings of the National Conference on Artificial Intelligence, Philadelphia, Pennsylvania, (AAAI Press) pp. 51-57.
19. Gmytrasiewicz, P. J., Durfee, E. H. and Wehe, D. K., 1991, A decision-theoretic approach to coordinating multiagent interactions. In Proceedings of the Twelfth International Joint Conference on Artificial Intelligence, pp. 62-68.
20. Grefenstette, J., 1988, Credit assignment in rule discovery systems. Machine Learning, 3(2/3): 225-246.
21. Gu, P. and Maddox, A. B., 1996, A framework for distributed reinforcement learning. In G. Weiß and S. Sen, (eds), Adaptation and Learning in Multi-Agent Systems, Lecture Notes in Artificial Intelligence (Berlin: Springer Verlag), pp. 97-112.
22. Halpern, J. and M oses, Y., 1990, Knowledge and common knowled ge in a distributed environment. Journal of the ACM, 37(3): 549-587. A preliminary version appeared in Proceedings of the 3rd ACM Symposium on Principles of Distributed Computing, 1984.
23. Haynes, T. and Sen, S., 1998, Learning cases to compliment rules for conflict resolution in multi-agent systems. International Journal of Human-Computer Studies 48(1).
24. Holland, J. H., 1975, Adaptation in Natural and Artificial Systems (Ann Arbor, MI: University of Michigan Press).
25. Holland, J. H., 1986, Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems. In R. S. Michalski, J. G. Carbonell and T. M. Mitchell (eds) Machine Learning, an Artificial Intelligence Approach, Vol. 2 (Los Alamos, CA: Morgan Kaufmann).
26. Huhns, M. (ed.), 1987, Distributed Artificial Intelligence (Los Alamos, CA: Morgan Kaufmann).
27. Kaelbling, L. P., Littman, M. L. and M oore, A. W., 1996, Reinforcement learning: a survey. Journal of AI Research, 4: 237-285.
28. Kirkpatrick, S., Gelatt, C. D. and Vecchi, M. P., 1983, Optimization by simulated reannealing. Science, 220: 671-680.
29. Lesser, V. R., 1995, Multiagent systems: an emerging subdiscipline of AI. ACM Computing Surveys, 27(3): 340-342.
30. Littman, M. L., 1994, Markov games as a framework formulti-agent reinforcement learning. In Proceedings of the Eleventh International Conference on Machine Learning, Amherst, MA (San Mateo, CA: Morgan Kaufmann) pp. 157-163.
31. Mahadevan, S., 1993, To discount or not to discount in reinforcement learning: a case study comparing R learning and Q learning. In Proceedings of the Tenth International Conference on Machine Learning, pp. 205-211.
32. Malone, T. W., 1987, Modelling coordination in organizations and markets. Management Science, 33(10): 1317-1332.
33. March, J. G. and Simon, H. A., 1958, Organizations (New York: John Wiley and Sons).
34. Mataric, M. J., 1996, Learning in multi-rob ot systems. In G. W eiß and S. Sen (eds) Adaptation and Learning in Multi-Agent Systems, Lecture Notes in Artificial Intelligence (Berlin: Springer Verlag), pp. 152-163.
35. Narendra, K. and Thatachar, M. A. L., 1989, Learning Automata: An Introduction (Engelwood Cliffs, NJ: Prentice Hall).
36. Parker, L. E., 1992, Adaptive action selection for cooperative robot teams. In J. Meyer, H. Roitblat and S. Wilson (eds) Proceedings of the Second International Conference on Simulation of Adaptive Behavior (Cambridge, MA: MIT Press), pp. 442-450.
37. Prasad, M. V. N., Lander, S. E. and Lesser, V. R., 1996, Cooperative learning over composite search spaces: Experiences with a multi-agent design system. In Proceedings of Thirteenth National Conference on Artificial Intelligence (Menlo Park, CA: AAAI Press), pp. 68-73.
38. Provost, F. J. and Hennessy, D. N., 1996, Scaling up: Distributed machine learning with cooperation. In Proceedings of the Thirteenth National Conference on Artificial Intelligence (Menlo Park, CA: AAAI Press), pp. 74-79.
39. Rosenschein, J. S., 1982, Synchronization of multi-agent plans. In Proceedings of the National Conference on Artificial Intelligence, Pittsburgh, Pennsylvania, pp. 115-119.
40. Sandholm, T. W. and Crites, R. H., 1996, On multiagent Q-learning in a semi-competitive domain. In G. Weiß and S. Sen (eds) Adaptation and Learning in Multi-Agent Systems, Lecture Notes in Artificial Intelligence, (Berlin: Springer Verlag), pp. 191-205.
41. Schaerf, A., Shoham, Y. and Tennenholtz, M., 1995, Adaptive load balancing: a study in multiagent learning. Journal of Artificial Intelligence Research, 2: 475-500.
42. Schmidhuber, J., 1996, A general method for multi-agent reinforcement learning in unrestricted environm ents. In S. Sen, (ed.) Working Notes for the AAAI Symposium on Adaptation, Co-evolution and Learning in Multiagent Systems (Stanford, CA: Stanford University), pp. 84-87.
43. Sekaran, M. and Sen, S., 1994, Learning with friends and foes. In Sixteenth Annual Conference of the Cognitive Science Society, Atlanta, GA (Hillsdale, NJ: Erlbaum), pp. 800-805.
44. Sen, S., 1996, IJCAI-95 workshop on adaptation and learning in multiagent systems. AI Magazine, 17(1): 87-89.
45. Sen, S., Sekaran, M. and Hale, J., 1994, Learning to coordinate without sharing information. In National Conference on Artificial Intelligence, Seattle, WA (Menlo Park, CA: AAAI Press), pp. 426-431.
46. Shoham, Y. and Tennenholtz, M., 1992, On the synthesis of useful social laws for artificial agent societies (preliminary report). In Proceedings of the National Conference on Artificial Intelligence, San Jose, California, pp. 276-281.
47. Sian, S., 1991, Adaptation based on cooperative learning in multi-agent systems. In Y. Demazeau and J.-P. MOller (eds) Decentralized AI, Vol. 2 (Elsevier Science Publications), pp. 257-272.
48. Smith, R. G., 1980, The contract net protocol: High-level communication and control in a distributed problem solver. IEEE Transactions on Computers, 29(12): 1104-1113.
49. Sutton, R. S., 1984, Temporal Credit Assignment in Reinforcement Learning. PhD thesis, University of Massachusetts at Amherst.
50. Tan, M., 1993, Multi-agent reinforcement learning: independent vs. cooperative agents. In Proceedings of the Tenth International Conference on Machine Learning, pp. 330-337.
51. Watkins, C. J. C. H., 1989, Learning from Delayed Rewards. PhD thesis, King's College, Cambridge University.
52. Weiß, G., 1993, Learning to coordinate actions in multi-agent systems. In Proceedings of the International Joint Conference on Artificial Intelligence, pp. 311-316.
53. Weiß, G. (ed.), 1997, Distributed Artificial Intelligence Meets Machine Learning: Learning in Multi-Agent Environments, Lecture Notes in Artificial Intelligence (Berlin: Springer Verlag).
54. Weiß, G. and Sen, S. (eds), 1996, Adaptation and Learning in Multi-Agent Systems, Lecture Notes in Artificial Intelligence (Berlin: Springer Verlag).
55. Werner, E., 1989, Cooperating agents: a unified theory of communication and social structure. In L. Gasser and M. N. Huhns (eds) Distributed Artificial Intelligence, Research Notes in Artificial Intelligence, Vol. 2 (Pitman), pp. 3-36.
56. Yanco, H. and Stein, L. A., 1993, An adaptive communication protocol for cooperating mobile robots. In S. W ilson (ed.) From Animals to Animats: Proceedings of the Second International Conference on the Simulation of Adaptive Behavior (Cambridge, MA: MIT Press), pp. 478-485.
57. Yokoo, M., Durfee, E., Ishida, T. and Kuwabara, K., 1992, Distributed constraint satisfaction for formalizing distributed problem solving. In Proceedings of the Twelfth International Conference on Distributed Computing Systems, pp. 614-621.
58. Zlotkin, G. and Rosenschein, J. S., 1990, Negotiation and conflict resolution in non-cooperative domains. In Proceedings of the National Conference on Artificial Intelligence, pp. 100-105.