Toward guidelines for modeling learning agents in multiagent-based simulation: Implications from Q-learning and sarsa agents

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3415 LNAI, Issue , 2005, Pages 159-172

  Takadama, Keiki ^a,b   Fujita, Hironori ^c  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^c HITOTSUBASHI UNIVERSITY   (Japan)

Author keywords

Agent modeling; Bargaining game; Learning mechanism; Multiagent based simulation; Sensitivity

Indexed keywords

COMPUTER SIMULATION; GAME THEORY; MULTI AGENT SYSTEMS;

AGENT MODELING; BARGAINING GAME; LEARNING MECHANISM; MULTIAGENT-BASED SIMULATION; SENSITIVITY;

LEARNING SYSTEMS;

EID: 26844486300     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-32243-6_13     Document Type: Conference Paper

References (21)

1. Axelrod, R. M.: The Complexity of Cooperation: Agent-Based Models of Competition and Collaboration, Princeton University Press, 1997.
2. Axteil, R., Axelrod, R., Epstein J., and Cohen, M. D.: "Aligning Simulation Models: A Case Study and Results," Computational and Mathematical Organization Theory (CMOT), Vol. 1, No. 1, pp. 123-141, 1996.
3. Back, T., Rudolph, G., and Schwefel, H.: "Evolutionary Programming and Evolution Strategies: Similarities and Differences," The 2nd Annual Evolutionary Programming Conference, pp. 11-22, 1992.
4. Goldberg, D. E.: Genetic Algorithms in Search, Optimization, and Machine Learning, Addison-Wesley, 1989.
5. Güth, W., Schmittberger, R., and Schwarze, B.: "An Experimental Analysis of Ultimatum Bargaining," Journal of Economic Behavior and Organization, Vol. 3, pp. 367-388, 1982.
6. Holland, J. H., Holyoak, K. J., Nisbett, R. E., and Thagard, P. R.: Induction, The MIT Press, 1986.
7. Moss, S. and Davidsson, P.: Multi-Agent-Based Simulation, Lecture Notes in Artificial Intelligence, Vol. 1979, Springer-Verlag, 2001.
8. Muthoo, A.: Bargaining Theory with Applications, Cambridge University Press, 1999.
9. Muthoo, A.: "A Non-Technical Introduction to Bargaining Theory," World Economics, pp. 145-166, 2000.
10. Neelin, J., Sonnenschein, H., and Spiegel, M.: "A Further Test of Noncooperative Bargaining Theory: Comment," American Economic Review, Vol. 78, No. 4, pp. 824-836, 1988.
11. Nydegger, R. V. and Owen, G.: "Two-Person Bargaining: An Experimental Test of the Nash Axioms," International Journal of Game Theory, Vol. 3, No. 4, pp. 239-249, 1974.
12. Osborne, M. J. and Rubinstein, A.: A Course in Game Theory, MIT Press, 1994.
13. Roth, A. E., Prasnikar, V., Okuno-Pujiwara, M., and Zamir, S.: "Bargaining and Market Behavior in Jerusalem, Ljubljana, Pittsburgh, and Tokyo: An Experimental Study," American Economic Review, Vol. 81, No. 5, pp. 1068-1094, 1991.
14. Rubinstein, A.: "Perfect Equilibrium in a Bargaining Model," Econometrica, Vol. 50, No. 1, pp. 97-109, 1982.
15. Rummery, G. A. and Niranjan, M.: "On-line Q-learning Using Connectionist Systems", Technical Report CUED/F-INFENG/TR 166, Engineering Department, Cambridge University, 1994.
16. Ståhl, I.: Bargaining Theory, Economics Research Institute at the Stockholm School of Economics, 1972.
17. Sutton, R: "Generalization in Reinforcement Learning: Successful Examples Using Sparse Coarse Coding," In Touretzky, D. S., Mozer, M. C., and Hasselmo M. E. (Eds.), Advances in Neural Information Processing Systems, The MIT Press, pp. 1038-1044, 1996.
18. Sutton, R. S. and Bart, A. G.: Reinforcement Learning - An Introduction -, The MIT Press, 1998.
19. Takadama, K., Suematsu, Y. L., Sugimoto, N., Nawa, N. E., and Shimohara, K.: "Cross-Element Validation in Multiagent-based Simulation: Switching Learning Mechanisms in Agents," The Journal of Artificial Societies and Social Simulation (JASSS), Vol. 6, No. 4, http://jasss.soc.surrey.ac.uk/6/4/6.html, 2003.
20. Takadama, K. and Fujita, H.: "Lessons Learned from Comparison Between Q-learning and Sarsa Agents in Bargaining Game," NAA CSOS (North American Association for Computational Social and Organizational Science) Conference 2004, 2004.
21. Watkins, C. J. C. H. and Dayan, P.: "Technical Note: Q-Learning," Machine Learning, Vol. 8, pp. 55-68, 1992.