Learning through reinforcement for N-person repeated constrained games

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 32, Issue 6, 2002, Pages 759-771

  Poznyak, Alexander S ^a   Najim, Kaddour ^b  

^a DEPARTAMENTO DE FÍSICA   (Mexico)

^b UNIVERSITÉ DE TOULOUSE   (France)

Author keywords

Adaptive strategies; Learning automata (LA); Reinforcement learning; Repeated game

Indexed keywords

ADAPTIVE SYSTEMS; AUTOMATA THEORY; COMPUTER SIMULATION; LAGRANGE MULTIPLIERS; LEARNING ALGORITHMS; LEARNING SYSTEMS; RANDOM PROCESSES;

REINFORCEMENT LEARNINGS;

GAME THEORY;

EID: 0036894103     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2002.1049610     Document Type: Article

References (41)

1. E. Altman, Controlled Markov Decision Processes. London, U.K.: Chapman & Hall, 1999.
2. E. Altman and A. Shwartz, "Adaptive control of constrained Markov chains: Criteria and policies," Ann. Oper. Res., vol. 28, pp. 101-134, 1991.
3. J. Arifovic, "Genetic algorithm and the Cobweb model," J. Econ. Dynam. Contr, vol. 18, pp. 2-28, 1994.
4. K.J. Arrow, L. Hurwicz, and H. Uzawa, "Constraint qualifications in maximization problems," Nav. Res. Logist. Q., vol. 8, pp. 175-191, 1961.
5. N. Baba, New Topics in Learning Automata: Theory and Applications. New York: Springer-Verlag, 1984.
6. J.F. Mertens and A. Neyman. "Stochastic games," Int. J. Game Theory, vol. 10, pp. 53-66, 1981.
7. T.E.S. Raghavan and J.A. Filar, "Algorithms for stochastic games-A survey," ZOR-Methods Models Oper. Res., vol. 35, pp. 437-472, 1991.
8. T.E.S. Raghavan, T.S. Ferguson, T. Parthasarathy, and O.J. Vrieze, Stochastic Games and Related Topics. Norwell, MA: Kluwer, 1991.
9. J. Filar and K. Vrieze, Competitive Markov Decision Processes. New York: Springer-Verlag, 1979.
10. D. Fudenberg and D.K. Levine, The Theory of Learning in Games. Cambridge, MA: MIT Press, 1998.
11. J.P. Aubin, Mathematical Methods of Game and Economic Theory. Amsterdam, The Netherlands: North Holland, 1979.
12. Y. Balasco and D. Royer, "Stability of competitive equilibrium with respect to recursive and learning processes," Dép. d'Econ., Fac. Sci. Econ. Sociales, Univ. Genève, Genève, France, Rep. 94.03, 1994.
13. T. Basar and G.J. Olsder, Dynamic Noncooperative Game Theory, 2nd ed. Philadelphia, PA: SIAM, 1998.
14. D. Bertsekas and J.N. Tsiklitis, Neuro-Dynamic Programming. Belmont, MA: Athena Scientific, 1996.
15. T. Börgers and R. Sarin, "Learning through reinforcement and replicator dynamics," J. Econ. Theory, vol. 77, pp. 1-14, 1997.
16. X. Chen anal H. White, "Nonparametric adaptive learning with feed-back," J. Econ. Theory, vol. 82, pp. 190-222, 1998.
17. M. Duflo, Random Iterative Models. New York: Springer-Verlag, 1997.
18. J. Dutta and K. Prasad, "Learning by observation within the firm," J. Econ. Dynam. Contr., vol. 20, pp. 1395-1425, 1996.
19. Y.M. El-Fattah and C. Foulard, Learning Systems: Decision, Simulation, and Control. New York: Springer-Verlag, 1978.
20. I. Erev and A.E. Roth, "Predicting how people play games: Reinforcement learning in experimental games with unique, mixed strategy equilibria," Amer. Econ. Rev., vol. 88, pp. 848-881, 1998.
21. D. Friedman, "Evolutionary economics goes mainstream: A review of the theory of learning in games," J. Evol. Econ., vol. 8, pp. 423-432, 1998.
22. E. Kalai and E. Lehrer, "Rational learning leads to Nash equilibrium," Econometrica, vol. 61, pp. 1019-1045, 1993.
23. C.M. Kuan and H. White, "Adaptive learning with nonlinear dynamics driven by dependent processes," Econometrica, vol. 62, pp. 1087-1114, 1994.
24. S. Lakshmivarahan, Learning Algorithms Theory and Applications. New York: Springer-Verlag, 1981.
25. K. Najim and A.S. Poznyak, Learning Automata: Theory and Applications. New York: Pergamon, 1994.
26. _, "Multimodal searching technique based on learning automata with continuous input and changing number of actions," IEEE Trans. Syst., Man, Cybern. B, vol. 26, pp. 666-673, Aug. 1996.
27. K. Najim, A.S. Poznyak, and E. Gomez, "Adaptive policy for two finite Markov chains zero-sum stochastic games with unknown transition matrices and average payoffs," IFAC Automatica, vol. 37, pp. 1008-1018, 2001.
28. K.S. Narendra and M.A.L. Thathachar, Learning Automata: An Introduction. Englewood Cliffs, NJ: Prentice-Hall, 1989.
29. J. Nash, "Equilibrium points in n-person games," Proc. Nat. Acad. USA, vol. 36, pp. 48-49, 1950.
30. A.V. Nazin and A.S. Poznyak, "Matrix N-person game with incomplete information," Econ. Math. Meth., vol. 14, pp. 958-968, 1978.
31. _, Adaptive Choice of Variants (in Russian). Moscow: Nauka, 1986.
32. M.F. Norman, Markov Processes and Learning Models. New York: Academic, 1972.
33. S. Özyildirim and N.M. Alenmdar, "Learning the optimum as a Nash equilibrium," J. Econ. Dynam. Contr., vol. 24, pp. 483-499, 2000.
34. A.S. Poznyak and K. Najim, Learning Automata and Stochastic Optimization. New York: Springer-Verlag, 1997.
35. A.S. Poznyak, K. Najim, and E. Gomez, Self-Learning Control for Finite Markov Chains. New York: Marcel Dekker, 2000.
36. A. Poznyak and K. Najim, "Bush-Mosteller learning for zero-sum repeated game with random pay-offs," Int. J. Syst. Sci., vol. 32, no. 10, pp. 1251-1260, 2001.
37. A.E. Roth and I. Erev, "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games Econ. Beh., vol. 8, pp. 164-212, 1995.
38. H. Robbins and D. Siegmund, "A convergence theorem for nonnegative almost supermartingales and some applications," in Optimizing Methods in Statistics, J.S. Rustagi, Ed. New York: Academic, 1971.
39. J.B. Rosen, "Existence and uniqueness of equilibrium points for concave N-persons games," Econometrica, vol. 33, pp. 520-534, 1965.
40. P.S. Sastry, V.V. Phansalkar, and M.A.L. Thathachar, "Decentralized learning of Nash equilibria in multiperson stochastic game with incomplete information," IEEE Trans. Syst., Man, Cybern., vol. 24, pp. 769-777, May 1994.
41. N. Shimkin, "Stochastic games with average cost constraints," in Annals of the International Society of Dynamic Games, T. Basar and H. Haurie, Eds. Cambridge, MA: Birkhaüser, 1994, vol. 1, Advances in Dynamic Games and Applications.