Zero-sum average semi-Markov games: Fixed-point solutions of the Shapley equation

SIAM Journal on Control and Optimization

Volumn 42, Issue 5, 2003, Pages 1876-1894

  Vega Amaya, Oscar ^a  

^a UNIVERSIDAD DE SONORA   (Mexico)

Author keywords

Average payoff criterion; Fixed point approach; Lyapunov conditions; Zero sum semi Markov games

Indexed keywords

AVERAGE PAYOFF CRITERION; LYAPUNOV CONDITIONS; ZERO-SUM SEMI-MARKOV GAMES;

ALGORITHMS; GAME THEORY; ITERATIVE METHODS; LYAPUNOV METHODS; THEOREM PROVING;

MARKOV PROCESSES;

EID: 1642380053     PISSN: 03630129     EISSN: None     Source Type: Journal    
DOI: 10.1137/S0363012902408423     Document Type: Article

References (32)

1. E. ALTMAN, A. HORDIJK, AND F. M. SPIEKSMA, Contraction conditions for average and α-discount optimality in countable state Markov games with unbounded rewards, Math. Oper. Res., 22 (1997), pp. 588-618.
2. S. BHATNAGAR AND V. S. BORKAR, A convex analytic framework for ergodic control of semi-Markov processes, Math. Oper. Res., 20 (1995), pp. 923-936.
3. V. S. BORKAR AND M. K. GHOSH, Denumerable stochastic games with limiting average payoff, J. Optim. Theory Appl., 76 (1993), pp. 539-560.
4. K. FAN, Minimax theorems, Proc. Natl. Acad. Sci. USA, 39 (1953), pp. 42-47.
5. A. FERDEGRUEN, P. J. SCHWEITZER, AND H. C. TIJMS, Denumerable undiscounted semi-Markov decision processes with unbounded rewards, Math. Oper. Res., 8 (1983), pp. 298-313.
6. J. FILAR AND K. VRIEZE, Competitive Markov Decision Processes, Springer-Verlag, New York, 1997.
7. M. K. GHOSH AND A. BAGCHI, Stochastic games with average payoff criterion, Appl. Math. Optim., 38 (1998), pp. 283-301.
8. J. I. GONZÁLEZ-TREJO, O. HERNÁNDEZ-LERMA, AND L. F. HOYOS-REYES, Minimax control of discrete-time stochastic systems, SIAM J. Control Optim., 41 (2003), pp. 1626-1659.
9. E. GORDIENKO AND O. HERNÁNDEZ-LERMA, Average cost Markov control processes with weighted norms: Existence of canonical policies, Appl. Math. (Warsaw), 23 (1995), pp. 199-218.
10. O. HERNÁNDEZ-LERMA AND J. B. LASSERRE, Further Topics on Discrete-Time Markov Control Processes, Springer-Verlag, New York, 1999.
11. O. HERNÁNDEZ-LERMA AND J. B. LASSERRE, Zero-sum stochastic games in Borel spaces: Average payoff criteria, SIAM J. Control Optim., 39 (2001), pp. 1520-1539.
12. O. HERNÁNDEZ-LERMA, R. MONTES-DE-OCA, AND R. CAVAZOS-CADENA, Recurrence conditions for MDPs with Borel state space, Ann. Oper. Res., 28 (1991), pp. 29-46.
13. O. HERNÁNDEZ-LERMA AND O. VEGA-AMAYA, Infinite-horizon Markov control processes with undiscounted cost criteria: Prom average to overtaking optimality, Appl. Math. (Warsaw), 25 (1998), pp. 153-178.
14. O. HERNÁNDEZ-LERMA, O. VEGA-AMAYA, AND G. CARRASCO, Sample-path optimality and variance-minimization of average cost Markov control processes, SIAM J. Control Optim., 38 (1999), pp. 79-93.
15. A. JAŚKIEWICZ, An approximation approach to ergodic semi-Markov control processes, Math. Methods Oper. Res., 54 (2001), pp. 1-19.
16. A. JAŚKIEWICZ AND A. S. NOWAK, On the optimality equation for zero-sum ergodic stochastic games, Math. Methods Oper. Res., 54 (2001), pp. 291-301.
17. A. JAŚKIEWICZ, Zero-sum semi-Markov games, SIAM J. Control Optim., 41 (2002), pp. 723-739.
18. H.-U. KÜENLE AND R. SCHURAT, The optimality equation and e-optimal strategies in Markov games with average reward criterion, Math. Methods Oper. Res., 56 (2003), pp. 439-449.
19. M. KURANO, Average optimal adaptive policies in semi-Markov decision processes including an unknown parameter, J. Oper. Res. Soc. Japan, 28 (1985), pp. 252-266.
20. A. K. LAL AND S. SINHA, Zero-sum two-person semi-Markov games, J. Appl. Probab., 29 (1992), pp. 56-72.
21. F. LUQUE-VÁSQUEZ, Zero-sum semi-Markov games in Borel spaces: Discounted and average payoff, Bol. Soc. Mat. Mexicana (3), 8 (2002), pp. 227-241.
22. F. LUQUE-VÁSQUEZ AND O. HERNÁNDEZ-LERMA, Semi-Markov models with average costs, Appl. Math. (Warsaw), 26 (1999), pp. 315-331.
23. S. P. MEYN AND R. L. TWEEDIE, Markov Chains and Stochastic Stability, Springer-Verlag, London, 1993.
24. A. S. NOWAK, Measurable selection theorems for minimax stochastic optimization problems, SIAM J. Control Optim., 23 (1985), pp. 466-476.
25. A. S. NOWAK, Optimal strategies in a class of zero-sum ergodic stochastic games, Math. Methods Oper. Res., 50 (1999), pp. 399-419.
26. M. L. PUTERMAN, Markov Decision Processes. Discrete Stochastic Dynamic Programming, Wiley, New York, 1994.
27. U. RIEDER, Average optimality in Markov games with general state space, in Proceedings of the 3rd Conference on Approximation Theory and Optimization, Puebla, Mexico, 1995, http://www.emis.de/proceedings/.
28. S. M. Ross, Applied Probability Models with Optimization Applications, Holden-Day, San Francisco, 1970.
29. P. J. SCHWEITZER, Iterative solution of functional equations of undiscounted Markov renewal programming, J. Math. Anal. Appl., 34 (1971), pp. 495-501.
30. O. VEGA-AMAYA, The average cost optimality equation: A fixed point approach, Bol. Soc. Mat. Mexicana (3), 9 (2003), pp. 185-195.
31. O. VEGA-AMAYA, A Note on the Regularity Property of Semi-Markov Processes with Borel Stat Space, Reporte de Investigación 18, Departamento de Matemáticas, Universidad de Sonora, México, 2002, http://fractus.mat.uson.mx/~tedi/reportes. Statist. Probab. Lett., to appear.
32. O. VEGA-AMAYA AND F. LUQUE-VÁSQUEZ, Sample-path average cost optimality for semi-Markov control processes on Borel spaces: Unbounded costs and mean holding times, Appl. Math. (Warsaw), 27 (2000), pp. 343-367.