Zero-sum ergodic stochastic games with feller transition probabilities

SIAM Journal on Control and Optimization

Volumn 45, Issue 3, 2006, Pages 773-789

  Jaśkiewicz, Anna ^a   Nowak, Andrzej S ^b  

^a WROCLAW UNIVERSITY OF TECHNOLOGY   (Poland)

^b UNIVERSITY OF ZIELONA GÓRA   (Poland)

Author keywords

Average optimal strategies; Borel state space; Discrete time zero sum stochastic games; Optimality equation

Indexed keywords

GAME THEORY; PROBABILISTIC LOGICS; STATE SPACE METHODS; THEOREM PROVING;

AVERAGE OPTIMAL STRATEGIES; BOREL STATE SPACE; DISCRETE-TIME ZERO-SUM STOCHASTIC GAMES; OPTIMALITY EQUATION;

STOCHASTIC MODELS;

EID: 34249037119     PISSN: 03630129     EISSN: None     Source Type: Journal    
DOI: 10.1137/S0363012904443257     Document Type: Article

References (38)

1. E. ALTMAN, A. HORDIJK, AND F. M. SPIEKSMA, Contraction conditions for average and α-discount optimality in countable state Markov games with unbounded rewards, Math. Oper. Res., 22 (1997), pp. 588-618.
2. E. BERGE, Topological Spaces, MacMillan, New York, 1963.
3. D. P. BERTSEKAS AND S. E. SHREVE, Stochastic Optimal Control: The Discrete Time Case, Academic Press, New York, 1978.
4. H. A. M. COUWENBERGH, Stochastic games with metric state space, Internat. J. Game Theory, 9 (1980), pp. 25-36.
5. L. O. CURTAT, Markov equilibria of stochastic games with complementarities, Games and Econ. Behavior, 17 (1996), pp. 177-199.
6. D. DUFFIE, J. GEANAKOPLOS, A. MAS-COLELL, AND A. MCLENNAN, Stationary Markov equilibria, Econometrica, 62 (1994), pp. 745-782.
7. K. FAN, Minimax theorems, Proc. Nat. Acad. Sci. USA, 39 (1953), pp. 42-47.
8. E. A. FEINBERG AND M. E. LEWIS, Optimality of four-threshold policies in inventory systems with customer returns and borrowing/storage options, Probab. Engrg. Inform. Sci., 19 (2005), pp. 45-71.
9. J. I. GONZÁLEZ-TREJO, O. HERNÁ NDEZ-LERMA, AND L. F. HOYOS-REYES, Minimax control of discrete-time stochastic systems, SIAM J. Control Optim., 41 (2003), pp. 1626-1659.
10. O. HERNÁNDEZ-LERMA AND J. B. LASSERRE, Further Topics on Discrete-Time Markov Control Processes, Springer-Verlag, New York, 1999.
11. O. HERNÁNDEZ-LERMA AND J. B. LASSERRE, Zero-sum stochastic games in Borel spaces: Average payoff criteria, SIAM J. Control Optim., 39 (2001), pp. 1520-1539.
12. C. J. HIMMELBERG AND F. S. VAN VLECK, Multifunctions with values in a space of probability measures, J. Math. Anal. Appl., 50 (1975), pp. 108-112.
13. H. A. HOPENHAYN AND E. C. PRESCOTT, Stochastic monotonicity and stationary distributions for dynamic economies, Econometrica, 60 (1992), pp. 1387-1406.
14. A. JAŚKIEWICZ, Zero-sum semi-Markov games, SIAM J. Control Optim., 41 (2002), pp. 723739.
15. A. JAŚKIEWICZ AND A. S. NOWAK, On the optimality equation for zero-sum ergodic stochastic games, Math. Methods Oper. Res., 54 (2001), pp. 291-301.
16. A. JAŚKIEWICZ AND A. S. NOWAK, On the average cost optimality equation for Markov control processes with Feller transition probabilities, J. Math. Anal. Appl., 316 (2006), pp. 495-509.
17. N. V. KARTASHOV, Strong Stable Markov Chains, VSP, Utrecht, The Netherlands, 1996.
18. E. KLEIN AND A. C. THOMPSON, Theory of Correspondences, Wiley, New York, 1984.
19. H. J. KUSHNER, Numerical approximations for stochastic differential games: The ergodic case, SIAM J. Control Optim., 42 (2004), pp. 1911-1933.
20. H.-U. KÜENLE, Markov games under a geometric drift condition, in Advances in Dynamic Games, Ann. Internat. Soc. Dynam. Games 7, Birkhäuser Boston, Boston, MA, 2005, pp. 21-38.
21. H.-U. KÜENLE AND R. SCHURATH, The optimality equation and ε-optimal strategies in Markov games with average reward criterion, Math. Methods Oper. Res., 56 (2003), pp. 439-449.
22. A. MAITRA AND W. SUDDERTH, Borel stochastic games with limsup payoffs, Ann. Probab., 21 (1993), pp. 861-885.
23. S. P. MEYN AND R. L. TWEEDIE, Markov Chains and Stochastic Stability, Springer-Verlag, New York, 1993.
24. S. P. MEYN AND R. L. TWEEDIE, Computable bounds for geometric convergence rates of Markov chains, Ann. Appl. Probab., 4 (1994), pp. 981-1011.
25. E. MICHAEL, Continuous selections I, Ann. Math., 63 (1956), pp. 361-382.
26. J. NEVEU, Mathematical Foundations of the Calculus of Probability, Holden-Day, San Francisco, 1965.
27. A. S. NOWAK, Measurable selection theorems for minimax, stochastic optimization problems, SIAM J. Control Optim., 23 (1985), pp. 466-476.
28. A. S. NOWAK, Semicontinuous nonstationary stochastic games, J. Math. Anal. Appl., 117 (1986), pp. 84-99.
29. A. S. NOWAK, Zero-sum average payoff stochastic games with general state space, Games and Econ. Behavior, 7 (1994), pp. 221-232.
30. A. S. NOWAK, Optimal strategies in a class of zero-sum ergodic stochastic games, Math. Methods Oper. Res., 50 (1999), pp. 399-420.
31. E. NUMMELIN, General Irreducible Markov Chains and Non-Negative Operators, Cambridge University Press, Cambridge, UK, 1983.
32. K. R. PARTHASARATHY, Probability Measures on Metric Spaces, Academic Press, New York, 1967.
33. D. REPOVŠ AND P. V. SEMENOV, Continuous Selections of Multivalued Mappings, Kluwer, Dordrecht, 1998.
34. M. SCHÄL, Average optimality in dynamic programming with general state space, Math. Oper. Res., 18 (1993), pp. 163-172.
35. R. SERFOZO, Convergence of Lebesgue integrals with varying measures, Sankhyā, Ser. A, 44 (1982), pp. 380-402.
36. L. S. SHAPLEY, Stochastic games, Proc. Nat. Acad. Sci. USA, 39 (1953), pp. 1095-1100.
37. H. C. TIJMS, Average reward optimality equation in Markov decision processes, in Probability, Statistics and Optimization: A Tribute to Peter Whittle, F. P. Kelly, ed., Wiley, New York, 1994, pp. 485-495.
38. O. VEGA-AMAYA, Zero-sum average semi-Markov games: Fixed-point solutions of the Shapley equation, SIAM J. Control Optim., 42 (2003), pp. 1876-1894.