Continuity of the value of competitive Markov decision processes

Journal of Theoretical Probability

Volumn 16, Issue 4, 2003, Pages 831-845

  Solan, Eilon ^a,b  

^a NORTHWESTERN UNIVERSITY   (United States)

^b TEL AVIV UNIVERSITY   (Israel)

Author keywords

Competitive Markov decision process; Sensitivity analysis; Stochastic games; Value

Indexed keywords

EID: 3543025168     PISSN: 08949840     EISSN: None     Source Type: Journal    
DOI: 10.1023/B:JOTP.0000011995.28536.ef     Document Type: Article

References (14)

1. Amir, R. (1987). Sequential Games of Resource Extraction: Existence of Nash Equilibrium, Cowles Foundation D.P. #825.
2. Arapostathis, A., Borkar, V. S., Fernández-Gaucherand, E., Ghosh, M. K., and Marcus, S. I. (1993). Discrete-time controlled Markov processes with average cost criterion: A survey. SIAM J. Control Optim. 31, 282-344.
3. Bewley, T., and Kohlberg, E. (1976). The asymptotic theory of stochastic games. Math. Oper. Res. 1, 197-208.
4. Catoni, O. (1999). Simulated Annealing Algorithms and Markov Chains with Rare Transitions, Séminaire de Probabilités, XXXIII, 69-119, Lecture Notes in Mathematics, 1709, Springer, Berlin.
5. Filar, J. A. (1985). Player aggregation in the traveling inspector model, IEEE Trans. Automatic Control AC-30, 723-729.
6. Filar, J. A., and Vrieze, K. (1997). Competitive Markov Decision Processes, Springer-Verlag, New York.
7. Freidlin, M. I., and Wentzell, A. D. (1984). Random Perturbations of Dynamical Systems, Springer-Verlag, Berlin.
8. Levhari, D., and Mirman, L. (1980). The great fish war: An example using a dynamic Cournot-Nash solution. Bell J. Econ. 11, 322-334.
9. Mertens, J. F., and Neyman, A. (1981). Stochastic games. Int. J. Game theory 10, 53-66.
10. Milman, E. (2002). The semi-algebraic theory of stochastic games. Math. Oper. Res. 27, 401-418.
11. Schweizer, P. J. (1968). Perturbation theory and finite Markov chains. J. Applied Probab. 5, 401-413.
12. Shapley, L. S. (1953). Stochastic games. Proc. Nat. Acad. Sci. U.S.A. 39, 1095-1100.
13. Sorin, S. (2002). A First Course on Zero-Sum Repeated Games, Mathématiques et Applications, Vol. 37, Springer-Verlag, Berlin.
14. Winston, W. (1978). A stochastic game model of a weapons development competition. SIAM J. Control Optim. 16, 411-419.