The average cost optimality equation: A fixed point approach

Boletin de la Sociedad Matematica Mexicana

Volumn 9, Issue 1, 2003, Pages 185-195

  Vega Amaya, Oscar ^a  

^a UNIVERSIDAD DE SONORA   (Mexico)

Author keywords

Banach's fixed point theorem; Discrete time Makov control processes; Expected average cost criterion; Lyapunov conditions

Indexed keywords

EID: 0042326540     PISSN: 1405213X     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (24)

1. A. ARAPOSTATHIS, V.S. BORKAR, E. FERNÁNDEZ-GAUCHERAND, M.K. GHOSH AND S.I. MARCUS, Discrete-time Markov control processes with average cost criterion: a survey, SIAM J. Control Optim. 31 (1993), 282-344.
2. D. P. BERTSEKAS, Dynamic Programming: Deterministic and Stochastic Models, Prentice-Hall, Englewood Cliffs, New Jersey, 1987.
3. J.I. GONZÁLEZ-TREJO, O. HERNÁNDEZ-LERMA, L.F. HOYOS-REYES, Minimax control of discrete-time stochastic systems, SIAM J. Control Optim. 41 (2003), 1626-1659.
4. E. GORDIENKO AND O. HERNÁNDEZ-LERMA, Average cost Markov control processes with weighted norms: existence of canonical policies, Appl. Math. (Warsaw) 23 (1995), 199-218.
5. E. GORDIENKO AND O. HERNANDEZ-LERMA, Average cost Markov control processes with weighted norms: value iteration, Appl. Math. (Warsaw) 23 (1995), 219-237.
6. O. HERNÁNDEZ-LERMA, Adaptive Markov Control Processes, Springer-Verlag, New York, 1989.
7. O. HERNÁNDEZ-LERMA AND J. B. LASSERRE, Discrete-Time Markov Control Process: Basic Optimality Criteria, Springer-Verlag, New York, 1996.
8. O. HERNÁNDEZ-LERMA AND J. B. LASSERRE, Further Topics on Discrete-Time Markov Control Processes, Springer-Verlag, New York, 1999.
9. O. HERNÁNDEZ-LERMA AND J. B. LASSERRE, Further criteria for positive Harris recurrence of Markov chains, Proc. Amer. Math. Soc. 129 (2000), 1521-1524.
10. O. HERNÁNDEZ-LERMA AND J.B. LASSERRE, Zero-sum stochastic games in Borel spaces: average payoff criteria, SIAM J. Control Optim. 39 (2001), 1520-1539.
11. O. HERNÁNDEZ-LERMA, R. MONTES-DE-OCA, R. CAVAZOS-CADENA, Recurrence conditions for MDPs with Borel state space: A survey, Ann. Oper. Res. 28 (1991), 29-46.
12. O. HERNANDEZ-LERMA AND O. VEGA-AMAYA, Infinite-horizon Markov control processes with undiscounted cost criteria: from average to overtaking optimally, Appl. Math. (Warsaw) 25 (1998), 153-178.
13. O. HERNÁNDEZ-LERMA, O. VEGA-AMAYA AND G. CARRASCO, Sample-path optimally and variance-minimization of average cost Markov control processes, SIAM J. Control Optim. 38 (1999), 79-93.
14. A. JÁSKIEWICZ, An approximation approach to ergodic semi-Markov control processes, Math. Methods Oper. Res. 54 (2001), 1-19.
15. A. JÁSKIEWICZ, Zero-sum semi-Markov games, SIAM J. Control Optim. 41 (2002), 723-739.
16. A. JÁSKIEWICZ AND A. NOWAK, On the optimality equation for zero-sum ergodic stochastic games, Math. Methods Oper. Res. 64 (2001), 291-301.
17. F. LUQUE-VÁSQUEZ, Zen-Sum semi-Markov games in Borel spaces: discounted and average payoff, to appear in Bol. Soc. Mat. Mexicana. Available in:http://fractus.mat.uson.mx/̃tedi/reportes.
18. F. LUQUE-VÁSQUEZ AND O. HERNÁNDEZ-LERMA, Semi-Markov control models with average costs, Appl. Math.(Warsaw) 26 (1999), 315-331.
19. S. P. MEYN AND R. L. TWEEDIE, Markov Chains and Stochastic Stability, Springer-Verlag, London, 1993.
20. E. NUMMELIN, General Irreducible Markov Chains and Non-negative Operators, Cambridge University Press, Cambridge, 1983.
21. A. NOWAK, Optimal strategies in a class of zero-sum ergodic stochastic games, Math. Methods Oper. Res. 60 (1999), 399-419.
22. M.L. PUTERMAN, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, New York, 1994.
23. O. VEGA-AMAYA, Zero-sum average semi-Markov games: fixed point solutions ot the Shapley equation, Reporte de Investigatión No. 16, 2002, Depto. Mat., Universidad de Sonora, México. Submitted to SIAM J. Control Optim.
24. O. VEGA-AMAYA AND F. LUQUE-VÁSQUEZ, Sample-path average cost optimally for semi-Markov control processes on Borel spaces: Unbounded costs and mean holding times, Appl. Math. (Warsaw) 27 (2000), 343-367.