On the equivalence of two expected average cost criteria for semi-Markov control processes

Mathematics of Operations Research

Volumn 29, Issue 2, 2004, Pages 326-338

  Jaskiewicz A ^a  

^a WROCLAW UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

Average cost optimality equation; Borel state space; Semi Markov control models

Indexed keywords

EQUIVALENCE CLASSES; MATHEMATICAL MODELS; OPTIMIZATION; PROBABILITY; STATE SPACE METHODS; STOCHASTIC CONTROL SYSTEMS;

AVERAGE COST OPTIMALITY EQUATION; BOREL STATE SPACE; SEMI-MARKOV CONTROL MODELS;

MARKOV PROCESSES;

EID: 4043062801     PISSN: 0364765X     EISSN: None     Source Type: Journal    
DOI: 10.1287/moor.1030.0060     Document Type: Article

References (24)

1. Bertsekas, D. P., S. E. Shreve. 1978. Stochastic Optimal Control: The Discrete Time Case. Academic Press, New York.
2. Blackwell, D. 1948. A renewal theorem. Duke Math. J. 15 145-150.
3. Brown, L. D., R. Purves. 1973. Measurable selections of extrema. Ann. Statist. 1 902-912.
4. Feinberg, E. A. 1994. Constrained semi-Markov decision processes with average rewards. Math. Methods Oper. Res. 39 257-288.
5. Hernández-Lerma, O., J. B. Lasserre. 1999. Further Topics on Discrete-Time Markov Control Process. Springer-Verlag, New York.
6. Hernández-Lerma, O., F. Luque-Vásquez. 1999. Semi-Markov control models with average costs. Applicationes Mathematicae 26 315-331.
7. Jaśkiewicz, A. 2001. An approximation approach to ergodic semi-Markov control processes. Math. Methods Oper. Res. 54 1-19.
8. Jaśkiewicz, A. 2002. Zero-sum semi-Markov games. SIAM J. Control Optim. 41 723-739.
9. Maitra, A. P., W. D. Sudderth. 1996. Discrete Gambling and Stochastic Games. Springer-Verlag, New York.
10. Meyn, S. P., R. L. Tweedie. 1993. Markov Chains and Stochastic Stability. Springer-Verlag, New York.
11. Meyn, S. P., R. L. Tweedie. 1994. Computable bounds for geometric convergence rates of Markov chains. Ann. Appl. Probab. 4 981-1011.
12. Mine, H., S. Osaki. 1970. Markovian Decision Processes. Elsevier, New York.
13. Neveu, J. 1965. Mathematical Foundations of the Calculus of Probability. Holden-Day, San Francisco, CA.
14. Neveu, J. 1975. Discrete-Parameter Martingales. Elsevier, New York.
15. Nowak, A. S. 1985. Universally measurable strategies in zero-sum stochastic games. Ann. Probab. 13 269-287.
16. Nowak, A. S. 2000. Some remarks on equilibria in semi-Markov games. Applicationes Mathematicae 27 385-394.
17. Nowak, A. S., E. Altman. 2002. ε-Equilibria for stochastic games with uncountable state space and unbounded costs. SIAM J. Control Optim. 40 1821-1839.
18. Puterman, L. M. 1994. Markov Decision Processes. John Wiley, New York.
19. Ross, S. M. 1970. Applied Probability Models with Optimization Applications. Holden-Day, San Francisco, CA.
20. Schäl, M. 1992. On the second optimality equation for semi-Markov decision models. Math. Oper. Res. 17 470-486.
21. Sennott, L. I. 1989. Average cost semi-Markov decision processes and the control of queueing system. Probab. Engrg. and Inform. Sci. 3 247-272.
22. Strauch, R. E. 1966. Negative dynamic programming. Ann. Statist. 37 871-890.
23. Yushkevich, A. 1981. On semi-Markov controlled models with an average reward criterion. Theory Probab. Appl. 26 796-803.
24. Vega-Amaya, O., F. Luque-Vásquez. 2000. Sample-path average cost optimality for semi-Markov control processes on Borel spaces: Unbounded