Denumerable state continuous time Markov decision processes with unbounded cost and transition rates under average criterion

ANZIAM Journal

Volumn 43, Issue 4, 2002, Pages 541-557

  Guo, Xianping ^a   Zhu, Weiping ^b  

^a SUN YAT SEN UNIVERSITY   (China)

^b UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0001675640     PISSN: 14461811     EISSN: None     Source Type: Journal    
DOI: 10.1017/s144618110001213x     Document Type: Article

References (21)

1. W. J. Andson, Continuous time Markov chains (Springer, New York, 1991).
2. J. Bather, "Optimal stationary policies for denumerable Markov chains in continuous time", Adv. Appl. Prob. 8 (1976) 144-158.
3. D. P. Bertsekas, Dynamic programming: deterministic and stochastic models (Prentice-Hall, Englewood Cliffs, NJ, 1987).
4. K. L. Chung, Markov chains with stationary transition probabilities (Springer, Berlin, 1960).
5. Z. Q. Dong, "Continuous time Markov decision programming with average reward criterion-countable state and action space", Scientia Sinica SP ISS(II) (1979) 11-148.
6. J. A. Filar and K. Vrieze, Competitive Markov decision processes (Springer, New York, 1996).
7. M. Haviv and M. L. Puterman, "Bias optimality in controlled queuing systems", J. Appl. Prob. 35 (1998) 16-150.
8. B. Hou, "Continuous-time Markov decision processes programming with polynomial reward", Ph. D. Thesis, Institute of Appl. Math. Academic Sinica, Beijing, 1986.
9. Z. T. Hou and X. P. Guo, Markov decision processes (Science and Technology Press of Hunan, Changsha, China, 1998).
10. R. A. Howard, Dynamic programming and Markov processes (Wiley, New York, 1960).
11. P. Kakuman, "Nondiscounted continuous time Markov decision processes with countable state space", SIAM J. Control 10 (1972) 210-220.
12. M. Lembersky, "On maximal rewards and ε-optimal policies in continuous time Markov decision processes", Ann. Stat. 2 (1974) 159-169.
13. R. L. Miller, "Finite state continuous time Markov decision processes with an infinite planning horizon", J. Math. Anal. Appl. 22 (1968) 552-569.
14. M. L. Puterman, Markov decision processes (John Wiley & Sons, 1994).
15. L. I. Sennott, "Average cost optimal stationary policies in infinite state Markov decision processes with unbounded cost", Oper. Res. 37 (1989) 623-633.
16. L. I. Sennott, "Another set of conditions for average optimality in Markov decision processes", Systems Control Lett. 24 (1995) 147-151.
17. R. Serfozo, "Optimal control of random walks, birth and death processes, and queues", Adv. Appl. Prob. 13 (1981) 61-83.
18. J. S. Song, "Continuous time Markov decision programming with non-uniformly bounded transition rate", Scientia Sinica 12 (1987) 1258-1267.
19. C. B. Wu, "Continuous time Markov decision processes with unbounded reward and non-uniformly bounded transition rate under discounted criterion", Acta Math. Appl. Sinica 20 (1997) 196-208.
20. A. A. Yushkevich and E. A. Feinberg, "On homogeneous Markov model with continuous time and finite or countable state space", Theory, Prob. Appl. 24 (1979) 156-161.
21. S. H. Zheng, "Continuous time Markov decision programming with average reward criterion and unbounded reward rate", Acta Math. Appl. Sinica 7 (1991) 6-16.