Controlled Markov set-chains under average criteria

Applied Mathematics and Computation

Volumn 120, Issue 1-3, 2001, Pages 195-209

  Hosaka, Masanori ^a   Horiguchi, Masayuki ^a   Kurano, Masami ^a  

^a CHIBA UNIVERSITY   (Japan)

Author keywords

Average reward criterion; Controlled Markov set chains; Interval arithmetic; Minorization condition; Pareto optimal

Indexed keywords

EID: 0035837647     PISSN: 00963003     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0096-3003(99)00241-6     Document Type: Article

References (19)

1. J. Bather Optimal decision procedures for finite Markov chains. Part II: communicating systems Adv. Appl. Prob. 5 1973 521 540
2. D. Blackwell Discrete dynamic programming Ann. Math. Statist. 33 1962 719 726
3. N. Furukawa Characterization of optimal policies in vector-valued Markovian decision process Math. Oper. Res. 5 1980 271 279
4. D.J. Hartfiel Component bounds for Markov set-chain limiting sets J. Statist. Comput. Simulation 38 1991 15 24
5. D.J. Hartfiel E. Seneta The theory of Markov set-chains Adv. Appl. Prob. 26 1994 947 964
6. D.J. Hartfiel Markov Set-Chains 1998 Springer Berlin
7. O. Hernondex-Lerma Adaptive Markov Control Processes 1989 Springer New York
8. K. Hinderer Foundations of Non-Stationary Dynamic Programming with Discrete Time Parameter 1970 Springer New York
9. M. Hosaka M. Kurano Non-discounted optimal policies in controlled Markov set-chains J. Oper. Res. Jpn. 42 1999 256 267
10. R. Howard Dynamic Programming and Markov Processes 1960 MIT Press Cambridge, MA
11. J.G. Kemeny J.L. Snell Finite Markov-Chains 1960 Van Nostrand New York
12. M. Kurano Markov decision processes with a Borel measurable cost function – the average case Math. Oper. Res. 11 1986 309 320
13. M. Kurano J. Song M. Hosaka Y. Huang Controlled Markov set-chains with discounting J. Appl. Prob. 35 1998 293 302
14. A. Nenmaier New techniques for the analyses of linear interval equations Linear Algebra Appl. 58 1984 273 325
15. M.L. Puterman Markov Decision Processes: Discrete Stochastic Dynamic Programming 1994 Wiley New York
16. E. Seneta Non-negative Matrices and Markov Chains 1981 Springer New York
17. J. Song M. Hosaka M. Kurano A span seminorm approach to controlled Markov set-chains Bull. Ed. Chiba Univ. 46 3 1998 13 23
18. Y. Takahashi A weak D -Markov chain approach to tandem queueing network G. Iazeolla P.J. Courtois A. Hordijk Mathematical Computer Performance and Reliability 1998 North-Holland Amsterdam 151 159
19. D.J. White Multi-objective unfinite-horizon discounted Markov decision processes J. Math. Anal. Appl. 89 1982 639 647