Controlled Markov set-chains with discounting

Journal of Applied Probability

Volumn 35, Issue 2, 1998, Pages 293-302

  Kurano, Masami ^a   Song, Jinjie ^a   Hosaka, Masanori ^a   Huang, Youqiang ^a  

^a CHIBA UNIVERSITY   (Japan)

Author keywords

Controlled Markov set chains; Discounted return criterion; Interval arithmetic

Indexed keywords

EID: 0032399375     PISSN: 00219002     EISSN: None     Source Type: Journal    
DOI: 10.1017/S0021900200014959     Document Type: Article

References (14)

1. BERTSEKAS, D.P. AND SHEVE, S.E. (1978). Stochastic Optimal Control: The Discrete Time Case. Academic Press, New York.
2. BLACKWELL, D. (1962). Discrete dynamic programming. Ann. Math. Statist. 33, 719-726.
3. n. Proc. Amer. Math. Soc. 81, 201-206.
4. HARTFIEL, D.J. (1991). Component bounds on Markov set-chain limiting sets. J. Statist. Comput. Simul. 38, 15-24.
5. HARTFIEL, D.J. (1993). Cyclic Markov set-chains. J. Statist. Comput. Simul. 46, 145-167.
6. HARTFIEL, D.J. AND SENETA, E. (1994). On the theory of Markov set-chains. Adv. Appl. Prob. 26, 947-964.
7. HERNANDEZ-LERMA, O. (1989). Adaptive Markov Control Processes. Springer-Verlag, New York.
8. HINDERER, K. (1970). Foundations of Non-Stationary Dynamic Programming with Discrete Time Parameter. Lecture Notes. Oper. Res. Math. Systems 33. Springer-Verlag, New York.
9. HOWARD, R.A. (1960). Dynamic Programming and Markov Processes. MIT Press, Cambridge, MA.
10. KUMAR, P.R. AND VARAIYA, P. (1986). Stochastic Systems: Estimation, Identification and Adaptive Control. Prentice-Hall, Englewood Cliffs, New Jersey.
11. KURATOWSKI, K. (1966). Topology. Academic Press, New York.
12. NEUMAIER, A. (1984). New techniques for the analysis of linear interval equations. Linear Algebra Appl. 58, 273-325.
13. PUTERMAN, M.L. (1994). Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley & Sons, Inc.
14. WHITE, D.J. (1993). Markov Decision Processes. Wiley, Chichester.