Constrained markov decision processes with compact state and action spaces: The average case

Optimization

Volumn 48, Issue 2, 2000, Pages 255-269

  Kurano, Masami ^a   Nakagami, Jun Ichi ^a   Huang, Youqiang ^b  

^a CHIBA UNIVERSITY   (Japan)

^b Hongo OGI BLDG   (Japan)

Author keywords

Average criteria; Compact state and action spaces; Constrained Markov decision processes; Constrained optimal pair; Lagrange technique; Saddle point

Indexed keywords

EID: 0000603299     PISSN: 02331934     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (17)

1. Anderson, E. J. and Nash, P., Linear programming in infinite-dimensional spaces, Wiley, Chichester, England, 1987.
2. Arapostathis, A., Borkar, V. S., Fernandez-Gaucherand, E., Ghosh, M. K. and Marcus, S. I. (1993). Discrete-time Controlled Markov Processes with Average Cost Criterion: A Survey, SIAM J. Control Optim., 31, 282-344.
3. Avriel, M., Nonlinear programming, Analysis and Methods, Prentice-Hall, Inc., 1976.
4. Bertsekas, D. P. and Shreve, S. E., Stochastic optimal control - the discrete time case, Academic press, New York, 1978.
5. Beutler, F. J. and Ross, K. W. (1985). Optimal policies for controlled Markov chains with a constraint, J. Math. Anal. Appl., 112, 236-252.
6. Borkar, V. S., Topics in controlled Markov chains, Pitman Research Notes in Math. No. 240, Longman Scientific and Technical, Harlow, 1991.
7. Borkar, V. S. (1994). Ergodic control of Markov chains with constraints - the general case, SIAM J. Control Optim., 32, 176-186.
8. Brown, L. D. and Purve, R. (1973). Measurable selection of extrema, Ann. Statist., 1, 902-912.
9. Derman, C., Finite state Markovian decision processes, Academic Press, New York, 1970.
10. Doob, J. L., Stochastic processes, John Wiley, New York, 1953.
11. Hernández-Lerma, O. and Lasserre, J. B. (1994). Linear programming and average optimality of Markov control processes on Borel spaces-Unbounded costs, SIAM J. Control Optim., 32, 480-500.
12. Hernández-Lerma, O. and Hernández-Hernández, D. (1994). Discounted cost Markov decision processes on Borel spaces: The linear programming formulation, J. Math. Anal. Appl., 183, 335-351.
13. Hordijk, A. and Lasserre, J. B. (1994). Linear programming formulation of MDPs in countable state space: the multichain case, ZOR-Math. Meth. O.R., 40, 91-108.
14. Kallenberg, L. C. M. (1994). Survey of linear programming for standard and nonstandard Markovian control problems. Part I: Theory, ZOR-Math. Meth. O.R., 40, 1-42.
15. Kurano, M. (1989). The existence of a minimum pair of state and policy for Markov decision processes under the hypothesis of Doeblin, SIAM J. Control Optim., 27, 296-307.
16. Luenberger, D., Optimization by vector space methods, John Wiley, New York, 1969.
17. Parthasarathy, K. R., Probability measure on metric space, Academic Press, New York, 1967.