Envelopes of sets of measures, tightness, and Markov control processes

Applied Mathematics and Optimization

Volumn 40, Issue 3, 1999, Pages 377-392

  Gonzalez Hernandez J ^a   Hernandez Lerma O ^b  

^a UNIVERSIDAD NACIONAL AUTÓNOMA DE MÉXICO   (Mexico)

^b DEPARTAMENTO DE FÍSICA   (Mexico)

Author keywords

[No Author keywords available]

Indexed keywords

CONTROL SYSTEM ANALYSIS; MARKOV PROCESSES; OPTIMAL CONTROL SYSTEMS;

MARKOV CONTROL PROCESSES;

DISCRETE TIME CONTROL SYSTEMS;

EID: 0345073172     PISSN: 00954616     EISSN: None     Source Type: Journal    
DOI: 10.1007/s002459900131     Document Type: Article

References (23)

1. Ash RB (1972) Real Analysis and Probability. Academic Press, New York
2. Balder EJ (1989) On compactness of the space of policies in stochastic dynamic programming. Stochastic Process Appl 32: 141-150
3. Balder EJ (1995) Lectures on Young Measures. Cahiers de Mathématiques de la Décision, CEREMADE, Université Paris IX-Dauphine, Paris
4. Bhatt AG, Borkar VS (1996) Occupation measures for controlled Markov processes: characterization and optimality. Ann Probab 24: 1531-1562
5. Billingsley P (1968) Convergence of Probability Measures. Wiley, New York
6. Bourbaki N (1969) Intégration, Chap. IX, Hermann, Paris
7. Doob JL (1994) Measure Theory. Springer-Verlag, New York
8. Dynkin EB, Yushkevich AA (1979) Controlled Markov Processes. Springer-Verlag, New York
9. Fleming WH, Vermes D (1989) Convex duality approach to the optimal control of diffusions. SIAM J Control Optim 27: 1136-1155
10. Hernández-Hernández D, Hernández-Lerma O, Taksar M (1996) The linear programming approach to deterministic optimal control problems. Appl Math (Warsaw) 24: 17-33
11. Hernández-Lerma O, Lasserre JB (1996) Discrete-Time Markov Control Processes: Basic Optimality Criteria. Springer-Verlag, New York
12. Hernández-Lerma O, Lasserre JB (1996) An extension of the Vitali-Hahn-Saks theorem. Proc Amer Math Soc 124: 3673-3676; (1998) correction, ibid 126: 949
13. Hinderer K (1970) Foundations of Non-Stationary Dynamic Programming with Discrete Time Parameter, Lecture Notes Oper Res Math Syst 33. Springer-Verlag, Berlin
14. Kawabe J (1994) A criterion for weak compactness of measures on product spaces with applications. Yokohama Math J 42: 159-169
15. Kurano M, Kawai M (1994) Existence of optimal stationary policies in discounted decision processes: approaches by occupation measures. Comput Math Appl 27: 95-101
16. Luque-Vásquez F, Robles Alcaraz MT (1994) Controlled semi-Markov models with discounted unbounded costs. Bol Soc Mat Mexicana 39: 51-68
17. Mascolo E, Migliaccio L (1989) Relaxation methods in control theory. Appl Math Optim 20: 97-103
18. Reus C, Jens P (1976) Submeasures and the Problem on the Existence of Control Measures, pp. 49-51. Lecture Notes Math 541. Springer-Verlag, Berlin
19. Rogers CA (1986) Probability measures on compact sets. Proc London Math Soc 52: 328-348
20. Royden HL (1968) Real Analysis, 2nd edn. Macmillan, New York
21. Rubio JE (1995) The global control of nonlinear diffusion equations. SIAM J Control Optim 33: 308-322
22. Schäl M (1975) On dynamic programming: compactness of the space of policies. Stochastic Process Appl 3: 345-364
23. Yushkevich AA (1995) Compactness of a measure space in dynamic programming revisited. Technical Report #95-2, Department of Mathematics, University of North Carolina, Charlotte, NC 28223