Semi-Markov control processes with unknown holding times distribution under a discounted criterion

Mathematical Methods of Operations Research

Volumn 61, Issue 3, 2005, Pages 455-468

  Luque Vásquez, Fernando ^a   Minjárez Sosa, J Adolfo ^a  

^a UNIVERSIDAD DE SONORA   (Mexico)

Author keywords

Adaptive control; Asymptotic optimality; Discounted cost criterion; Semi Markov control processes

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; ASYMPTOTIC STABILITY; PROCESS CONTROL; STATISTICAL METHODS;

ASYMPTOTIC OPTIMALITY; DISCOUNTED COST CRITERIA; DISCOUNTED COST CRITERION; SEMI-MARKOV CONTROL PROCESS;

MARKOV PROCESSES;

EID: 23744458323     PISSN: 14322994     EISSN: None     Source Type: Journal    
DOI: 10.1007/s001860400406     Document Type: Article

References (15)

1. Ash RB (1972) Real Analysis and Probability. Academic Press, New York
2. Bhattacharya RN, Majumdar M (1989) Controlled semi-Markov models-the discounted case. J. Statist. Plann. Inference, 21:365-381
3. Dynkin EB, Yushkevich AA, (1979) Controlled Markov Processes. Springer-Verlag, New York
4. Gordienko EI, Minjárez-Sosa JA (1998) Adaptive control for discrete-time Markov processes with unbounded costs: discounted criterion. Kybernetika, 34:217-234
5. Hernández-Lerma O, Lasserre JB (1996) Discrete-Time Markov Control Processes: Basic Optimality Criteria. Springer-Verlag, New York
6. Hernández-Lerma O, Lasserre JB (1999) Further Topics on Discrete-Time Markov Control Processes. Springer-Verlag, New York
7. Lippman SA (1973) Semi-Markov decision processes with unbounded rewards. Manag. Sci., 19:717-731
8. Lippman SA (1975) On dynamic programming with unbounded rewards. Management Sci., 21:1225-1233
9. Luque-Vásquez F, Robles-Alcaraz MT (1994) Controlled semi-Markov models with discounted unbounded costs. Bol. Soc. Mat. Mexicana, 39:51-68
10. Puterman ML (1994) Markov Decision Processes. Discrete Stochastic Dynamic Programming. John Wiley & Sons
11. Ross SM (1970) Applied Probability Models with Optimization Applications. Holden-Day San Francisco
12. Schäl M (1975) Conditions for optimality and for the limit of n-stage optimal policies to be optimal. Z. Wahrs. Verw. Gerb., 32:179-196
13. Schäl M (1987) Estimation and control in discounted stochastic dynamic programming. Stochastics, 20:51-71
14. Van Nunen JAEE, Wessels J (1978) A note on dynamic programming with unbounded rewards. Manag. Sci., 24:576-580
15. Vega-Amaya O (1993) Average optimality in semi-Markov control models on Borel spaces: unbounded costs and controls. Bol. Soc. Mat. Mexicana, 38:47-60