On mean reward variance in semi-Markov processes

Mathematical Methods of Operations Research

Volumn 62, Issue 3, 2005, Pages 387-397

  Sladký, Karel ^a  

^a INSTITUTE OF INFORMATION THEORY AND AUTOMATION   (Czech Republic)

Author keywords

[No Author keywords available]

Indexed keywords

ASYMPTOTIC STABILITY; DISCRETE TIME CONTROL SYSTEMS; EMBEDDED SYSTEMS; RECURSIVE FUNCTIONS;

GROWTH RATE; SEMI-MARKOV PROCESSES;

MARKOV PROCESSES;

EID: 28544436552     PISSN: 14322994     EISSN: 14325217     Source Type: Journal    
DOI: 10.1007/s00186-005-0039-z     Document Type: Conference Paper

References (16)

1. Benito F (1982) Calculating the variance in Markov processes with random reward. Trabajos Estadistica Investigacion Operativa 33:73-85
2. Filar J, Kallenberg LCM, Lee H-M (1989) Variance penalized Markov decision processes. Math Oper Res 14:147-161
3. Huang Y, Kallenberg LCM (1994) On finding optimal policies for Markov decision chains: a unifying framework for mean-variance-tradeoffs. Math Oper Res 19:434-448
4. Jaquette SC (1972) Markov decision processes with a new optimality criterion: small interest rates. Ann Math Stat 43:1894-1901
5. Jaquette SC (1973) Markov decision processes with a new optimality criterion: discrete time. Ann Statist 1:496-505
6. Jaquette SC (1975) Markov decision processes with a new optimality criterion: continuous time. Ann Stat 3:547-553
7. Kadota Y (1997) A minimum average-variance in Markov decision processes. Bull Inform Cybern 29:83-89
8. Kawai H (1987) A variance minimization problem for a Markov decision process. Eur J Oper Res 31:140-145
9. Kurano M (1987) Markov decision processes with a minimum-variance criterion. J Math Anal Appl 123:572-583
10. Mandl P (1971) On the variance in controlled Markov chains. Kybernetika 7:1-12
11. Puterman ML (1994) Markov decision processes-discrete stochastic dynamic programming. Wiley, New York
12. Ross SM (1970) Applied probability models with optimization applications. Holden-Day, San Francisco
13. Sladký K, Sitař M (2004) Optimal solutions for undiscounted variance penalized Markov decision chains. In: Marti K, Ermoliev Y, Pflug G (eds) Dynamic stochastic optimization. Springer, Berlin Heidelberg New York, pp 43-66
14. Sobel MJ (1982) The variance of discounted Markov decision processes. J Appl Probab 19:794-802
15. Sobel MJ (1985) Maximal mean/standard deviation ratio in an undiscounted MDP. Oper Res Lett 4:157-159
16. White DJ (1988) Mean variance and probability criteria in finite Markov decision processes: a review. J Optim Theory Appl 56:1-29