Optimization Models for the First Arrival Target Distribution Function in Discrete Time

Journal of Mathematical Analysis and Applications

Volumn 225, Issue 1, 1998, Pages 193-223

  Yu, Stella X ^b   Lin, Yuanlie ^a   Yan, Pingfan ^b  

^a TSINGHUA UNIVERSITY   (China)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0040685640     PISSN: 0022247X     EISSN: None     Source Type: Journal    
DOI: 10.1006/jmaa.1998.6015     Document Type: Article

References (23)

1. White D. J. Mean, Variance and probabilistic criteria in finite Markov decision processes: A review. J. Optim. Theory Appl. 56:1988;1-29.
2. Howard R. A., Matheson J. E. Risk-sensitive Markov decision processes. Management Sci. 8:1972;356-369.
3. Derman C., Ignall E. On the stochastic ordering of Markov chains. Oper. Res. 23:1975;574-576.
4. Ross S. M. Stochastic Processes. 1983;Wiley, New York.
5. Stoyan D. Comparison Methods for Queues and Stochastic Models. 1983;Wiley, New York.
6. Chung Kun-Jen, Sobel Matthew J. Discounted MDPs distribution functions and exponential utility maximization. SIAM J. Control Optim. 25:1987;49-62.
7. Lin Yuanlie, Tomkins R. J., Wang Chunglie. Optimal models for the first arrival time distribution function in continuous time - a special case. Acta Math. Appl. Sinica. 10:1994;194-212.
8. Zhang Wanqi, Jiang Qiyuan, Lin Yuanlie. Reliability-constrained Markov decision programming and penalty factor method. J. Tsinghua Univ. 23:1983;61-71.
9. Yuanlie, Lin, Qiyuan, Jiang, Three problems of applying Markov decision programming to the optimal regulation of hydropower station reservoirs, in, China-Japan Symposium on Statistics, Beijing, China, 1984, 143-147.
10. Bauakiz M., Kiber Y. Target-level criterion in Markov decision processes. J. Optim. Appl. 86:1995;1-15.
11. Filar J. A. Percentiles and Markov decision processes. Oper. Res. Lett. 2:1983;13-15.
12. Filar J. A., Krass D., Ross K. W. Percentile performance criteria for limiting average Markov decision processes. IEEE Trans. Automat. Control. 40:1995;2-9.
13. White D. J. Minimizing a threshold probability in discounted Markov decision processes. J. Math. Anal. Appl. 173:1993;634-646.
14. Grandell J. Aspects of Risk Theory. 1991;Springer-Verlag, Berlin/New York.
15. Jianxing, Lin, A Study of Models for Markov Decision Programming in Discrete Time, Department of Applied Mathematics, Tsinghua Univ. Beijing, 1987.
16. Lin Yuanlie, Tomkins R. J., Wang Chunglie. Optimal models for the first arrival time distribution function in continuous time. Proc. APORS'91. 14:1991;292-299.
17. Lin Yuanlie, Lin Jianxing. Models for the first arrival time distribution function optimization and risk minimization. 53-59. J. Tsinghua Univ. 36:1995.
18. Kushner Harold J., Dupuis G. Numerical Methods for Stochastic Control Problems in Continuous Time. 1992;Springer-Verlag, New York.
19. Lin Yuanlie. Continuous time first arrival target models. I. Discounted moment optimal models. ACTA Math. Appl. Sinica. 14:1991;116-124.
20. Lin Yuanlie. Optimal models for the first arrival target in continuous time. II. L optimal problems. J. Tsinghua Univ. 33:1993;1-9.
21. Yuanlie, Lin, Xingxing, Yu, Jianxing, Lin, Models for first arrival target distribution function optimization and risk minimization in discrete time, in, Operations Research and Its Applications, First International Symposium, ISORA'95, Beijing, August 1995 Proceedings, 368, 375.
22. Xingxing, Yu, Research on Joint Delay-Filter Identification and Reinforcement Learning Control Models, Department of Automation, Tsinghua Univ. Beijing, 1996.
23. Blackwell David. Discrete dynamic programming. Ann. Statist. 33:1962;719-726.