Performance optimization of continuous-time Markov control processes based on performance potentials

International Journal of Systems Science

Volumn 34, Issue 1, 2003, Pages 63-71

  Tang, Hao ^a   Xi, Hongsheng ^a   Yin, Baoqun ^a  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; ITERATIVE METHODS; MARKOV PROCESSES; POISSON EQUATION;

ITERATIVE ALGORITHMS;

PROCESS CONTROL;

EID: 0142196586     PISSN: 00207721     EISSN: None     Source Type: Journal    
DOI: 10.1080/0020772031000115641     Document Type: Article

References (10)

1. BALAJI, S., and MEYN, S. P., 2000, Multiplicative ergodicity and large deviations for an irreducible Markov chain. Stochastic Processes and their Applications, 90, 123-144.
2. BERTSEKAS, D. P., 1995, Dynamic Programming and Optimal Control (Belmont: Athena).
3. CAO, X. R., 1998, The relations among potentials, perturbation analysis, and Markov decision processes. Discrete Event Dynamic Systems: Theory and Applications, 8, 71-78.
4. CAO, X. R., 1999, Single sample path-based optimization of Markov chains. Journal of Optimization Theory and Applications, 100, 527-548.
5. CAO, X. R., 2000, A unified approach to Markov decision problems and performance sensitivity analysis. Automatica, 36, 771-774.
6. CAO, X. R., and CHEN, H. F., 1997, Potentials, perturbation realization, and sensitivity analysis of Markov processes. IEEE Transactions on Automatic Control, 42, 1382-1393.
7. GLYNN, P. W., and MEYN, S. P., 1996, A Lyapunov bound for solutions of Poisson's equation. Annals of Probability, 24, 916-931.
8. MEYN, S. P., and TWEEDIE, R. L., 1993, Markov Chains and Stochastic Stability (London: Springer).
9. PUTERMAN, M. L., 1994, Markov Decision Processes: Discrete Stochastic Dynamic Programming (New York: Wiley).
10. ZHOU, Y. P., YIN, B. Q., XI, H. S., TAN, X. B., and SUN, D. M., 2000, Algorithms of decentralized optimization for a class of closed queuing network by using performance potentials. Journal of University of Science and Technology of China, 30, 151-157.