Aggregation of perturbation realization factors and service rate-based policy iteration for queueing systems

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2006, Pages 1063-1068

  Xia, Li ^a,b   Cao, Xi Ren ^a,c  

^a IEEE

^b TSINGHUA UNIVERSITY   (China)

^c HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

DIFFERENCE EQUATIONS; OPTIMIZATION; PROBABILITY; ROUTING ALGORITHMS;

DIFFERENCE FORMULAS; PERTURBATION REALIZATION; RATE BASED POLICY;

QUEUEING NETWORKS;

EID: 39649083774     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. J.P. Buzen, "Computational algorithms for closed queueing networks with exponential servers", Communications of the ACM, vol. 16, no. 9, pp. 527-531, 1973.
2. X.R. Cao, Realization Probabilities ?The Dynamics of Queueing Systems, New York: Springer Verlag, 1994.
3. X.R. Cao and H.F. Chen, "Potentials, perturbation realization, and sensitivity analysis of Markov processes", IEEE Transactions on Automatic Control, vol. 42, pp. 1382-1393, 1997.
4. X.R. Cao, "From perturbation analysis to Markov decision processes and reinforcement learning", Discrete Event Dynamic Systems: Theory and Applications, vol. 13, pp. 9-39, 2003.
5. C. G. Cassandras and S. Lafortune, Introduction to Discrete Event Systems, Norwell, MA: Kluwer, 1999.
6. H. Chen and D.D. Yao, Fundamentals of Queueing Networks: Performance, Asymptotics, and Optimization, New York: Springer Verlag, 2001.
7. nd Edition, New York: John Wiley & Sons, 2001.
8. N.V. Dijk, Queueing Networks and Product Forms: A Systems Approach, Chichester: John Wiley & Sons, 1993.
9. W.J. Gordon and G.F. Newell, "Closed queueing systems with Exponential Servers", Operations Research, vol. 15, pp. 252-265, 1967.
10. P. Glasserman, Gradient Estimation via Perturbation Analysis, Norwell, MA: Kluwer, 1991.
11. Y.C. Ho and X.R. Cao, Perturbation Analysis of Discrete-Event Dynamic Systems, Boston: Kluwer, 1991.
12. D.J. Ma and X.R. Cao, "A direct approach to decentralized control of service rates in a closed Jackson network", IEEE Transactions on Automatic Control, vol. 39, pp. 1460-1463, 1994.
13. M.L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, New York: John Wiley & Sons, 1994.
14. D.D. Yao and Z. Schechner, "Decentralized control of service rates in a closed Jackson network", IEEE Transactions on Automatic Control, vol. 34, pp. 236-240, 1989.
15. L. Xia and X.R. Cao, "Relationship between perturbation realization factors with queueing models and Markov models", IEEE Transactions on Automatic Control, 2006, to appear.
16. L. Xia and X.R. Cao, "Parameterized policy iteration of customeraverage performance in queueing systems", technical report (hyperlink at http://cfins.au.tsinghua.edu.cn/personalhg/xiali/paper/ DifferencePA.pdf), 2006.