Policy iteration for customer-average performance optimization of closed queueing systems

Automatica

Volumn 45, Issue 7, 2009, Pages 1639-1648

  Xia, Li ^a   Chen, Xi ^b   Cao, Xi Ren ^c  

^a IBM CHINA RESEARCH LAB   (China)

^b TSINGHUA UNIVERSITY   (China)

^c HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

Customer average performance; Perturbation analysis; Policy iteration

Indexed keywords

CUSTOMER-AVERAGE PERFORMANCE; CUSTOMER-CENTRIC; DISTRIBUTED SERVICE; NEW DIRECTIONS; NUMERICAL EXPERIMENTS; OPTIMIZATION ALGORITHMS; OPTIMIZATION CRITERIA; PERFORMANCE METRIC; PERFORMANCE OPTIMIZATIONS; PERTURBATION ANALYSIS; POLICY ITERATION; QUEUEING SYSTEM; ROUTING PROBABILITIES; SERVICE RATES; SINGLE SAMPLE; STATE-DEPENDENT; SYSTEM STATE;

CUSTOMER SATISFACTION; DIFFERENCE EQUATIONS; OPTIMIZATION; QUEUEING NETWORKS; QUEUEING THEORY; ROUTING ALGORITHMS;

SALES;

EID: 67349214932     PISSN: 00051098     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.automatica.2009.03.007     Document Type: Article

References (13)

1. Cao X.R. Realization probabilities - The dynamics of queueing systems (1994), Springer Verlag, New York
2. Cao X.R. Basic ideas for event-based optimization of Markov systems. Discrete Event Dynamic Systems: Theory and Applications 15 (2005) 169-197
3. Cao X.R., and Chen H.F. Potentials, perturbation realization, and sensitivity analysis of Markov processes. IEEE Transactions on Automatic Control 42 (1997) 1382-1393
4. Cassandras C., and Lafortune S. Introduction to discrete event systems (1999), Kluwer Academic Publishers, Boston, MA
5. Chen H., and Yao D.D. Fundamentals of queueing networks: Performance, asymptotics, and optimization (2001), Springer Verlag, New York
6. Chong E.K.P., and Zak S.H. An introduction to optimization. 2nd ed. (2001), John Wiley & Sons, New York
7. Glasserman P. Gradient estimation via perturbation analysis (1991), Kluwer Academic Publisher, Norwell, MA
8. Gong W.B., and Ho Y.C. Smoothed (conditional) perturbation analysis of discrete event dynamical systems. IEEE Transactions on Automatic Control 32 (1987) 858-866
9. Gordon W.J., and Newell G.F. Closed queueing systems with exponential servers. Operations Research 15 (1967) 252-265
10. Ho Y.C., and Cao X.R. Perturbation analysis of discrete-event dynamic systems (1991), Kluwer Academic Publisher, Boston, MA
11. Ho Y.C., Cao X.R., and Cassandras C. Infinitesimal and finite perturbation analysis for queueing networks. Automatica 19 (1983) 439-445
12. Puterman M.L. Markov decision processes: Discrete stochastic dynamic programming (1994), John Wiley & Sons, New York
13. Xia L., and Cao X.R. Relationship between perturbation realization factors with queueing models and Markov models. IEEE Transactions on Automatic Control 51 (2006) 1699-1704