Performance optimization of queueing systems with perturbation realization

European Journal of Operational Research

Volumn 218, Issue 2, 2012, Pages 293-304

  Xia, Li ^a   Cao, Xi Ren ^b,c  

^a KING ABDULLAH UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Saudi Arabia)

^b SHANGHAI JIAO TONG UNIVERSITY   (China)

^c HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

Performance potential; Perturbation analysis; Perturbation realization factors; Queueing; Sensitivity based optimization

Indexed keywords

QUEUEING NETWORKS;

PERFORMANCE POTENTIALS; PERTURBATION ANALYSIS; PERTURBATION REALIZATION FACTORS; QUEUEING; SENSITIVITY-BASED OPTIMIZATIONS;

QUEUEING THEORY;

EID: 84855678838     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ejor.2011.07.039     Document Type: Article

References (44)

1. D.P. Bertsekas, and J.N. Tsitsiklis Neuro-Dynamic Programming 1996 Athena Scientific Belmont, MA
2. X.R. Cao Convergence of parameter sensitivity estimates in a stochastic experiment IEEE Transactions on Automatic Control 30 1985 834 843
3. X.R. Cao Realization probability in closed Jackson queueing networks and its application Advances in Applied Probability 19 1987 708 738
4. X.R. Cao Realization Probabilities - The Dynamics of Queueing Systems 1994 Springer Verlag New York
5. X.R. Cao A unified approach to Markov decision problems and performance sensitivity analysis Automatica 36 2000 771 774
6. X.R. Cao From perturbation analysis to Markov decision processes and reinforcement learning Discrete Event Dynamic Systems: Theory and Applications 13 2003 9 39
7. X.R. Cao Basic ideas for event-based optimization of Markov systems Discrete Event Dynamic Systems: Theory and Applications 15 2007 169 197
8. X.R. Cao Stochastic Learning and Optimization - A Sensitivity-Based Approach 2007 Springer New York
9. X.R. Cao, and H.F. Chen Perturbation realization, potentials, and sensitivity analysis of Markov processes IEEE Transactions on Automatic Control 42 1997 1382 1393
10. X.R. Cao, X.M. Yuan, and L. Qiu A single sample path-based performance sensitivity formula for Markov chains IEEE Transactions on Automatic Control 41 1996 1814 1817 (Pubitemid 126767979)
11. C.G. Cassandras, G. Sun, C.G. Panayiotou, and Y. Wardi Perturbation analysis and control of two-class stochastic fluid models for communication networks IEEE Transactions on Automatic Control 48 2003 770 782
12. C.G. Cassandras, Y. Wardi, B. Melamed, G. Sun, and C.G. Panayiotou Perturbation analysis for online control and optimization of stochastic fluid models IEEE Transactions on Automatic Control 47 2002 1234 1248 (Pubitemid 34959758)
13. J.T. Chen Queueing models of certain manufacturing cells under product-mix sequencing rules European Journal of Operational Research 188 2008 826 837
14. M.C. Fu, and J.Q. Hu Smoothed perturbation analysis derivative estimation for Markov chains Operations Research Letters 15 1994 241 251
15. M.C. Fu, and J.Q. Hu Conditional Monte Carlo: Gradient Estimation and Optimization Applications 1997 Kluwer Academic Publishers Boston
16. P. Glasserman Gradient Estimation via Perturbation Analysis 1991 Kluwer Academic Publishers Boston, MA
17. P. Glasserman, and W.B. Gong Smoothed perturbation analysis for a class of discrete event system IEEE Transactions on Automatic Control 35 1990 1218 1230
18. W.B. Gong, and Y.C. Ho Smoothed (conditional) perturbation analysis for discrete event dynamic systems IEEE Transactions on Automatic Control 32 1987 858 866
19. W.J. Gordon, and G.F. Newell Closed queueing systems with Exponential Servers Operations Research 15 1967 252 265
20. P. Heidelberger, X.R. Cao, M.A. Zazanis, and R. Suri Convergence properties of infinitesimal perturbation analysis estimates Management Science 34 1989 1281 1302
21. B. Heidergott Optimisation of a single-component maintenance system: a smoothed perturbation analysis approach European Journal of Operational Research 119 1998 181 190 (Pubitemid 30510477)
22. B. Heidergott Customer-oriented finite perturbation analysis for queueing networks Discrete Event Dynamic Systems: Theory and Applications 10 2000 201 232
23. Y.C. Ho, and X.R. Cao Perturbation analysis and optimization of queueing networks Journal of Optimization Theory and Applications 40 1983 559 582 (Pubitemid 14449623)
24. Y.C. Ho, and X.R. Cao Perturbation Analysis of Discrete Event Systems 1991 Kluwer Academic Publishers. Norwell
25. Y.C. Ho, X.R. Cao, and C.G. Cassandras Infinitesimal and finite perturbation analysis for queueing networks Automatica 19 1983 439 445 (Pubitemid 13605663)
26. Y.M. Kitaev, and V.V. Rykov Controlled Queueing Systems 1995 CRC Press New York
27. Q.L. Li Constructive Computation in Stochastic Models with Applications: The RG-Factorizations 2010 Springer and Tsinghua Press
28. Y. Liu, and W.B. Gong Perturbation analysis for stochastic fluid queueing systems Discrete Event Dynamic Systems: Theory and Applications 12 2002 391 416
29. D.J. Ma, and X.R. Cao A direct approach to decentralized control of service rates in a closed Jackson network IEEE Transactions on Automatic Control 39 1994 1460 1463
30. P. Marbach, O. Mihatsch, and J.N. Tsitsiklis Call admission control and routing in integrated services networks using neuro-dynamic programming IEEE Journal On Selected Areas In Communications 18 2000 197 208 (Pubitemid 30584805)
31. P. Marbach, and J.N. Tsitsiklis Simulation-based optimization of Markov reward processes IEEE Transactions on Automatic Control 46 2001 191 209 (Pubitemid 32259323)
32. C. Panayiotou, and C.G. Cassandras Infinitesimal perturbation analysis and optimization for make-to-stock manufacturing systems based on stochastic fluid models Discrete Event Dynamic Systems: Theory and Applications 16 2006 109 142 (Pubitemid 43261386)
33. M.L. Puterman Markov Decision Processes: Discrete Stochastic Dynamic Programming 1994 John Wiley & Sons New York
34. J.A. Rappold, and B.D.V. Roo Designing multi-echelon service parts networks with finite repair capacity European Journal of Operational Research 199 2009 781 792
35. L.I. Sennott Stochastic Dynamic Programming and the Control of Queueing Systems 1999 Wiley New York
36. S. Stidham, and R. Weber A survey of Markov decision models for control of networks of queues Queueing systems 13 1993 291 314
37. Y. Wardi, B. Melamed, C.G. Cassandras, and C.G. Panayiotou Online IPA gradient estimators in stochastic continuous fluid models Journal of Optimization Theory and Applications 115 2002 369 405 (Pubitemid 39583292)
38. T.V. Woensel, L. Kerbache, H. Peremans, and N. Vandaele Vehicle routing with dynamic travel times: a queueing approach European Journal of Operational Research 186 2008 990 1007 (Pubitemid 350016653)
39. L. Xia, and X.R. Cao Relationship between perturbation realization factors with queueing models and Markov models IEEE Transactions on Automatic Control 51 2006 1699 1704 (Pubitemid 44593676)
40. Xia, L., Cao, X.R., 2006b. Aggregation of perturbation realization factors and service rate-based policy iteration for queueing systems. In: the Proceedings of the 45th IEEE Conference on Decision and Control, San Diego, CA, USA, pp. 1063-1068. (Pubitemid 351283690)
41. L. Xia, X. Chen, and X.R. Cao Policy iteration for customer-average performance optimization of closed queueing systems Automatica 45 2009 1639 1648
42. Xia, L., Shihada, B., submitted for publication. Max-Min optimality of service rate control in closed queueing networks. IEEE Transactions on Automatic Control.
43. D.D. Yao, and Z. Schechner Decentralized control of service rates in a closed Jackson network IEEE Transactions on Automatic Control 34 1989 236 240
44. J. Zhang, and X.R. Cao Continuous-time Markov decision processes with nth-bias optimality criteria Automatica 45 2009 1628 1638