Weak convergence and fluid limits in optimal time-to-empty Queueing control problems

Applied Mathematics and Optimization

Volumn 64, Issue 3, 2011, Pages 339-362

  Day, Martin V ^a  

^a VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

Author keywords

Fluid limit; Optimal control; Queueing; Relaxed controls

Indexed keywords

BOUNDEDNESS; BOUNDEDNESS PROPERTIES; CONTROL PROBLEMS; EQUICONTINUITY; FLUID LIMITS; OPTIMAL CONTROL PROBLEM; OPTIMAL CONTROLS; OPTIMAL VALUE FUNCTIONS; OPTIMAL VALUES; QUEUE LENGTHS; QUEUEING; QUEUEING CONTROL; RELAXED CONTROL; RESCALING; ROUTING PROBABILITIES; RUNNING COST; SEMICONTINUOUS VISCOSITY; STOCHASTIC CONTROL; SUFFICIENT CONDITIONS; WEAK CONVERGENCE;

OPTIMAL CONTROL SYSTEMS; QUEUEING THEORY;

PROCESS CONTROL;

EID: 84871507166     PISSN: 00954616     EISSN: 14320606     Source Type: Journal    
DOI: 10.1007/s00245-011-9144-y     Document Type: Article

References (24)

1. Bardi, M., Cappuzzo-Dolcetta, I.: Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations. Birkhäuser, Boston (1997)
2. Bäuerle, N.: Asymptotic optimality of tracking policies in stochastic networks. Ann. Appl. Probab. 10, 1065-1083 (2000)
3. Billingsley, P.: Convergence of Probability Measures. Wiley, New York (1968)
4. Brémaud, P.: Point Processes and Queues: Martingale Dynamics. Springer, New York (1981)
5. Chen, W., Huang, D., Kulkarni, A., Unnikrishnan, J., Zhu, Q., Mehta, P., Meyn, S., Wierman, A.: Approximate dynamic programming using fluid and diffusion approximations with applications to power management. In: Proceedings of the 48th IEEE Conf. on Decision and Control, December 2009, pp. 3575-3580 (2009)
6. Dai, J.G.: On positive Harris recurrence of multiclass queueing networks: a unified approach via fluid limit models. Ann. Appl. Probab. 5, 49-77 (1995)
7. Dai, J.G., Lin, W.: Maximum pressure policies in stochastic processing networks. Oper. Res. 53, 197-218 (2005)
8. Dai, J.G., Meyn, S.P.: Stability and convergence of moments for multiclass queueing networks via fluid limit models. IEEE Trans. Autom. Control 40, 1889-1904 (1995)
9. Dai, J.G., Weiss, G.: Stability and instability of fluid models for certain reentrant lines. Math. Oper. Res. 21, 115-134 (1996)
10. Dupuis, P., Atar, R., Shwartz, A.: An escape-time criterion for queueing networks: asymptotic risksensitive control via differential games. Math. Oper. Res. 28, 801-835 (2003)
11. Dupuis, P., Ishii, H.: On Lipschitz continuity of the solution mapping to the Skorokhod problem, with applications. Stoch. Stoch. Rep. 35, 31-62 (1991)
12. Dupuis, P., Ramanan, K.: Convex duality and the Skorokhod problem, I and II. Probab. Theory Relat. Fields 115, 153-195 (1999) also pp. 197-236
13. Ethier, S.N., Kurtz, T.G.: Markov Processes: Characterization and Convergence. Wiley, New York (1986)
14. Fleming, W.H., Soner, H.M.: Controlled Markov Processes and Viscosity Solutions. Springer, New York (1993)
15. Jacod, J.: Multivariate point processes: predictable projection, Radon-Nikodym derivatives, representation of martingales. Z. Wahrscheinlichkeitstheor. Verw. Geb. 31, 235-253 (1975)
16. Kushner, H.J.: Heavy Traffic Analysis of Controlled Queueing and Communication Networks. Springer, New York (2001)
17. Meyn, S.P.: Stability and asymptotic optimality of generalized MaxWeight policies. SIAM J. Control Optim. 47, 3259-3294 (2009)
18. Meyn, S.P.: Control Techniques for Complex Networks. Cambridge Univ. Press, New York (2008)
19. Meyn, S.P.: Workload models for stochastic networks: value functions and performance evaluation. IEEE Trans. Autom. Control 50, 1106-1122 (2005)
20. Meyn, S.P.: The policy iteration algorithm for average rewardMarkov decision processes with general state space. IEEE Trans. Autom. Control 42, 1663-1680 (1997)
21. Meyn, S.P.: Stability and optimization of queueing networks and their fluid models. In: Mathematics of Stochastic Manufacturing Systems, pp. 175-199. AMS, Providence (1997)
22. Nazarathy, Y., Weiss, G.: Near optimal control of queueing networks over a finite time horizon. Ann. Oper. Res. 170, 233-249 (2005)
23. Pang, G., Day, M.V.: Fluid limits of optimally controlled queueing networks. J. Appl. Math. Stoch. Anal. 2007, 68958 (2007) (Available at http://www.hindawi.com/journals/ijsa/2007/068958.abs.html)
24. Rogers, L.C.G., Williams, D.: Diffusions, Markov Processes and Martingales, 2nd edn. Cambridge Univ. Press, Cambridge (2000)