Heavy traffic convergence of a controlled, multiclass queueing system

SIAM Journal on Control and Optimization

Volumn 34, Issue 6, 1996, Pages 2133-2171

  Martins, L F ^a   Shreve, S E ^b   Soner, H M ^b  

^a CLEVELAND STATE UNIVERSITY   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Brownian networks; Heavy traffic; Queueing; Stochastic control; Viscosity solutions

Indexed keywords

BROWNIAN MOVEMENT; CONTROL; CONTROL THEORY; DIFFUSION; STOCHASTIC CONTROL SYSTEMS;

BROWNIAN NETWORKS; HEAVY TRAFFIC; VISCOSITY SOLUTIONS;

QUEUEING THEORY;

EID: 0030291550     PISSN: 03630129     EISSN: None     Source Type: Journal    
DOI: 10.1137/S0363012994265882     Document Type: Article

References (30)

1. G. BARLES AND B. PERTHAME (1988), Exit time problems in control and vanishing viscosity solutions of Hamilton-Jacobi-Bellman equations, SIAM J. Control Optim., 26, pp. 1113-1148.
2. H. CHEN, P. YANG, AND D. YAO (1991), Control and Scheduling in a Two-Station Queueing Network: Optimal Policies and Heuristics, preprint.
3. K. L. CHUNG (1960), Markov Chains with Stationary Transition Probabilities, Springer-Verlag, New York.
4. M. G. CRANDALL AND P.-L. LIONS (1984), Viscosity solutions of Hamilton-Jacobi equations, Trans. Amer. Math. Soc., 277, pp. 1-43.
5. M. G. CRANDALL, L. C. EVANS, AND P.-L. LIONS (1984), Some properties of viscosity solutions of Hamilton-Jacobi equations, Trans. Amer. Math. Soc., 282, pp. 487-502.
6. M. G. CRANDALL, H. ISHII, AND P.-L. LIONS (1992), User's guide to viscosity solutions of second order partial differential equations, Bull. Amer. Math. Soc., 27, pp. 1-67.
7. J. DAI AND T. KURTZ (1995), A multi-class station with Markovian feedback in heavy traffic, Math. Oper. Res., 20, pp. 721-742.
8. W. H. FLEMING AND H. M. SONER (1993), Controlled Markov Processes and Viscosity Solutions, Springer-Verlag, New York.
9. D. GILBARG AND N. TRUDINGER (1977), Elliptic Partial Differential Equations of Second Order, Springer-Verlag, New York.
10. J. M. HARRISON (1985), Brownian Motion and Stochastic Flow Systems, Wiley, New York.
11. _ (1988), Brownian models of queueing networks with heterogeneous customer populations, in Stochastic Differential Systems, Stochastic Control Theory and Applications, IMA Vol. Math. Appl. 10, P.-L. Lions and W. H. Fleming, eds., Springer-Verlag, New York, pp. 265-280.
12. J. M. HARRISON AND L. M. WEIN (1989), Scheduling networks of queues: Heavy traffic analysis of a simple open network, Queueing Systems Theory Appl., 5, pp. 265-280.
13. _ (1990), Scheduling networks of queues: Heavy traffic analysis of a two-station closed network, Oper. Res., 38, pp. 1052-1064.
14. D. IGLEHART AND W. WHITT (1970), Multiple channel queues in heavy traffic I, II, Adv. in Appl. Probab., 2, pp. 150-177, 355-364.
15. D. P. JOHNSON (1983), Diffusion Approximations for Optimal Filtering of Jump Processes and Queueing Networks, Ph.D. dissertation, University of Wisconsin, Madison, WI.
16. E. V. KRICHAGINA, S. X. C. LOU, S. SETHI, AND M. TAKSAR (1993), Production control in a failure-prone manufacturing system: Diffusion approximation and asymptotic optimality, Ann. Appl. Probab., 3, pp. 421-453.
17. E. V. KRICHAGINA, S. X. C. LOU, AND M. TAKSAR (1994), Double band policy for stochastic manufacturing systems in heavy traffic, Math. Oper. Res., 19, pp. 560-596.
18. H. J. KUSHNER AND F. L. MARTTNS (1990), Routing and singular control for queueing networks in heavy traffic, SIAM J. Control Optim., 28, pp. 1209-1233.
19. _ (1991), Limit Theorems for Pathwise Average per Unit Time Problems in Heavy Traffic, preprint.
20. _ (1996), Heavy traffic analysis of a controlled multi-class queueing network via weak convergence methods, SIAM J. Control Optim., 34, pp. 1781-1797.
21. H. KUSHNER AND K.M. RAMACHANDRAN (1988), Nearly optimal singular controls for wideband noise driven systems, SIAM J. Control Optim., 26, pp. 569-591.
22. H. KUSHNER AND K. M. RAMACHANDRAN (1989), Optimal and approximately optimal control problems for queues in heavy traffic, SIAM J. Control Optim., 27, pp. 1293-1318.
23. N. C. LAWS (1992), Resource pooling in queueing networks with dynamic routing, Adv. in Appl. Probab., 24, pp. 699-726.
24. N. C. LAWS AND G. M. LOUTH (1990), Dynamic scheduling of a four-station queueing network, Probab. Engrg. Inform. Sci., 4, pp. 131-156.
25. W. P. PETERSON (1990), A heavy traffic limit theorem for networks of queues with multiple customer types, Math. Oper. Res., 16, pp. 90-118.
26. M. REIMAN (1984), Open queueing networks in heavy traffic, Math. Oper. Res., 9, pp. 441-458.
27. _ (1988), A multiclass feedback queue in heavy traffic, Adv. in Appl. Probab., 20, pp. 179-207.
28. L. WEIN (1990a), Optimal control of a two-station Brownian network, Math. Oper. Res., 15, pp. 215-242.
29. _ (1990b), Scheduling of network queues: Heavy traffic analysis of a two-station network with controllable inputs, Oper. Res., 38, pp. 1065-1078.
30. _ (1992), Scheduling of network queues: Heavy traffic analysis of a multistation network with controllable inputs, Oper. Res., 40, pp. S312-S334.