Optimal buffer size for a stochastic processing network in heavy traffic

Queueing Systems

Volumn 55, Issue 3, 2007, Pages 147-159

  Ghosh, Arka P ^a   Weerasinghe, Ananda P ^b  

^a Iowa State University   (United States)

^b IOWA STATE UNIVERSITY   (United States)

Author keywords

Diffusion approximations; Dynamic scheduling; Ergodic control; Hamilton Jacobi Bellman equations; Heavy traffic limits; Optimal buffer size; Queueing systems; Stochastic control

Indexed keywords

DYNAMIC PROGRAMMING; ORDINARY DIFFERENTIAL EQUATIONS; QUEUEING NETWORKS; QUEUEING THEORY; STOCHASTIC SYSTEMS; TRAFFIC CONGESTION;

BUFFER SIZES; DIFFUSION APPROXIMATIONS; DYNAMIC SCHEDULING; ERGODIC CONTROL; HAMILTON JACOBI BELLMAN EQUATION; HEAVY TRAFFIC LIMIT; QUEUEING SYSTEM; STOCHASTIC CONTROL;

STOCHASTIC CONTROL SYSTEMS;

EID: 34247393197     PISSN: 02570130     EISSN: 15729443     Source Type: Journal    
DOI: 10.1007/s11134-007-9012-2     Document Type: Article

References (26)

1. Ata B. Dynamic control of a multiclass queue with thin arrival streams. Oper Res 2006;54(5):876-92.
2. Ata B, Harrison JM, Shepp LA. Drift rate control of a Brownian processing system. Ann Appl Probab 2005;15:1145-60.
3. Ata B, Shneorson S. Dynamic control of an M/M/1 service system with adjustable arrival and service rates. Manag Sci 2006;52(11):1778-91.
4. Bell SL, Williams RJ. Dynamic scheduling of a system with two parallel servers in heavy traffic with resource pooling: asymptotic optimality of a threshold policy. Ann Appl Probab 2001;11:608-49.
5. Borkar VS, Ghosh MK. Ergodic control of muti-dimensional diffusions I: the existence results. SIAM J Control Optim 1988;26:112-26.
6. Budhiraja A, Ghosh AP. A large deviations approach to asymptotically optimal control of crisscross network in heavy traffic. Ann Appl Probab 2005;15(3):1887-935.
7. Budhiraja A, Ghosh AP. Diffusion approximations for controlled stochastic networks: an asymptotic bound for the value function. Ann Appl Probab 2006;16(4):1962-2006.
8. Fleming WH, Soner HM. Controlled Markov processes and viscosity solutions. New York: Springer; 1993.
9. Foschini GJ, Salz J. A basic dynamic routing problem and diffusion. IEEE Trans Commun 1978;26:320-7.
10. George JM, Harrison JM. Dynamic control of a queue with adjustable service rate. Oper Res 2001;49:720-31.
11. Harrison JM. Brownian models of queueing networks with heterogeneous customer population. In Stochastic differential systems, stochastic control theory and applications. IMA volumes in mathematics and its applications, vol 10. New York: Springer; 1988. p. 147-86.
12. Harrison JM, Zeevi A. Dynamic scheduling of a multi-class queue in the Halfin-Whitt heavy traffic regime. Oper Res 2004;52:243-57.
13. Hartman P. Ordinary differential equations. New York: Wiley; 1964.
14. Karatzas I. A class of singular stochastic control problems. Adv Appl Probab 1983;15:225-54.
15. Kumar S, Muthuraman M. A numerical method for solving singular stochastic control problems. Oper Res 2004;52(4):563-82.
16. Kushner HJ. Optimality conditions for the average cost per unit time problem with a diffusion model. SIAM J Control Optim 1978;16:330-46.
17. Kushner HJ. Heavy traffic analysis of controlled queueing and communication networks. New York: Springer; 2001.
18. Kushner HJ, Dupuis P. Numerical methods for stochastic control problems in continuous time. New York: Springer: 2001.
19. Meyer PA. Un cours sur les integrales stochastiques, Seminare de probabilites X. Lecture notes in mathematics, vol 511. New York: Springer; 1974.
20. Ocone D, Weerasinghe A. Degenerate variance control in the one dimensional stationary case. Electron J Probab 2003;8:1-27.
21. Protter MH, Weinberger HF. Maximum principles in differential equations. New York: Springer; 1984.
22. Shreve SE, Soner HM. Optimal investment and consumption with transaction costs. Ann Appl Probab 1994;4:609-92.
23. Turner SRE. A join the shorter queue model in heavy traffic. J Appl Probab 2000;37(1):212-23.
24. Ward AR, Kumar S. (2006). Asymptotically optimal admission control of a queue with impatient customers. Preprint http://www.isye.gatech.edu/~amy/PAPERS/ RenegeControlFinal.pdf.
25. Weerasinghe A. Stationary control for Ito processes. Adv Appl Probab 2002;34:128-40.
26. Weerasinghe A. A bounded variation control problem for diffusion processes. SIAM J Control Optim 2005;44:389-417.