Optimality of randomized trunk reservation for a problem with a single constraint

Advances in Applied Probability

Volumn 38, Issue 1, 2006, Pages 199-220

  Fan Orzechowski, X ^a   Feinberg, Eugene A ^a  

^a Stony Brook University   (United States)

Author keywords

Admission control; Lagrangian optimization; Queue; Semi Markov decision process; Trunk reservation

Indexed keywords

COMPUTATIONAL COMPLEXITY; LAGRANGE MULTIPLIERS; LINEAR PROGRAMMING; MATHEMATICAL MODELS; OPTIMIZATION; PROBABILITY; QUEUEING THEORY;

ADMISSION CONTROL; LAGRANGIAN OPTIMIZATION; SEMI-MARKOV DECISION PROCESS; TRUNK RESERVATION;

MARKOV PROCESSES;

EID: 33646085780     PISSN: 00018678     EISSN: None     Source Type: Journal    
DOI: 10.1239/aap/1143936147     Document Type: Article

References (28)

1. Altman, E. (2002). Applications of Markov decision processes in telecommunication networks. In Handbook of Markov Decision Processes, eds E. Feinberg and A. Schwartz, Kluwer, Boston, MA, pp. 480-536.
2. Altman, E., Jimenez, T. and Koole, G. (2001). On optimal call admission control in a resource-sharing system. IEEE Trans. Commun. 49, 1659-1668.
3. Carrizosa, E., Conde, E. and Munoz-Márquez, M. (1998). Admission policies in loss queueing models with heterogeneous arrivals. Manag. Sci. 44, 311-320.
4. Crabili, T. B., Gross, D. and Magazine, M. J. (1977). A classified bibliography of research on optimal design and control of queues. Operat. Res. 25, 219-232.
5. Feinberg, E. A. (1994). Constrained semi-Markov decision processes with average rewards. Z. Operat. Res. 39, 257-288.
6. Feinberg, E. A. (2002). Constrained finite continuous-time Markov decision processes with average rewards. In Proc. IEEE 2002 Conf. Decisions Control (December 2002, Las Vegas), pp. 3805-3810.
7. Feinberg, E. A. (2004). Continuous time discounted jump Markov decision processes: a discrete-event approach. Math. Operat. Res. 29, 492-524.
8. Feinberg, E. A. (2005). On essential information in sequential decision processes. Math. Meth. Operat. Res. 62, 399-410.
9. Feinberg, E. A. and Reiman, M. I. (1994). Optimality of randomized trunk reservation. Prob. Eng. Inf. Sci. 8, 463-489.
10. Fiacco, A. V. and McCormick, G. P. (1990). Nonlinear Programming: Sequential Unconstrained Minimization Techniques. SIAM, Philadelphia, PA.
11. Hunt, P. J. and Laws, C. N. (1997). Optimization via trunk reservation in single resource loss systems under heavy traffic. Ann. Appl. Prob. 7, 1058-1079.
12. Kelly, F. P. (1990). Routing and capacity allocation in networks with trunk reservation. Math. Operat. Res. 15, 771-793.
13. Key, P. (1990). Optimal control and trunk reservation in loss networks. Prob. Eng. Inf. Sci. 4, 203-242.
14. Lewis, M. E. (2001). Average optimal policies in a controlled queueing system with dual admission control. J. Appl. Prob. 38, 369-385.
15. Lewis, M. E., Ayhan, H. and Foley, R. D. (1999). Bias optimality in a queue with admission control. Prob. Eng. Inf. Sci. 13, 309-327.
16. Lewis, M. E., Ayhan, H. and Foley, R. D. (2002). Bias optimal admission policies for a nonstationary multiclass queueing system. J. Appl. Prob. 39, 20-37.
17. Lin, K. Y. and Ross, S. M. (2003). Admission control with incomplete information of a queueing system. Operat. Res. 51, 645-654.
18. Lin, K. Y. and Ross, S. M. (2004). Optimal admission control for a single-server loss queue. J. Appl. Prob. 41, 535-546.
19. Lippman, S. A. (1975). Applying a new device in the optimization of exponential queuing systems. Operat. Res. 23, 687-710.
20. Mangasarian, O. L. (1969). Nonlinear Programming. McGraw-Hill, New York.
21. Miller, B. L. (1969). A queueing reward system with several customer classes. Manag. Sci. 16, 235-245.
22. Nguyen, V. (1991). Optimality of trunk reservation in overflow process. Prob. Eng. Inf. Sci. 5, 369-390.
23. Papastavrou, J. D., Rajagopalan, S. and Kleywegt A. J. (1996). The dynamic and stochastic knapsack problem with deadlines. Manag. Sci. 42, 1706-1718.
24. Piunovskiy, A. B. (2004). Bicriteria optimization of a queue with a controlled input stream. Queueing Systems 48, 159-184.
25. Puhalskii, A. A. and Reiman, M. I. (1998). A critically loaded multirate link with trunk reservation. Queueing Systems 28, 157-190.
26. Ross, K. W. (1995). Multiservice Loss Models for Broadband Telecommunication Networks. Springer, London.
27. Ross, K. W. and Yao, D. D. (1990). Monotonicity properties for the stochastic knapsack. IEEE Trans. Inf. Theory 36, 1173-1179.
28. Stidham, S., Jr. (1985). On optimal control of admission to a queueing system. IEEE Trans. Automatic Control 30, 705-713.