Bias optimality in controlled queueing systems

Journal of Applied Probability

Volumn 35, Issue 1, 1998, Pages 136-150

  Haviv, Moshe ^a,b   Puterman, Martin L ^c  

^a UNIVERSITY OF SYDNEY   (Australia)

^b HEBREW UNIVERSITY OF JERUSALEM   (Israel)

^c UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Admission control; Average reward; Blackwell optimality; Control limit policies; Markov decision processes; Uniformization

Indexed keywords

EID: 0032400452     PISSN: 00219002     EISSN: None     Source Type: Journal    
DOI: 10.1017/S0021900200014741     Document Type: Article

References (13)

1. BERTSEKAS, D. (1987). Dynamic Programming: Deterministic and Stochastic Models. Prentice-Hall, Englewood Cliffs, NJ.
2. BLACKWELL, D. (1962). Discrete dynamic programming. Ann. Math. Statist. 33, 719-726.
3. DEKKER, R. AND HORDIJK, A. (1988). Average, sensitive and Blackwell optimal policies in denumerable Markov decision chains with unbounded rewards. Math. Operat. Res. 13, 395-420.
4. HOWARD, R. (1960). Dynamic Programming and Markov Processes. MIT Press, Cambridge, MA.
5. LASSERRE, J. (1988). Conditions for existence of average and Blackwell optimal stationary policies in denumerable Markov decision chains. J. Math. Anal. Appl. 136, 479-490.
6. LIPPMAN, S. (1975). Applying a new device in the optimization of exponential queueing systems. Operat. Res. 23, 687-710.
7. MAHADEVAN, S. (1996). An average-reward reinforcement learning algorithm for computing bias-optimal policies. AAAI Proc.
8. PUTERMAN, M.L. (1994). Markov Decision Processes. Wiley, New York.
9. PUTERMAN, M.L. AND THOMAS, L.C. (1987). A note on computing optimal control limits for GI/M/1 queuing systems. Management Sci. 33, 939-943.
10. SPIEKSMA, F. (1991). The existence of sensitive optimal policies in two multi-dimensional queueing models. Ann. Operat. Res. 28, 273-295.
11. STIDHAM, S.S., JR. (1978). Socially and individually optimal control of arrivals to a GI/M/1 queue. Management Sci. 24, 1598-1610.
12. VEINOTT, A.F., JR. (1966). On finding optimal policies in discrete dynamic programming with no discounting. Ann. Math. Statist. 37, 1284-1294.
13. VEINOTT, A.F., JR. (1974). Markov decision chains. In Studies in Optimization. ed. G.B. Dantzig and B.C. Eaves. American Mathematical Association, Providence, RI. pp. 124-159.