On the structure of value functions for threshold policies in queueing models

Journal of Applied Probability

Volumn 40, Issue 3, 2003, Pages 613-622

  Bhulai, Sandjai ^a   Koole, Ger ^b  

^a LUCENT TECHNOLOGIES   (United States)

^b VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

Difference equation; Multiserver queue; One step policy improvement; Threshold policy; Value function

Indexed keywords

EID: 0242676837     PISSN: 00219002     EISSN: None     Source Type: Journal    
DOI: 10.1239/jap/1059060891     Document Type: Article

References (8)

1. BERTSEKAS, D. P. AND TSITSIKLIS, J. N. (1996). Neuro-Dynamic Programming. Athena Scientific, Belmont, MA.
2. GROSS, D. AND HARRIS, C. M. (1985). Fundamentals of Queueing Theory, 2nd edn. John Wiley, New York.
3. KOOLE, G. M. AND NAIN, P. (2000). On the value function of a priority queue with an application to a controlled polling model. Queueing Systems 34, 199-214.
4. KOOLE, G. M. AND SPIEKSMA, F. (2001). On deviation matrices for birth-death processes. Prob. Eng. Inf. Sci. 15, 239-258.
5. MICKENS, R. E. (1990). Difference Equations: Theory and Applications, 2nd edn. Van Nostrand Reinhold, New York.
6. OTT, T. J. AND KRISHNAN, K. R. (1992). Separable routing: a scheme for state-dependent routing of circuit switched telephone traffic. Ann. Operat. Res. 35, 43-68.
7. PUTERMAN, M. L. (1994). Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley, New York.
8. STIDHAM JR, S. AND WEBER, R. R. (1993). A survey of Markov decision models for control of networks of queues. Queueing Systems 13, 291-314.