Average optimal policies in a controlled queueing system with dual admission control

Journal of Applied Probability

Volumn 38, Issue 2, 2001, Pages 369-385

  Lewis, Mark E ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Markov and semi Markov processes; Queueing theory

Indexed keywords

EID: 0035613394     PISSN: 00219002     EISSN: None     Source Type: Journal    
DOI: 10.1239/jap/996986750     Document Type: Article

References (18)

1. ALTMAN, E. (1996). Non zero-sum stochastic games in admission, service, and routing control in queueing systems. Queueing Systems 23, 256-279.
2. ALTMAN, E. (1999). A Markov game approach for optimal routing into a queueing network. In Stochastic and Differential Games (Ann. Int. Soc. Dynamic Games 5), eds M. Bardi, T. E. S. Raghavan and T. Parthasarathy. Birkhäuser, Boston, pp. 359-376.
3. ALTMAN, E. (2001). Applications of Markov decision processes in telecommunications: a survey. To appear in Markov Decision Processes: Models, Methods, Directions and Open Problems, eds E. Feinberg and A. Schwartz. Kluwer, Dordrecht.
4. ALTMAN, E. AND STIDHAM, S., JR. (1995). Optimality of monotonic policies for two-action Markovian decision processes, with applications to control of queues with delayed information. Queueing Systems 21, 267-291.
5. GHONEIM, H. A. AND STIDHAM, S., JR. (1985). Control of arrivals to two queues in series. Eur. J. Operat. Res. 21, 399-409.
6. HAJEK, B. (1984). Optimal control of two interacting service stations. IEEE Trans. Automatic Control 29, 491-499.
7. HELM, W. E. AND WALDMANN, K.-H. (1984). Optimal control of arrivals to multi-server queues in a random environment. J. Appl. Prob. 21, 602-615.
8. HERNÁNDEZ-LERMA, O. AND LASSERRE, J. B. (1996). Discrete-Time Markov Control Processes: Basic Optimality Criteria. Springer, New York.
9. HEYMAN, D. P. (1968). Optimal operating policies for M/G/1 queueing systems. Operat. Res. 16, 362-382.
10. LEWIS, M. E. AND PUTERMAN, M. L. (2000). A note on bias optimality in controlled queueing systems. J. Appl. Prob. 37, 300-305.
11. LEWIS, M. E. AND PUTERMAN, M. L. (2001). A probabilistic analysis of bias optimality in unichain Markov decision processes. IEEE Trans. Automatic Control 46, 1-5.
12. LIPPMAN, S. A. (1975). Applying a new device in the optimization of exponential queueing systems. Operat. Res. 23, 687-712.
13. LIPPMAN, S. A. AND ROSS, S. M. (1971). The streetwalker's dilemma: a job shop model. SIAM J. Appl. Math. 20, 336-342.
14. MILLER, B. L. (1969). A queueing reward system with several customer classes. Management Sci. 16, 234-245.
15. PUTERMAN, M. L. (1994). Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley, New York.
16. STIDHAM, S., JR. (1985). Optimal control of admission to a queueing system. IEEE Trans. Automatic Control 30, 705-713.
17. XU, S. H. AND SHANTHIKUMAR, J. G. (1993). Optimal expulsion control - a dual approach to admission control of an ordered-entry system. Operat. Res. 41, 1137-1152.
18. YADIN, M. AND NAOR, P. (1963). Queueing systems with a removable service station. Operat. Res. Quart. 14, 393-405.