Optimal control of queueing systems with heterogeneous servers

Queueing Systems

Volumn 46, Issue 3-4, 2004, Pages 389-407

  Rykov, V ^a,b   Efrosinin, D ^c,d  

^a GUBKIN RUSSIAN STATE UNIVERSITY OF OIL AND GAS   (Russian Federation)

^b KETTERING UNIVERSITY   (United States)

^c PEOPLES FRIENDSHIP UNIVERSITY OF RUSSIA   (Russian Federation)

^d UNIVERSITY OF TRIER   (Germany)

Author keywords

Controllable queueing systems; Monotonicity of optimal policies; Numerical analysis

Indexed keywords

NUMERICAL ANALYSIS; QUEUEING THEORY;

HETEROGENEOUS SERVERS; MULTI-SERVER; OPTIMAL CONTROLS; OPTIMAL POLICIES; QUEUE LENGTHS; QUEUEING SYSTEM; THRESHOLD PROPERTIES;

QUEUEING NETWORKS;

EID: 3543064608     PISSN: 02570130     EISSN: 15729443     Source Type: Journal    
DOI: 10.1023/b:ques.0000027992.91461.1e     Document Type: Conference Paper

References (22)

1. E. Altman and G. Koole, On submodular functions of dynamic programming, Technical Report 2658, INRIA, Sophia Antipolis (1995).
2. P. Glasserman and D.D. Yao, Monotone Structure in Discrete Event Systems (Wiley, New York, 1994).
3. R.A. Howard, Dynamic Programming and Markov Processes (Wiley, New York, 1960).
4. W.S. Jewell, Controllable semi-Markov processes, Cybernet. Sb. 4 (1967) 97-137.
5. M. Yu. Kitaev and V.V. Rykov, Controlled Queueing Systems (CRC Press, New York, 1995).
6. P. Langrock and W.W. Rykow, Methoden und Modelle zur Steurung von Bedienungssystemen, in: Handbuch der Bedienungstheorie B, Vol. 2 (Akademie-Verlag, Berlin, 1984) pp. 422-486.
7. O.H. Lerma and J.B. Lassere, Discrete-Time Markov Control Processes, Applications of Mathematics (Springer, New York, 1996).
8. W. Lin and P.R. Kumar, Optimal control of a queueing system with two heterogeneous servers, IEEE Trans. Automat. Control 29 (1984) 696-703.
9. H.P. Luh and I. Viniotis, Threshold control policies for heterogeneous server systems, Math. Methods Oper. Res. 55 (2002) 121-142.
10. H. Mine and S. Osaki, Markovian Decision Processes, Vol. XI (Elsevier, Amsterdam, 1970).
11. A.B. Piunovskiy, Optimal Control of Random Sequences in Problems with Constraints (Kluwer Academic, Dordrecht, 1997).
12. M.L. Puterman, Markov Decision Processes, Wiley Series in Probability and Mathematical Statistics (Wiley, New York, 1994).
13. Sh. Ross, Applied Probability Models with Optimization Applications (Holden Day, San Francisco, CA, 1970).
14. V.V. Rykov, Markov decision processes with finite state and decision spaces, Probab. Theory Appl. 11(2) (1966) 302-311.
15. V.V. Rykov, Controllable queueing systems, in: Itogi Nauki i Techniki. Teoria Verojatn. Matem. Statist. Teoretich. Kibern., Vol. 12 (1975) (In Russian) pp. 45-152. English translation in Soviet Math.
16. V.V. Rykov, On monotonicity conditions for optimal policies for controlling queueing systems, Automat. Remote Control 60(9) (1999) 1290-1301.
17. V.V. Rykov, Monotone Control of queueing systems with heterogeneous servers, Queueing Systems 37 (2001) 391-403.
18. L. Sennott, Stochastic Dynamic Programming and Control of Queueing Systems (Wiley, New York, 1999).
19. Sh. Stidham Jr., Optimal control of admission to a queueing system, IEEE Trans. Automat. Control 30 (1985) 705-713.
20. Sh. Stidham Jr. and R. Weber, A survey of Markov decision models for control of networks of queues, Queueing Systems 13 (1993) 291-314.
21. D. Topkis, Minimizing a submodular function on a lattice, Oper. Res. 26(2) (1978) 305-321.
22. F. Wolf and G. Danzig, Markov chains and linear programming, Cybernet. Sb. 4 (1967) 86-96.