On the optimal control of arrivals to a single queue with arbitrary feedback delay

Queueing Systems

Volumn 27, Issue 1-2, 1997, Pages 1-16

  Kuri, Joy ^a   Kumar, Anurag ^b  

^a ÉCOLE POLYTECHNIQUE DE MONTRÉAL   (Canada)

^b INDIAN INSTITUTE OF SCIENCE   (India)

Author keywords

Delayed feedback information; Markov decision theory; Threshold policies

Indexed keywords

ACCESS CONTROL; COMPUTATION THEORY; DECISION THEORY; FEEDBACK; MARKOV CHAINS; QUEUEING THEORY;

CONTROLLED MARKOV CHAINS; DELAYED FEEDBACK; MARKOV DECISION THEORY; MULTI-DIMENSIONAL DYNAMIC PROGRAMMING; MULTI-DIMENSIONAL STATE; OPTIMAL VALUE FUNCTIONS; THRESHOLD POLICIES; UPPER AND LOWER BOUNDS;

DYNAMIC PROGRAMMING;

EID: 0031328931     PISSN: 02570130     EISSN: 15729443     Source Type: Journal    
DOI: 10.1023/a:1019145611110     Document Type: Article

References (13)

1. E. Altman and P. Nain, Closed-loop control with delayed information, Performance Evaluation Review 20 (1992) 193-204.
2. E. Altman and G. Koole, Stochastic scheduling games with Markov decision arrival processes, J. Comput. Math. Appl. (1993) 141-148.
3. E. Altman and G. Koole, Control of a random walk with noisy delayed information, Systems Control Lett. 24 (1995) 207-213.
4. E. Altman and S. Stidham, Optimality of monotonic policies for two-action Markovian decision processes, with applications to control of queues with delayed information, Report UNC/OR/TR-94-2, Univ. of North Carolina, Chapel Hill (1994).
5. D. Artiges, Optimal routing into two heterogeneous service stations with delayed information, IEEE Trans. Automat. Control 40 (1995) 1234-1236.
6. B. Hajek, Optimal control of two interacting service stations, IEEE Trans. Automat. Control 29 (1984) 491-499.
7. O. Hernández-Lerrna, Adaptive Markov Control Processes (Springer, 1989).
8. G. Koole, Optimal repairman assignment in two symmetric maintenance models, European J. Oper. Res. 82 (1995) 295-301.
9. P.R. Kumar and P.P. Varaiya, Stochastic Systems: Estimation, Identification and Adaptive Control (Prentice-Hall, 1986).
10. J. Kuri and A. Kumar, Optimal control of arrivals to queues with delayed queue length information, in: Proc. of 31st IEEE Conference on Decision and Control (1992) pp. 991-992.
11. J. Kuri and A. Kumar, Optimal control of arrivals to queues with delayed queue length information, IEEE Trans. Automat. Control 40 (1995) 1444-1450.
12. J. Kuri, Optimal control problems in communication networks with information delays and quality of service constraints, Ph.D. thesis, Indian Institute of Science (1995).
13. D. Stoyan, Comparison Methods for Queues and Other Stochastic Models (Wiley, 1983).