Control of polling in presence of vacations in heavy traffic with applications to satellite and mobile radio systems

SIAM Journal on Control and Optimization

Volumn 41, Issue 1, 2003, Pages 217-252

  Altman, Eitan ^a   Kushner, Harold J ^b  

^a INRIA   (France)

^b BROWN UNIVERSITY   (United States)

Author keywords

Communication networks; Heavy traffic analysis; Mobile communications; Optimal stochastic control; Polling; Queueing networks; Scheduling queues; Wireless communications

Indexed keywords

ASYMPTOTIC STABILITY; CONGESTION CONTROL (COMMUNICATION); COST EFFECTIVENESS; LYAPUNOV METHODS; MOBILE RADIO SYSTEMS; QUEUEING NETWORKS; RESOURCE ALLOCATION; SATELLITE COMMUNICATION SYSTEMS; TELECOMMUNICATION NETWORKS; TELECOMMUNICATION TRAFFIC;

HEAVY TRAFFIC ANALYSIS; OPTIMAL STOCHASTIC CONTROL; POLLING; SCHEDULING QUEUES;

OPTIMAL CONTROL SYSTEMS;

EID: 0037229226     PISSN: 03630129     EISSN: None     Source Type: Journal    
DOI: 10.1137/S0363012999358464     Document Type: Article

References (32)

1. E. Altman, D. Kofman, and U. Yechiali, Discrete time queues with delayed information, Queueing Systems, 19 (1995), pp. 361-376.
2. E. Altman and H. J. Kushner, Admission control for combined guaranteed performance and best effort communications systems under heavy traffic, SIAM J. Control Optim., 37 (1999), pp. 1780-1807.
3. E. Altman and A. Shwartz, Optimal priority assignment: A time sharing approach, IEEE Trans. Automat. Control, 34 (1989), pp. 1098-1102.
4. J. S. Baras, D. J. Ma, and A. M. Makowski, K competing queues with geometric service requirements and linear costs: The μc rule is always optimal, Systems Control Lett., 6 (1985), pp. 173-180.
5. P. Billingsley, Convergence of Probability Measures, Wiley, New York, 1968.
6. G. Blankenship and G. C. Papanicolaou, Stability and control of systems with wide-band noise disturbances. I, SIAM J. Appl. Math., 34, (1978), pp. 437-476.
7. M. Bramson, State space collapse with application to heavy traffic limits for multiclass queueing networks, Queueing Systems, 30 (1999), pp. 89-148.
8. M. Carr and B. Hajek, Scheduling with asynchronous service opportunities with applications to multiple satellite systems, IEEE Trans. Automat. Control, 38 (1993), pp. 1820-1833.
9. D. R. Cox and W. L. Smith, Queues, Methuen, London, 1961.
10. P. Dupuis and H. Ishii, On Lipschitz continuity of the solution mapping to the Skorokhod problem, with applications, Stochastics Stochastics Rep., 35 (1991), pp. 31-62.
11. B. R. Elbert, The Satellite Communication Applications Handbook, Artech House, Boston, London, 1997.
12. S. N. Ethier and T. G. Kurtz, Markov Processes: Characterization and Convergence, Wiley, New York, 1986.
13. S. Karlin and H. M. Taylor, A First Course in Stochastic Processes, 2nd ed., Academic Press, New York, 1975.
14. R. Z. Khasminskii, Stochastic Stability of Differential Equations, Sijthoff, Noordhoff, Alphen aan den Rijn, Amsterdam, 1982.
15. H. Kunita and S. Watanabe, On square integrable martingales, Nagoya Math. J., 30 (1967), pp. 209-245.
16. H. J. Kushner, Stochastic Stability and Control, Academic Press, New York, 1967.
17. H. J. Kushner, Approximation and Weak Convergence Methods for Random Processes with Applications to Stochastic Systems Theory, MIT Press, Cambridge, MA, 1984.
18. H. J. Kushner, Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems, Systems and Control, Vol. 3, Birkhäuser, Boston, 1990.
19. H. J. Kushner and P. Dupuis, Numerical Methods for Stochastic Control Problems in Continuous Time, 2nd ed., Springer-Verlag, Berlin, New York, 2001.
20. H. J. Kushner, D. Jarvis, and J. Yang, Controlled and optimally controlled multiplexing systems: A numerical exploration, Queueing Systems, 20 (1995), pp. 255-291.
21. H. J. Kushner and K. M. Ramachandran, Optimal and approximately optimal control policies for queues in heavy traffic, SIAM J. Control Optim., 27 (1989), pp. 1293-1318.
22. H. J. Kushner and G. Yin, Stochastic Approximation Algorithms and Applications, Springer-Verlag, Berlin, New York, 1997.
23. R. Liptser and A. N. Shiryaev, Statistics of Random Processes, Springer-Verlag, Berlin, New York, 1977.
24. W. P. Peterson, Diffusion approximations for networks of queues with multiple customer types, Math. Oper. Res., 9 (1951), pp. 90-118.
25. M. I. Reiman, Some diffusion approximations with state space collapse, in Proceedings of the Int. Seminar on Modelling and Performance Evaluation Methodology, Paris, 1983, F. Baccelli and G. Fayolle, eds., Springer-Verlag, New York, 1983, pp. 209-240.
26. M. I. Reiman, A multiclass feedback queue in heavy traffic, Adv. Appl. Probab., 20 (1998), pp. 179-207.
27. V. Solo and X. Kong, Adaptive Signal Processing Algorithms, Prentice-Hall, Englewood Cliffs, NJ, 1995.
28. T. Tassiulas and A. Ephremides, Dynamic server allocation to parallel queues with randomly varying connectivity, IEEE Trans. Automat. Control, 39 (1993), pp. 466-478.
29. L. Tassiulas and S. Papavassiliou, Optimal anticipative scheduling with asynchronous transmission opportunities, IEEE Trans. Automat. Control, 40 (1995), pp. 2052-2062.
30. J. A. van Mieghem, Dynamic scheduling with convex delay costs: The generalized cμ rule, Ann. Appl. Probab., 5 (1995), pp. 809-833.
31. J. Walrand, An Introduction to Queuing Networks, Prentice-Hall, Englewood Cliffs, NJ, 1988.
32. R. J. Williams, Diffusion approximations for open multiclass queueing networks: Sufficient conditions involving state space collapse, Queueing Systems, 30 (1998), pp. 27-88.